Remove Usernames & HTTP Links From Tweet Data

Python

Here we have tweet data in a dataframe column. We use declare a function that uses regex to remove any words the start with '@' (usernames) or 'http' (links). We then use Pandas apply to pass each tweet in the dataframe to the function to process the data.

 1|  import re
 2|  
 3|  def remove_usernames_links(tweet):
 4|      tweet = re.sub('@[^\s]+','',tweet)
 5|      tweet = re.sub('http[^\s]+','',tweet)
 6|      return tweet
 7|  df['tweet'] = df['tweet'].apply(remove_usernames_links)
detro
Twitter | Regex | Text
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

133
LightGBM Custom Loss Function
Python

LightGBM | Loss function

121
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

117
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

109
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

79
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

77
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

77
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

61
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

60
Overwriting a Python Logging File Instead of Appending
Python

Logging

55