Drop Duplicate Values in a Pandas DataFrame Column

Python

 1|  # Will drop any rows that contain duplicate values in the Name column 
 2|  # but will keep the first row that contains a duplicated value
 3|  df.drop_duplicates(subset=['Name'], inplace=True)
 4|  
 5|  # Will drop any rows that contain duplicate values in the Name column 
 6|  # but will keep the last row that contains a duplicated value
 7|  df.drop_duplicates(subset=['Name'], keep='last', inplace=True)
 8|  
 9|  # Will drop any rows that contain duplicate values in the Name column
10|  df.drop_duplicates(subset=['Name'], keep=False, inplace=True)
detro
Drop_duplicates
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

133
LightGBM Custom Loss Function
Python

LightGBM | Loss function

121
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

116
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

109
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

78
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

77
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

77
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

61
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

60
Overwriting a Python Logging File Instead of Appending
Python

Logging

55