Drop Duplicate Values in a Pandas DataFrame Column

Python

Data Preprocessing

 1|  # Will drop any rows that contain duplicate values in the Name column 
 2|  # but will keep the first row that contains a duplicated value
 3|  df.drop_duplicates(subset=['Name'], inplace=True)
 4|  
 5|  # Will drop any rows that contain duplicate values in the Name column 
 6|  # but will keep the last row that contains a duplicated value
 7|  df.drop_duplicates(subset=['Name'], keep='last', inplace=True)
 8|  
 9|  # Will drop any rows that contain duplicate values in the Name column
10|  df.drop_duplicates(subset=['Name'], keep=False, inplace=True)

DETRO

1 Upvote

Tags: Drop_duplicates

Did you find this snippet useful?

Sign up to bookmark this in your snippet library

Normalize Windowed Time Series

Python

Data Preprocessing

Scaler | Normalize | Scale | Min-max

4

Convert All Non-numeric Columns to Category Data Types

Python

Data Preprocessing

4

Creating a Running Total Column in Pandas

Python

Data Preprocessing

3

Pivoting Pandas Dataframes

Python

Data Preprocessing

3

Renaming Columns in a Pandas Dataframe Using Dictionaries & Lists

Python

Data Preprocessing

2

How to Remove Punctuation From Text with Python

Python

Data Preprocessing

Nlp | String | Punctuation

2

How To Set First Row of a Pandas Dataframe as Column Headers

Python

Data Preprocessing

2

How to Create Different Aggregations Using GroupBy, Agg & Dictionaries

Python

Data Preprocessing

2

Using Pandas GroupBy Transform Function

Python

Data Preprocessing

Transform | Groupby

2

Extract Date & Time Features From a Pandas Date Column

Python

Data Preprocessing

2