Pandas Undersampling for Imbalanced Binary Classification

Python

An example of how to handle imbalanced data in Python. This is based on the titanic dataset. Here we split the main dataframe into separate survived and deceased dataframe. The deceased dataframe is the larger dataframe so we sample the same number of rows from this dataframe as there are in the survived dataframe to make them the same size. We then concat both data frames back together to create a dataframe that is balanced.

 1|  survived = df[df['survived']==1]
 2|  deceased = df[df['survived']==0]
 3|  deceased = deceased.sample(n=len(survived), random_state=101)
 4|  df = pd.concat([survived,deceased],axis=0)
analyseup
Pandas | Binary-classification
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

133
LightGBM Custom Loss Function
Python

LightGBM | Loss function

121
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

117
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

109
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

79
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

77
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

77
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

61
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

60
Overwriting a Python Logging File Instead of Appending
Python

Logging

55