Pandas Undersampling for Imbalanced Binary Classification

Python

An example of how to handle imbalanced data in Python. This is based on the titanic dataset. Here we split the main dataframe into separate survived and deceased dataframe. The deceased dataframe is the larger dataframe so we sample the same number of rows from this dataframe as there are in the survived dataframe to make them the same size. We then concat both data frames back together to create a dataframe that is balanced.

 1|  survived = df[df['survived']==1]
 2|  deceased = df[df['survived']==0]
 3|  deceased = deceased.sample(n=len(survived), random_state=101)
 4|  df = pd.concat([survived,deceased],axis=0)
analyseup
Pandas | Binary-classification
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

147
LightGBM Custom Loss Function
Python

LightGBM | Loss function

131
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

125
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

118
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

89
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

89
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

85
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

67
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

67
Overwriting a Python Logging File Instead of Appending
Python

Logging

63