Select Columns by Masking Using Itertools Compress and a Filter List

Python

In this example we use compress from itertools to select columns in a dataframe by using a filter list of boolean values as a mask. Here we've manually defined the filter list but this could be derived in other ways such as through a recursive feature elimination algorithm.

The original dataframe has four columns but only the 1st, 3rd and 4th columns will be kept.

 1|  from itertools import compress
 2|  
 3|  filter_list = [True, False, True, True]
 4|  cols = compress(df.columns, filter_list)
 5|  cols = list(cols)
 6|  df.columns = cols
detro
Filter | Compress | Itertools | Masking
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

149
LightGBM Custom Loss Function
Python

LightGBM | Loss function

132
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

127
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

119
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

92
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

91
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

86
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

68
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

68
Overwriting a Python Logging File Instead of Appending
Python

Logging

65