Converting Values to NaNs in All Columns

Python

Example of how to impute data in all columns. In this example we are replacing any values that are question marks to NaNs.

 1|  import pandas as pd
 2|  import numpy as np
 3|  
 4|  #If value in dataframe is ? then return NaN, otherwise return the value unchanged.
 5|  def impute_data(x):
 6|      if x == "?":
 7|          return np.NaN
 8|      else:
 9|          return x
10|  
11|  for col, content in data.items():
12|      data[col] = data[col].apply(impute_data)
Greg He
Pandas | Data-cleaning | Numpy
Did you find this snippet useful?

Sign up for free to to add this to your code library

Remove Stop Words from Text in DataFrame Column
Python

Pandas | Nltk | Nlp

133
LightGBM Custom Loss Function
Python

LightGBM | Loss function

121
Tuning XGBoost Hyperparameters with Grid Search
Python

XGBoost | Tuning

117
How to Convert DataFrame Values Into Percentages
Python

Lambda | Percentages | Pipe

109
How to Scale Data Using Standard Scaler But Keep Column Names
Python

Scaler | Standard

79
LightGBM Hyperparameter Tuning with GridSearch
Python

Python | LightGBM | Hyperparameter tuning | Gridsearch

77
Calculating Root Mean Squared Error (RMSE) with Sklearn and Python
Python

Rmse

77
Dynamically Create Columns in Pandas Dataframe
Python

Pandas | Columns

61
How to Train a Catboost Classifier with GridSearch Hyperparameter Tuning
Python

Catboost | Hyperparameter tuning

60
Overwriting a Python Logging File Instead of Appending
Python

Logging

55