Including None in dataframe filter

Question

I have a dataframe called df:

 col1 col2 1 2 3 3 7 8 5 2 12 8 5 None

I want to use pandas.series.isin to filter the data frame, where I want to filter the data from df where the col2 only includes number 2,8 and None, so the new data frame is:

 col1 col2 1 2 7 8 5 2 12 8 5 None

I tried:

filter1 = [2,8,'None'] filter2 = [2,8,np.nan] filter3 = [2,8,''] df.col2.isin(filter1) df.col2.isin(filter2) df.col2.isin(filter3)

And the result is always:

 col1 col2 1 2 7 8 5 2 12 8

it seems I am unable to identify what is None and how to include it into the filter.

df where the col2 only includes number 2,8 and None...What if there's a NaN in col2 should output df include NaN or not? — Ch3steR
– Ch3steR, Commented Aug 3, 2020 at 12:46

ansev · Accepted Answer · 2020-08-03 12:39:32Z

3

if you want to include any null value:

filter = df['col2'].isin([2,8]) | df['col2'].isnull() df_filtered = df.loc[filter]

answered Aug 3, 2020 at 12:39

ansev

31k5 gold badges21 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

EddyG · Accepted Answer · 2020-08-03 12:33:07Z

2

Exclude the '' when passing None in your filter

filter1 = [2,8,None]

answered Aug 3, 2020 at 12:33

EddyG

6854 silver badges13 bronze badges

Collectives™ on Stack Overflow

Including None in dataframe filter

2 Answers 2

Comments

Comments

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Related