How can I drop rows in pandas based on a condition

Question

I'm trying to drop some rows in a pandas data frame, but I'm getting this error: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame.

I have a list of desired items that I want to stay in the Data Frame, so I wrote this:

#

import sys import pandas as pd biog = sys.argv[1] df = pd.read_csv(biog, sep ='\t') desired = ['Affinity Capture-Luminescence', 'Affinity Capture-MS', 'Affinity Capture-Western', 'Co-crystal Structure', 'Far Western', 'FRET', 'PCA', 'Reconstituted Complex'] new_df = df[['OFFICIAL_SYMBOL_A','OFFICIAL_SYMBOL_B','EXPERIMENTAL_SYSTEM']] for i in desired: print(i) new_df.drop(new_df[new_df.EXPERIMENTAL_SYSTEM != i].index, inplace = True) print(new_df)

#

it works if I place a single condition at a time, but when the for loop is inserted it doesn't work.

I didn't placed here the data because it is too large, I hope that this is enough.

thanks for the help

Does this answer your question? delete rows based on a condition in pandas — foglerit
– foglerit, Commented Apr 14, 2020 at 21:38

mrbTT · Accepted Answer · 2020-04-14 21:21:27Z

1

You can set a new df of when a column is in a list of values. No need to loop it.

new_df = new_df[new_df['EXPERIMENTAL_SYSTEM'].isin(desired)]

answered Apr 14, 2020 at 21:21

mrbTT

1,4092 gold badges20 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

mrbTT Over a year ago

@LucasLazari, no problem! Could you mark it as the correct answer? It's the checkmark just bellow the upvote/downvote arrows.

Collectives™ on Stack Overflow

How can I drop rows in pandas based on a condition

1 Answer 1

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Linked

Related