I have this text file:
LEU,LEID,PPP,YYY,LEO '1','2','3','4','5' '2','1','2','3','4' '2','AA','','','' I want to delete the rows where for LEID='1'
import pandas as pd import os originalFile=os.path.abspath("D:\\python\\test\\OriginalFile.csv") df = pd.read_csv(originalFile) df = df[(df['LEID'] !='1')] df.to_csv('D:\\python\\test\\CorrectedFile.csv') print (df) Why the row with LEID='1' is not delted?
As you have it, the quote characters are still included in your dataframe. It probably looks like:
>>> df LEU LEID PPP YYY LEO 0 '1' '2' '3' '4' '5' 1 '2' '1' '2' '3' '4' 2 '2' 'AA' '' '' '' So you would actually need to include those quotes in your filter. You can do this like:
df[df['LEID'] != "'1'"] # or: df[df['LEID'] !='\'1\''] LEU LEID PPP YYY LEO 0 '1' '2' '3' '4' '5' 2 '2' 'AA' '' '' '' An alternative would be to remove your single quotes when you read the csv:
df = pd.read_csv(originalFile, sep=',', quotechar="'") And you will get this dataframe:
>>> df LEU LEID PPP YYY LEO 0 1 2 3.0 4.0 5.0 1 2 1 2.0 3.0 4.0 2 2 AA NaN NaN NaN Which you can filter like you were trying:
df[df['LEID' ]!= '1'] LEU LEID PPP YYY LEO 0 1 2 3.0 4.0 5.0 2 2 AA NaN NaN NaN 
df[(df['LEID'] !='1')] selects on columns. You need df.loc[df['LEID'] !='1']
