Pandas read_csv prevent quotes in file from being part of data

Question

I'm reading data from a CSV that has single quotes, but I don't want the quotes to be part of the internal data. I'm used to the tradition that quotes are optional, and can be used to handle commas within the string fields. So rather than changing the input file, how I can remove quotes using Pandas, rather than stripping them out in the code itself.

dfRules = pd.read_csv(filenameRules, quoting=csv.QUOTE_NONE, quotechar="'") print ("---- Data Head ---- ") print (dfRules.head())

DataFile

PAYEECONTAINS,CATEGORY 'SOUTHWEST AIRLINES','Travel' 'GODADDY','Internet Services' 'AIRBNB','Travel'

Output:

---- Data Head ---- PAYEECONTAINS CATEGORY 0 'SOUTHWEST AIRLINES' 'Travel' 1 'GODADDY' 'Internet Services' 2 'AIRBNB' 'Travel'

Davide Fiocco · Accepted Answer · 2019-12-01 19:58:12Z

2

I think

dfRules = pd.read_csv(filenameRules, quoting=csv.QUOTE_MINIMAL, quotechar="'")

may solve.

edited Dec 1, 2019 at 19:58

answered Dec 1, 2019 at 19:47

Davide Fiocco

6,0395 gold badges43 silver badges79 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Pandas read_csv prevent quotes in file from being part of data

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related