How can I exclude columns in a Daraframe if the content of a row contains a specific substring?

Question

This question touches upon the problem that I am facing. However, instead of excluding columns based on an exact string match, I want to exclude columns if a particular substring matches.

For example, in the image below, I would like to filter out columns A and C because they contain the substring 'is'

How would I go on about doing this? I replaced df.loc[:, ~(df == 'Salty').any()] from @cs95's answer to df.loc[:, ~(re.findall('/\w+(?:is)\w+/', df)).any()] but this gives me a

TypeError: expected string or bytes-like object

Any help would be appreciated!

Input

|---------------------|------------------|----------------|----------| | | A | B | C | |---------------------|------------------|----------------|----------| | Value | Red | Green |Blue | |---------------------|------------------|----------------|----------| | 12 | HotisGood | Warm |isGood | |---------------------|------------------|----------------|----------|

Output

|---------------------|--------------| | | B | |---------------------|--------------| | Value | Green | |---------------------|--------------| | 12 | Warm | |---------------------|--------------|

halfer · Accepted Answer · 2021-10-08 22:38:29Z

3

You can do:

cols = df.apply(lambda x: x.str.contains('is').any()) df.loc[:, ~cols]

Output:

 B Value Green 12 Warm

edited Oct 8, 2021 at 22:38

halfer

20.2k20 gold badges110 silver badges207 bronze badges

answered May 19, 2020 at 19:32

Quang Hoang

151k11 gold badges64 silver badges86 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Mega_Noob Over a year ago

Hi! I included the sample input table and output table - is the image not visible/corrupted? Should I re-upload it?

Quang Hoang Over a year ago

@Mega_Noob no, images are not encouraged, see a guide to ask good question.

Mega_Noob Over a year ago

Understood, thank you. I will update the question right away - jbtw the output is the exact opposite of what I want (which is to exclude the columns that are being shown now and keep everything else)

Quang Hoang Over a year ago

@Mega_Noob please see updated. As you also see, the text data helps me debug my code and reproduce your expected outcome easily.

Mega_Noob Over a year ago

Thanks a ton! I'll keep formatting in mind for the future

Collectives™ on Stack Overflow

How can I exclude columns in a Daraframe if the content of a row contains a specific substring?

1 Answer 1

5 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Linked

Related