BeautifulSoup - Search by text inside a tag

BeautifulSoup - Search by text inside a tag

Using BeautifulSoup, you can search for tags based on their text content. This can be particularly useful when you want to find elements with specific textual content.

Here's how to search by text inside a tag using BeautifulSoup:

1. Install the required libraries:

If you haven't already installed beautifulsoup4 and lxml (a parser for BeautifulSoup):

pip install beautifulsoup4 lxml

2. Use the string argument in find() or find_all():

from bs4 import BeautifulSoup html = """ <html> <body> <div>Hello, World!</div> <div>Welcome to the tutorial</div> <div>Hello, User!</div> </body> </html> """ soup = BeautifulSoup(html, 'lxml') # Find a single div containing the text 'Hello, World!' result = soup.find('div', string='Hello, World!') print(result) # Find all divs that contain the word 'Hello' results = soup.find_all('div', string=lambda text: 'Hello' in text if text else False) for r in results: print(r)

3. Use CSS selectors with the select() method:

If you prefer using CSS selectors, you can combine the :contains pseudo-class to search for tags containing specific text:

# Find all divs that contain the word 'Hello' results = soup.select('div:contains("Hello")') for r in results: print(r)

However, note that the :contains pseudo-class is not a standard CSS selector but is specific to certain libraries like jQuery. BeautifulSoup supports it for convenience.

Important:

The string parameter in find() or find_all() does an exact match by default. If you want to do a partial match or apply some logic, you should provide a function, as shown in the example above.

More Tags

hidden-field google-drive-realtime-api output-formatting sapply webbrowser-control uivideoeditorcontroller acl internationalization umbraco bitmap

More Programming Guides

Other Guides

More Programming Examples