Linked Questions

0 votes
2 answers
384 views

I'm trying to scrape two tables using beautifulsoup and running into a brick wall. Website: https://bgp.he.net/country/US I'm trying to grab the header row from the table, but for some reason can't ...
Jordan Newman's user avatar
0 votes
1 answer
122 views

I am trying to learn how to parse HTML data so I've chosen this website (http://ets.aeso.ca/ets_web/ip/Market/Reports/CSMPriceReportServlet) which has real time data for electricity prices. from ...
Michael O'Connell's user avatar
40 votes
3 answers
150k views

My local airport disgracefully blocks users without IE, and looks awful. I want to write a Python scripts that would get the contents of the Arrival and Departures pages every few minutes, and show ...
Adam Matan's user avatar
  • 138k
2 votes
3 answers
3k views

I want to find the value of a <td> that "belongs" to a <th>? I can search for the text in the <th> tag and find it, but I do not know the value and there is no class to ...
2by's user avatar
  • 1,093
1 vote
3 answers
1k views

Beginner to BeautifulSoup, I am trying to extract the Company Name, Rank, and Revenue from this wikipedia link. https://en.m.wikipedia.org/wiki/List_of_largest_Internet_companies The code I've used so ...
Compoot's user avatar
  • 2,377
2 votes
3 answers
848 views

I was trying to make a list of all the top 1000 instagramer's acount from this website:'https://hypeauditor.com/top-instagram/'. The list that returns from lxml is empty for both lxml.html and lxml....
Onlyfood's user avatar
  • 137
0 votes
2 answers
2k views

What I'm trying to do is to convert the scraped data I get from the URL to JSON object. import bs4 as bs from urllib.request import Request, urlopen import json req = Request('https://www....
van123's user avatar
  • 123
1 vote
2 answers
2k views

Using BeautifulSoup I am trying to scrape MarketWatch from bs4 import BeautifulSoup import requests import pandas url = "https://www.marketwatch.com/investing/stock/khc/profile" # Make a GET request ...
gabboshow's user avatar
  • 5,589
0 votes
2 answers
2k views

My goal is grab all of the court case numbers and put them into an Excel folder. The cases are in the 2nd column My code: courtCases = driver.find_elements_by_css_selector('body > table:nth-...
John's user avatar
  • 1
0 votes
2 answers
2k views

I'm having problems parsing table data with BeautifulSoup, though I've tried many solutions found here, here, and here. I hate to re-ask but maybe my issue is unique and that is why the above ...
Aaron Nelson's user avatar
1 vote
1 answer
2k views

I have a task that I think my python skills far slightly short at. I have a oil production data scraped from an open data website and looking to turn this into a json format. At present with some ...
Chris's user avatar
  • 69
0 votes
1 answer
2k views

I am trying to scrape the New Hampshire Secretary of State's website on registered voters. So far I have been able to get the text of the website in Beautiful soup with the following code: import ...
user avatar
1 vote
3 answers
1k views

I want to create a table in a browser that's been created with python. That part can be done by using DataTable of the bokeh library. The problem is that I want to extract data from the table when a ...
Infi's user avatar
  • 255
1 vote
1 answer
756 views

I am trying to read a table from a web-page. Generally, my company has strict authentication policies restricting us in the way we can scrape the data. But the following code is how I am trying to use ...
jack ryan's user avatar
-1 votes
1 answer
1k views

For example, here is an address: https://pesdb.net/pes2021/?id=44379 There seems to be no api call (I am pretty new to this but I checked XHR in network monitor and there are no relevant json calls).
Abdul Azeem's user avatar

15 30 50 per page