Linked Questions

16 votes
0 answers
6k views

I'm using Selenium in Python to perform some web scraping in Chrome. The scraper loads a page, types a search in a searchbox, solves a basic captcha, scrapes the data, and repeats. Problem The ...
OscarVanL's user avatar
  • 739
1 vote
0 answers
2k views

I am running a scraper created using Python 3.7, Selenium 3.141.0, Google Chrome 77.0.3865.90 and ChromeDriver 77.0.3865.40 on Ubuntu 18.04. Problem: As the script continues scraping more pages, the ...
Nyxynyx's user avatar
  • 64.1k
1 vote
0 answers
1k views

I'm coding a scripts that needs Selenium. As you know it requires lots of RAM power. So I tried with different browsers for the same script. Firefox required 120MB, Opera about 60MB. The best result I ...
giacomomaraglino's user avatar
1 vote
0 answers
730 views

I'm running C# Selenium.WebDriver.ChromeDriver v84.0.4147.3001 from .Net Core 3.1 WEB APPLICATION and Windows "MODIFIED MEMORY" do not stop increasing. When chromedriver.exe process reached ...
Tatiana Perere's user avatar
3 votes
0 answers
703 views

I am using selenium headless browser with chromedriver to crawl content from websites that have javascript generated code. (thus why I can't use requests) The code runs for a good couple of hours as ...
Lucas Azevedo's user avatar
1 vote
0 answers
468 views

is there any way to free up the memory consumed by selenium chrome? This question is specifically for websites like opeansea for eg. where there are more than 100k nfts in a single collection. The ...
Salman Shahzada's user avatar
2 votes
0 answers
330 views

I have a Jenkins server running maven jobs to test a web application, using java and selenium. we had a lot of out of memory problems. Tried to limit the memory use with xmx, maxPermSize ...
Sam polo's user avatar
1 vote
0 answers
212 views

I am using selenium google chrome driver to get some web page in Python, when use the google driver, I want the google driver was exit completely. But there still have chrome process in the kubernetes ...
Dolphin's user avatar
  • 40.8k
0 votes
0 answers
143 views

So I have a web scraper using selenium, code below. The problem is that each time the code is run, a new process seems to permanently appear as per htop- both a chromedriver process, and a XVFB ...
mcplums's user avatar
  • 259
7 votes
2 answers
5k views

I'm trying to make my selenium test as atomic and independent of each other as possible so I decided to quit the browser and create a new Webdriver instance after each test runs. This approach made ...
CrispJam's user avatar
  • 189
3 votes
3 answers
6k views

Can anyone help me to calculate how many Selenium driven automated browser can be initiated on a single computer at the same time? Note: If it matters, I am using ChromeDriver and Chrome for this ...
Rizwan's user avatar
  • 128
2 votes
2 answers
6k views

Good day to all! I've been experiencing this problem for a week now but I don't think I can solve it and I also do not see any solution based on articles online. Hopefully someone can help me here... ...
Errol Flynn Calado's user avatar
2 votes
1 answer
6k views

I'm doing web scraping using Headless Chrome (Selenium Chrome Web driver) installed on Ubuntu on EC2. For small number of requests, it's working fine.. but when are large number of simultaneous ...
user1955934's user avatar
  • 3,575
1 vote
1 answer
5k views

My cpu usage is on average 17% with peaks of 22% when running this selenium script. Is this normal? I have a 5 5600g processor and am not running anything in the background. Thanks in advance. Button =...
koeliga's user avatar
  • 81
1 vote
1 answer
3k views

I have the latest version of the drivers (chromedriver=2.44.609551), selenium package(3.141.0) and the (headless chrome=70.0.3538.110). (on windows) I am opening multiple windows with the browser. ...
Victor Hugo Borges's user avatar

15 30 50 per page