Linked Questions
26 questions linked to/from Limit chrome headless CPU and memory usage
16 votes
0 answers
6k views
Chrome memory leak using Selenium and Chrome Dev Tools [duplicate]
I'm using Selenium in Python to perform some web scraping in Chrome. The scraper loads a page, types a search in a searchbox, solves a basic captcha, scrapes the data, and repeats. Problem The ...
1 vote
0 answers
2k views
Python+Selenium+Chrome Increasing Memory Usage Over Time [duplicate]
I am running a scraper created using Python 3.7, Selenium 3.141.0, Google Chrome 77.0.3865.90 and ChromeDriver 77.0.3865.40 on Ubuntu 18.04. Problem: As the script continues scraping more pages, the ...
1 vote
0 answers
1k views
Selenium Python best way to optimize RAM consumption [duplicate]
I'm coding a scripts that needs Selenium. As you know it requires lots of RAM power. So I tried with different browsers for the same script. Firefox required 120MB, Opera about 60MB. The best result I ...
1 vote
0 answers
730 views
Selenium WebDriver ChromeDriver 2.6GB of "Modified Memory" and increasing [duplicate]
I'm running C# Selenium.WebDriver.ChromeDriver v84.0.4147.3001 from .Net Core 3.1 WEB APPLICATION and Windows "MODIFIED MEMORY" do not stop increasing. When chromedriver.exe process reached ...
3 votes
0 answers
703 views
Selenium leaving chrome processes open [duplicate]
I am using selenium headless browser with chromedriver to crawl content from websites that have javascript generated code. (thus why I can't use requests) The code runs for a good couple of hours as ...
1 vote
0 answers
468 views
System freezes due to selenium chrome memory consumption [duplicate]
is there any way to free up the memory consumed by selenium chrome? This question is specifically for websites like opeansea for eg. where there are more than 100k nfts in a single collection. The ...
2 votes
0 answers
330 views
Maven testing jobs memory allocation is expanding to 20gb on Jenkins servers [duplicate]
I have a Jenkins server running maven jobs to test a web application, using java and selenium. we had a lot of out of memory problems. Tried to limit the memory use with xmx, maxPermSize ...
1 vote
0 answers
212 views
how to ensure the google chrome driver exit after use in selenium [duplicate]
I am using selenium google chrome driver to get some web page in Python, when use the google driver, I want the google driver was exit completely. But there still have chrome process in the kubernetes ...
0 votes
0 answers
143 views
Selenium python web scraper clogging my RAM: drivers and xvfb display not closing following display.stop() and driver.close() [duplicate]
So I have a web scraper using selenium, code below. The problem is that each time the code is run, a new process seems to permanently appear as per htop- both a chromedriver process, and a XVFB ...
7 votes
2 answers
5k views
Should I quit the browser after each Selenium based automated test?
I'm trying to make my selenium test as atomic and independent of each other as possible so I decided to quit the browser and create a new Webdriver instance after each test runs. This approach made ...
3 votes
3 answers
6k views
How many Selenium driven automated browser can be initiated on a single computer at the same time [closed]
Can anyone help me to calculate how many Selenium driven automated browser can be initiated on a single computer at the same time? Note: If it matters, I am using ChromeDriver and Chrome for this ...
2 votes
2 answers
6k views
Python, Selenium and Chromedriver - endless loop using find_element_by_id causes CPU problem
Good day to all! I've been experiencing this problem for a week now but I don't think I can solve it and I also do not see any solution based on articles online. Hopefully someone can help me here... ...
2 votes
1 answer
6k views
Selenium Headless Chrome - Java Heap Issue
I'm doing web scraping using Headless Chrome (Selenium Chrome Web driver) installed on Ubuntu on EC2. For small number of requests, it's working fine.. but when are large number of simultaneous ...
1 vote
1 answer
5k views
Is my cpu usage normal while using selenium?
My cpu usage is on average 17% with peaks of 22% when running this selenium script. Is this normal? I have a 5 5600g processor and am not running anything in the background. Thanks in advance. Button =...
1 vote
1 answer
3k views
ChromeDriver is too slower than GeckoDriver on the first page query through Selenium and Python
I have the latest version of the drivers (chromedriver=2.44.609551), selenium package(3.141.0) and the (headless chrome=70.0.3538.110). (on windows) I am opening multiple windows with the browser. ...