Linked Questions
203 questions linked to/from Can a website detect when you are using Selenium with chromedriver?
1 vote
0 answers
2k views
Website is detecting SELENIUM.How is this possible? [duplicate]
So there is this chat website where you go, click "connect as guest", enter your username, complete a ReCaptcha v2, click "CONNECT" and you're in. If I do this in my browser, it ...
1 vote
0 answers
2k views
How to avoid Selenium webdriver from being detected as bot? [duplicate]
I have used selenium web driver to scrape a website in python. The issue is When I open the website in the Chrome browser there is no captcha. But when I open it in the selenium (using chrome web ...
3 votes
0 answers
2k views
How to avoid Captcha when use Selenium in Python to monitor a website [duplicate]
I am writing a script in Python to monitor the change of a website. The aim is, once an element in the page is updated (e.g. a button from non-existent to existent), I'll receive a notification. I don'...
1 vote
0 answers
1k views
selenium chromedriver - Twitter detects suspicious activity [duplicate]
I have an automated daily task with RSelenium in the cloud. This task consists of logging (required) into www.twitter.com and make a webflow navigation. Instead, Twitter detects this logging as ...
2 votes
0 answers
1k views
How to hide that i am using selenium to browse [duplicate]
I am trying to scrape some information from a website. When I enter it using my browser (manually), everything works well and I don't get any request to solve Google captcha. But when I enter it using ...
1 vote
0 answers
786 views
selenium chromedriver php detected as a bot [duplicate]
Just wondering if anyone can porvide any insight to a problem that I am having. I am trying to scrape a site using selenium and chromedriver. The site seems to always detect the chromedriver browswer ...
1 vote
0 answers
662 views
How to make selenium as undetectable as possible [duplicate]
I have been working on using selenium and pyton on a website recently, and it seems to know I am using selenium. I have tried using chromdriver, geckodriver, using headless browsers, using random ...
0 votes
0 answers
569 views
Is there any way to avoid detection of selenium? [duplicate]
I am using selenium in python to for scraping website https://www.owler.com/ but it's detecting selenium and others such as mechanize too. I had tried the User-Agent = Mozilla/5.1 and Firefox too but ...
1 vote
1 answer
474 views
How do i avoid selenium detection in chromium on linux? [duplicate]
I am trying to automate emails sign ups. When I do it manually it works, but when I open the website with selenium it does not. It has verification which I can't do. Is there a way to just open (not ...
0 votes
0 answers
364 views
protecting selenium from detection [duplicate]
I am trying to crawl a couple of website pages to use their information and I can only use things like selenium that has chromium to do that Now I am trying to hide it from the website owners because ...
1 vote
0 answers
333 views
how to scrape a dynamic website without selenium [duplicate]
i am facing an issue that i hope anyone can help me with. i'm trying to scrape a webpage using selenium package on python but it keeps detecting that i'm using selenium and redirects me to a log in ...
0 votes
0 answers
158 views
Website "gosugamers.net" is detecting Selenium [duplicate]
When you open website gosugamers.net, it shows the following, After 5 seconds it automatically directs to the main page. But I tried to open it using selenium, it got stuck at the above screenshot. ...
1 vote
1 answer
97 views
Launching Chromedriver using Selenium [duplicate]
What options do I set for chromedriver so that the web server cannot tells the browser is manually launched or programming launched using Selenium? Thanks,
1 vote
0 answers
92 views
Is there any way to make ChromeDriver less detectable? [duplicate]
I have been using selenium and web driver for making a very simple bot, and some websites are blocking me at the door. I was wondering if there was any way to modify my chrome driver to make it less ...
1 vote
0 answers
79 views
Find Webpage Element Using Requests, Scrapy or Selenium [duplicate]
I am trying to interact with a webpage that has strong bot detection measures. This means I cannot use things like Requests, Scrapy or Selenium as they get detected. Even Undetected Chromedriver doesn'...
0 votes
1 answer
51 views
Does web explorers have an id or something like that? [duplicate]
I wonder if the explorers has a unique id or something because I’m making an experiment and I realized that Google detect it’s the same computer even if I chance many things. I have tried all I have ...
1 vote
0 answers
25 views
selenium Not Running Javascript [duplicate]
I can't access Tidal site with selenium. It is detected. How can I overcome this problem. My code is below. I am attaching the error I got. proxies = proxy() print(proxies) options = ...
1 vote
0 answers
18 views
Python selenium undetectable by websites [duplicate]
I'm trying to scrape a website i tried all the options i found on the internet even proxies but my selenium is detected and i got a captcha. I tried proxies, adding arguments and options to selenium ...
217 votes
13 answers
349k views
How to save and load cookies using Python + Selenium WebDriver
How can I save all cookies in Python's Selenium WebDriver to a .txt file, and then load them later? The documentation doesn't say much of anything about the getCookies function.
114 votes
16 answers
179k views
Selenium webdriver: Modifying navigator.webdriver flag to prevent selenium detection
I'm trying to automate a very basic task in a website using selenium and chrome but somehow the website detects when chrome is driven by selenium and blocks every request. I suspect that the website ...
70 votes
2 answers
161k views
Way to change Google Chrome user agent in Selenium?
I'm trying to figure out a way whereby whenever I open up Chrome via Selenium (in Python) in this particular script, the Chrome page automatically opens up with another user agent selected - in this ...
66 votes
4 answers
295k views
How can I bypass the Google CAPTCHA with Selenium and Python?
How can I bypass the Google CAPTCHA using Selenium and Python? When I try to scrape something, Google give me a CAPTCHA. Can I bypass the Google CAPTCHA with Selenium Python? As an example, it's ...
35 votes
9 answers
62k views
Unable to hide "Chrome is being controlled by automated software" infobar within Chrome v76
After updating Chrome to version 76, I cannot figure out how to hide the "Chrome is being controlled by automated software..." notification overriding some controls on the page. The latest stable ...
49 votes
10 answers
125k views
Selenium headless: How to bypass Cloudflare detection using Selenium
Hoping an expert can help me with a Selenium/Cloudflare mystery. I can get a website to load in normal (non-headless) Selenium, but no matter what I try, I can't get it to load in headless. I have ...
31 votes
8 answers
89k views
Using Extensions with Selenium (Python)
I am currently using Selenium to run instances of Chrome to test web pages. Each time my script runs, a clean instance of Chrome starts up (clean of extensions, bookmarks, browsing history, etc). I ...
49 votes
3 answers
97k views
Is there a version of Selenium WebDriver that is not detectable?
I am running the Chrome driver over Selenium on a Ubuntu server behind a residential proxy network. Yet, my Selenium is being detected. Is there a way to make the Chrome driver and Selenium 100% ...
47 votes
3 answers
107k views
How does reCAPTCHA 3 know I'm using Selenium/chromedriver?
I'm curious how reCAPTCHA v3 works. Specifically the browser fingerprinting. When I launch an instance of Chrome through Selenium/chromedriver and test against reCAPTCHA 3 (https://recaptcha-demo....
34 votes
4 answers
61k views
How to avoid being detected as bot on Puppeteer and Phantomjs?
Puppeteer and PhantomJS are similar. The issue I'm having is happening for both, and the code is also similar. I'd like to catch some informations from a website, which needs authentication for ...
23 votes
6 answers
41k views
What Is Selenium And What Is WebDriver?
What is Selenium? When you open the official page of the Selenium, the first thing you read is "Selenium automates browser" in "What is Selenium?" section. The section "Which part of Selenium is ...
23 votes
4 answers
35k views
Selenium stuck on "Checking your browser before accessing URL"
This is a recent problem, it began I think three or four days ago. It is not isolated to my own system, as I was running the software on a remote server as well (Windows 10, Windows Server). It is not ...
22 votes
2 answers
38k views
How to make chromedriver undetectable
This is my first Stack Overflow question so please bear with me. I have read this SO question, which lead me to wondering, is it possible to make chromedriver completely undetectable? For my own ...
18 votes
7 answers
48k views
Unable to sign into google with selenium automation because of "This browser or app may not be secure."
I am trying to login to google with selenium and I keep getting the error that "This browser or app may not be secure." The function I use to log in is: async function loginToChrome(driver, ...
17 votes
5 answers
23k views
Is there a way to detect that I'm in a Selenium Webdriver page from JavaScript?
I'd like to suppress the initialization of TinyMCE inside my tests and can do this easily if the JavaScript can detect that I'm running inside a Selenium-automated page. So, is there some JavaScript ...
10 votes
5 answers
68k views
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=59587): Max retries exceeded with url using Selenium GeckoDriver Firefox
At dawn my code was working perfectly, but today when I woke up it is no longer working, and I didn't change any line of code, I also checked if Firefox updated, and no, it didn't, and I have no idea ...
22 votes
1 answer
19k views
Unable to use Selenium to automate Chase site login
When I try to log into the Chase website using Selenium (Python), I'm hit with the following error message: However, using "human" login works fine. It seems that when Selenium finds an element it ...
12 votes
3 answers
23k views
Selenium app redirect to Cloudflare page when hosted on Heroku
I have made a discord bot that uses selenium to access a website and get information, when I run my code locally I don't have any problem but when I deploy to Heroku the first URL I get redirects me ...
11 votes
6 answers
17k views
Sign in to gmail account fails (selenium automation)
I have a Selenium service that has to login to my gmail account as the first step. This functionality was working couple of weeks ago, but suddenly the login starts to fails and i am seeing this Error ...
7 votes
2 answers
45k views
Undetected Chromedriver not loading correctly
I'm attempting to use a headless chrome browser with selenium that also bypasses the bot detection test and currently using the the following project https://github.com/ultrafunkamsterdam/undetected-...
8 votes
2 answers
22k views
MaxRetryError Selenium
I tried writing a simple script that checks the website every hour and sends me an email when it finds there's availability. I figured doing this evey hour shouldn't trigger any problems but I'm ...
9 votes
5 answers
19k views
Website using DataDome gets captcha blocked while scraping using Selenium and Python
I'm actually trying to scrape some car datas from different websites, i've been using selenium with chromebrowser but some websites actually block selenium with captcha validation(example: https://www....
10 votes
3 answers
17k views
Getting 403 when using Selenium to automate checkout process
I am trying to create a script using python and selenium to automate the checkout process at bestbuy.ca. I get all the way to the final stage where you click to review the final order, but get the ...
7 votes
2 answers
8k views
to set MutationObserver, How to inject javascript before page-loading using Selenium
I'm trying to set MutationObserver for observing page mutation while loading. In order to do that, MutationObserver should be configured before page loading. With selenium-chromedriver, couldn't ...
6 votes
3 answers
24k views
How to change the User Agent using Selenium and Python
I am having an error when changing the web driver user agent in Python using selenium. Here is my code: import requests import json from selenium import webdriver from selenium.webdriver.common....
4 votes
6 answers
8k views
How to avoid being banned while scraping data from a login based site?
I'm trying to create a script using which I can parse few fields from a website without getting blocked. The site I wish to get data from requires credentials to access it's content. If it were not ...
9 votes
2 answers
30k views
How does chrome driver interact with Chrome browser?
It says ChromeDriver is a standalone server that implements the W3C WebDriver standard It looks like W3C WebDriver standard only defines the interface between the automation program and ...
9 votes
4 answers
14k views
Selenium Webdriver is detectable
I read everywhere that it is not possible for websites to detect that a user is using a selenium webdriver... but why? For example the webdriver plugin in firefox adds an 'webdriver attribute' to the ...
4 votes
2 answers
9k views
Access Denied page with headless Chrome on Linux while headed Chrome works on windows using Selenium through Python
I have this code that I'm using on my local machine: from selenium import webdriver chrom_path = r"C:\Users\user\sof\chromedriver_win32\chromedriver.exe" driver = webdriver.Chrome(chrom_path) link = '...
6 votes
2 answers
7k views
Chrome browser initiated through ChromeDriver gets detected
I am trying to use selenium chromedriver in python for the website www.mouser.co.uk. However, it is detected as bot from the first shot . Does any one has an explanation for this ?. hereafter the ...
5 votes
3 answers
7k views
Selenium: access denied
I am trying to scrape some data from LV website with Selenium and keep getting 'Access Denied' screen once 'sign in' button clicked. I feel like there is a protection against this because all seems to ...
10 votes
1 answer
13k views
How to automate login to a site which is detecting my attempts to login using selenium-stealth
So, I'm trying to write a script to login on https://us.etrade.com/e/t/user/login I am using Selenium for this but it somehow detects selenium when it starts and results in a message that says that ...