Python web scrapers built using Selenium, BS4 and Playwright
Clone the git repository:
git clone https://github.com/nirantak/scraper.git && cd scraper cp -nv .env.sample .env # copy and update the env variablesInstall necessary dependencies
python3 -m venv .venv source .venv/bin/activate pip install -U pip wheel setuptools pip install -U -r requirements.txt playwright installSee scrapers/README.md for usage instructions.
Samples present in demo/.