This project is a web scraper designed to extract job listings from the Y Combinator website at 10 am East African Time and shoot me a whatsapp Alert.
src/: This directory contains the source code for the project.__init__.py: An empty file that indicates this directory should be treated as a Python package.scraper.py: This module contains the web scraping logic.database.py: This module handles database operations.messaging.py: This module is responsible for sending WhatsApp messages.main.py: This is the entry point of the project.
tests/: This directory contains unit tests for the project.__init__.py: An empty file that indicates this directory should be treated as a Python package.test_scraper.py: This module contains tests for thescraper.pymodule.test_database.py: This module contains tests for thedatabase.pymodule.test_messaging.py: This module contains tests for themessaging.pymodule.
requirements.txt: This file lists the dependencies required by the project..gitignore: This file specifies files and directories that should be ignored by Git.README.md: This file contains information about the project..github/workflows/scraper.yml: This file defines a GitHub Actions workflow for the project.
To use this project, follow these steps:
- Install the required dependencies by running
pip install -r requirements.txt. - Set the
TWILIO_ACCOUNT_SID,TWILIO_AUTH_TOKEN,TWILIO_PHONE_NUMBER, andYOUR_PHONE_NUMBERenvironment variables. - Run the project by executing
python src/main.py.
To use this project, you need to configure the following settings:
TWILIO_ACCOUNT_SID: Your Twilio account SID.TWILIO_AUTH_TOKEN: Your Twilio auth token.TWILIO_PHONE_NUMBER: The Twilio phone number.YOUR_PHONE_NUMBER: Your phone number.