Scrapes book information (title, price, stock, etc.) from Books to Scrape by category with pagination support.
- Fetches all categories from the site
- For each category, scrapes multiple pages (pagination) to collect book details
- Extracts data such as title, price, availability, and possibly rating
- Saves results in a structured format
- Python 3.x
- Libraries (as listed in
requirements.txt
), e.g.requests
,beautifulsoup4
, etc.
- Clone the repository
git clone https://github.com/Akinfiresoye-Victor/Web-Scraping-project.git cd Web-Scraping-project
- Set environment
- python -m venv env
- pip install -r requirements.txt
- Run python book_scrape.py