88x31-Button-Scraper

Scrapes popular websites for 88x31 buttons. Exports scraped elements to a .zip/.tar.gz compressed folder.

Dependencies

Install all of the required Python packages initially before running the script:

$ pip install -r ./requirements.txt

$ python main.py

Automatically detecting operating system for .zip/.tar.gz compression.

If you need to tune crawling breadth in code, Scrape(max_pages_per_site=40) controls how many HTML pages are visited per seed URL.

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
main.py		main.py
requirements.txt		requirements.txt
sites.txt		sites.txt