Awesome Web Scraping

The list of tools, programming libraries and web services used in web scraping and data processing.

Web scraping chats: @grablab (English) and @grablab_ru (Russian)

Programming Libraries

• Python
• PHP
• Ruby
• JavaScript
• Go

Other Things

• Web Scraping Services
• Console tools
• dhamaniasad / HeadlessBrowsers - a list of (almost) all headless web browsers in existence
• DNS over HTTPS providers - list of DNS over HTTPs providers

Captcha Solving Services

• 2captcha.com - 2captcha.com
• anti-gate.com - anti-gate.com

Contributing

See Contributing document.

Credits

The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript