List of best web crawlers to extract data from the web. Find web crawling tools for different needs.

The "Node-web-crawling" is a web scraping project that allows you to find the best deals on mobile phones by comparing prices from two popular e-commerce websites, Flipkart and Amazon.

script crawler com nodejs para alimentar uma pagina estatica

A Node.js Tool To Download Entire Websites, Including HTML, CSS, JS, Images, & Fonts. Works With Custom-Coded & WordPress Sites.

This utility is a web crawler built using Playwright and Node.js. It is designed to crawl web pages, collect metrics such as HTML and JSON request counts, and handle retries for failed links. The results are saved in CSV files for further analysis.