Skip to content

be3max/http-crawler

Repository files navigation

Simple Web Crawler

Web crawler display information about a given website.

It craws some pages of your website, by given a single entry point.

Display`s the following results:

  • Number of pages crawled
  • Number of a unique images
  • Number of unique internal links
  • Number of unique external links
  • Average page load in seconds
  • Average word count
  • Average title length

Also display`s a table that shows each crawled page and the HTTP status code

About

Simple Web Crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published