Web Crawler An open-source web crawler written in Python The main aim is to collect as many links as possible and build a site map for the website.