Nested Sitemaps
Resolves issue #26
This accounts for the fact that a sitemap could have more than one structure.
- If a sitemap is a collection of other sitemaps, it will now collect all of those links together for crawling.
- If a sitemap is a collection of links, it'll add those links
- Because a nested sitemap could be a signal that this will take a bit longer, the CLI now reports:
- how many pages will be scanned
- how long the scan took, in minutes or seconds