Extract out configuration options into a separate readable configuration file rather than hard coding into the main webcrawler script.