Crawl delay and cache delay support
Pre-release
Pre-release
Thanks to our contributors, we can now support the following directives:
- Crawl Delay
- Cache Delay
- Clean Param
Code coverage should also be improved, at least a bit π
Great job, guys!
Special thanks to @JanPetterMG !