Skip to content

Commit

Permalink
Updated for bots hitting user and mailreporter pages unnecessarily
Browse files Browse the repository at this point in the history
  • Loading branch information
paulmwatson committed Aug 7, 2024
1 parent 5aae198 commit 7650a83
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion robots.txt
Original file line number Diff line number Diff line change
@@ -1,2 +1,4 @@
User-agent: *
Crawl-delay: 5
Disallow: /user/
Disallow: /mailreporter/
Crawl-delay: 120

0 comments on commit 7650a83

Please sign in to comment.