Skip to content

Commit

Permalink
Update robots.txt based on log review
Browse files Browse the repository at this point in the history
Signed-off-by: Wade Barnes <wade@neoterictech.ca>
  • Loading branch information
WadeBarnes committed Nov 3, 2023
1 parent ca4ab78 commit 7931353
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions public/robots.txt
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
User-agent: *
Disallow: /api/
Disallow: /hooks/
Disallow: /entity/
Disallow: /organization/

User-agent: Baiduspider
User-agent: 360Spider
Expand Down

0 comments on commit 7931353

Please sign in to comment.