Skip to content

Commit

Permalink
robots.txt says it’s duplicated on DuncanRitchie.co.uk
Browse files Browse the repository at this point in the history
  • Loading branch information
DuncanRitchie committed Dec 8, 2024
1 parent 91a7d25 commit 69dae68
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions public/robots.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
# List of AI crawlers from https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt
# This file exists on both DuncanRitchie.co.uk and velut.
User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: Amazonbot
Expand Down

0 comments on commit 69dae68

Please sign in to comment.