disallow chat gpt crawler

https://platform.openai.com/docs/gptbot
Xetera · Aug 9, 2023 · 80b7aca · 80b7aca
1 parent 185e86d
commit 80b7aca
Showing 1 changed file with 4 additions and 1 deletion.
diff --git a/public/robots.txt b/public/robots.txt
@@ -1,2 +1,5 @@
 User-agent: *
-Disallow:
+Disallow:
+
+User-agent: GPTBot
+Disallow: /