misc: add robots.txt

This commit is contained in:
James Xylight committed 2025-08-31 16:19:35 -07:00
1 parent 1c55baac5b
commit df58013a98
3 files changed
+22 -4

No files matched your search

+19
View File
@@ -0,0 +1,19 @@
User-Agent: *
Allow: /
Disallow: /admin/
Disallow: /api/
Disallow: /accounts/
Disallow: /settings/
Disallow: /messages/
Disallow: /inbox/
Disallow: /search?
Disallow: /*?sort=
Disallow: /*?type_=
Disallow: /*?q=
Allow: /c/*/
Allow: /u/*/
Allow: /post/*/
Allow: /comment/*/