# All crawlers allowed on purpose: search engines and AI search, AI assistants and AI training # (Content-Signal says the same for crawlers that read it; Google ignores it). # Keep a single group: a named User-agent group replaces the * group for that bot, so it would # miss any Disallow added here. Don't block the .md twins or llms.txt: AI agents use them, and # the twins' noindex header only works if they can be fetched. User-agent: * Content-Signal: ai-train=yes, search=yes, ai-input=yes Allow: / # Counter beacons (Pages Functions), not pages. Disallow: /api/ Sitemap: https://saalse.com/sitemap.xml