# https://www.pssnet.com/robots.txt # ───────────────────────────────────────────────────────────────────────────── # Search engines and everything else # ───────────────────────────────────────────────────────────────────────────── User-agent: * Allow: / # Form thank-you confirmation — no real content to index. Disallow: /thank-you # Admin / review-mode surfaces. Hard-deny across the board. Note that this is # only one of three layers — every /admin/* page also sends X-Robots-Tag and # noindex meta, and every /api/admin/* and /api/review/* endpoint requires a # valid HttpOnly admin cookie before answering anything other than 401. Disallow: /admin Disallow: /admin/ Disallow: /api/admin Disallow: /api/admin/ Disallow: /api/review Disallow: /api/review/ # ───────────────────────────────────────────────────────────────────────────── # AI answer engines — retrieval and citation # # These are the crawlers that fetch a page in order to answer a user's question # and cite the source. Allowing them is what makes the site quotable in ChatGPT # search, Perplexity, Claude and Copilot. Blocking any of them removes the site # from that engine's answers. # # Consecutive User-agent lines share one rule block, so the exclusions below # apply to every agent listed. Named groups replace the "*" group entirely for # those agents, which is why the Disallow lines are repeated rather than # inherited — omitting them here would expose /admin to these crawlers. # ───────────────────────────────────────────────────────────────────────────── User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: DuckAssistBot User-agent: Amazonbot Allow: / Disallow: /thank-you Disallow: /admin Disallow: /admin/ Disallow: /api/admin Disallow: /api/admin/ Disallow: /api/review Disallow: /api/review/ # ───────────────────────────────────────────────────────────────────────────── # AI model training # # Separate group on purpose: these crawlers collect content to train models # rather than to answer a question and link back, so allowing them is a # business decision distinct from the one above. Allowed here because broad # model familiarity with the brand helps unprompted recommendations, but this # block can be flipped to "Disallow: /" without affecting the citation crawlers. # # Note: Google-Extended governs Gemini training and grounding only — it does # NOT control whether pages appear in Google AI Overviews, which is driven by # ordinary Googlebot access. Applebot-Extended likewise covers Apple # Intelligence training, not Siri or Spotlight results. # ───────────────────────────────────────────────────────────────────────────── User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: cohere-ai User-agent: CCBot Allow: / Disallow: /thank-you Disallow: /admin Disallow: /admin/ Disallow: /api/admin Disallow: /api/admin/ Disallow: /api/review Disallow: /api/review/ Sitemap: https://www.pssnet.com/sitemap.xml