# GaVopia robots.txt — public content is available to search engines and AI search/retrieval systems. User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= # OpenAI search and user-directed retrieval User-agent: OAI-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= User-agent: ChatGPT-User Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= # Anthropic search and user-directed retrieval User-agent: Claude-SearchBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= User-agent: Claude-User Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= # Perplexity search User-agent: PerplexityBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= # Model-development crawlers — allowed in the inherited r9 policy. User-agent: GPTBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= User-agent: ClaudeBot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /Backend/ Disallow: /Intern/ Disallow: /submit-questions.html Disallow: /de/submit-questions.html Disallow: /en/submit-questions.html Disallow: /es/submit-questions.html Disallow: /fr/submit-questions.html Disallow: /*?token= Disallow: /*?access= Disallow: /*?session= Sitemap: https://gavopia.com/sitemap.xml