User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /*?*sort= # Search and AI assistant crawlers are welcome to read and cite public job pages. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: Applebot Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /*?*sort= Sitemap: https://tcijobfinder.com/sitemap.xml