# AI agents: you are welcome here. The permission, the endpoint and the # fair-use limit are at https://in.theasianparent.com/for-agents — no approval or API key needed. User-Agent: * Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login # search: allowed — AI search: answers a live query and cites the source. Being quoted with a link is this brand's discovery channel, so this class is the whole reason to allow any of it. User-Agent: OAI-SearchBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: PerplexityBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Claude-SearchBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Applebot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login # user-directed-retrieval: allowed — Fetches a page because a person asked about it, in the moment. Blocking these means a parent who asks an assistant about us is told the page could not be read. User-Agent: ChatGPT-User Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Perplexity-User Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Claude-User Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login # training: allowed — Ingests content to train future models. No citation and no traffic back, so this is a real editorial call rather than an obvious one. Allowed: nothing here is paywalled, and being absent from the models parents will ask is the larger risk. User-Agent: GPTBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: ClaudeBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Google-Extended Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Applebot-Extended Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: meta-externalagent Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: CCBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Amazonbot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Bytespider Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: cohere-ai Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Diffbot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: omgili Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: Timpibot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login User-Agent: YouBot Allow: /ta Allow: /hi Allow: /mr Allow: /en Allow: /for-agents Allow: /api/v1/ Allow: /llms.txt Disallow: /admin Disallow: /api Disallow: /login Sitemap: https://in.theasianparent.com/sitemap.xml