Anthropic applied two layers of indexing control on shared chat pages:
Disallow: /share/* rule in their robots.txt file, telling crawlers not to access the /share/ path.X-Robots-Tag: noindex HTTP header on the pages themselves, telling search engines not to index them even if they were crawled .The conflict: Because robots.txt blocked Google's crawler from accessing the pages entirely, Google's crawler never saw the noindex header. However, if the URLs were linked elsewhere on the web (e.g., on social media, forums, or other sites that Google could crawl), Google could still discover and index the URLs based on those external references. When the crawler is blocked by robots.txt from fetching a page, it cannot read the noindex directive — so it may index the URL from external context alone . Essentially, the robots.txt disallow made the noindex tag invisible and therefore ineffective.
| Company | Incident | Scale | Key difference |
|---|---|---|---|
| OpenAI (ChatGPT) | 2023–2025: ChatGPT shared link URLs were indexed by Google after users posted them publicly. Google estimated hundreds of thousands of transcripts surfaced . | ~143,000+ conversations across multiple GenAI chatbots | OpenAI reportedly did not initially use noindex or robots.txt blocking on shared links. |
| xAI (Grok) | 2025: Grok shared conversations also appeared in Google search results . | Hundreds of thousands | Similar pattern — share links were publicly accessible and crawled. |
| Anthropic (prior incident) | September 2025: Forbes reported that Anthropic became the third AI company whose chatbot conversations appeared in Google. Unlike OpenAI and xAI, Anthropic said it had blocked crawlers — yet pages still leaked . | Hundreds of transcripts | This is a repeat incident. The same class of problem recurred despite prior claims of having fixed it. |
Key pattern: In all three cases, the root cause is that AI companies' "share" features generate public, guessable URLs, and users post those links on the open web — after which search engines index them. Anthropic's 2025 incident was essentially the same issue .
site: queries .Google had previously estimated it indexed "just under 600" Claude conversations in the prior incident before they were removed . The current status is in flux — Anthropic had not publicly addressed the matter at the time of reporting .
Anthropic's official help center provides these steps:
Review your shared chats:
Unshare (revoke) a chat:
Delete a conversation entirely:
Note: Unsharing or deleting a conversation does not automatically remove it from search engine caches. You may also need to submit removal requests to Google, Bing, and Brave separately for any URLs already indexed .