GETCITED

Free tool

Is my site blocked from ChatGPT search?

Last updated

ChatGPT search reads sites through OAI-SearchBot. OpenAI documents it as the crawler that surfaces websites in ChatGPT's search features, and says a site that opts out of it will not be shown in ChatGPT search answers, though it can still appear as a navigational link; a robots.txt change takes about 24 hours to apply. GPTBot is a separate crawler that collects training data, and OpenAI says each setting is independent of the other. ChatGPT-User visits a page when a user's question needs it; OpenAI says robots.txt rules may not apply to it and that it does not decide whether content appears in search.

Source: OpenAI, Overview of OpenAI crawlers, read .

Eight requests: robots.txt, the homepage as a browser, and the homepage as six AI crawlers. Nothing is stored.

The crawlers that decide it for ChatGPT search

OAI-SearchBotOpenAI
Surfaces websites in ChatGPT's search features. Not used to train OpenAI's models. (OpenAI, Overview of OpenAI crawlers, read )In this check: robots.txt verdict, and the homepage requested with its user agent.
GPTBotOpenAI
Crawls content that may be used to train OpenAI's models. Disallowing it signals that the site's content should not be used in training. (OpenAI, Overview of OpenAI crawlers, read )In this check: robots.txt verdict, and the homepage requested with its user agent.
ChatGPT-UserOpenAI
Visits a page when a ChatGPT user's question needs it. Not used to crawl the web automatically, nor to decide what appears in search. (OpenAI, Overview of OpenAI crawlers, read )In this check: Not in this check. OpenAI says robots.txt rules may not apply to it, so a robots.txt verdict would not describe it, and its user agent is not among the six probed.

Other ways a site is invisible to ChatGPT search

Crawler access is the first condition of AI visibility, not the only one. This check does not measure the following.

  • JavaScript-only content. OpenAI's crawlers fetch JavaScript files but do not run them, in an analysis of hundreds of millions of crawler fetches. Text that only appears after JavaScript runs is not in what they read. (Vercel and MERJ, The rise of the AI crawler (December 2024))
  • Not in Bing's index. ChatGPT search draws on third-party search providers as well as its own crawler: 87% of its citations matched Bing's top organic results, against 56% for Google's. A page that is not in Bing's index is largely invisible to it. (Seer Interactive, 100 queries, early 2025)

The free audit crawls up to 25 pages the way an answer engine reads them and reports pages whose content only appears with JavaScript, pages marked noindex and blocked crawlers, with the evidence. Whether a page is in a search index is reported by the index's owner, in Google Search Console or Bing Webmaster Tools; neither this check nor the audit sees it.

The same check for other engines

Audit the whole site, free.

Run the free audit