AI search · OpenAI

OAI-SearchBot

Builds the index ChatGPT search answers from and links to. It is not used for training; that is GPTBot.

Operator: OpenAI
Purpose: AI answers. Crawlers that build the indexes AI assistants answer from and cite. Blocking one keeps you out of its answers.
robots.txt token: OAI-SearchBot
User agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot
Documentation: platform.openai.com/docs/bots

Block OAI-SearchBot

Add a group naming it to /robots.txt. Compliant crawlers stop before requesting any page. A firewall rule on the user agent is the only way to enforce it against crawlers that ignore robots.txt.

User-agent: OAI-SearchBot
Disallow: /

Allow OAI-SearchBot when everything else is blocked

A group naming the bot wins over User-agent: *, so an explicit allow lets it in while your catch-all rules stay in place.

User-agent: OAI-SearchBot
Allow: /

User-agent: *
Disallow: /

Does OAI-SearchBot reach your site?

The checker applies your robots.txt the way OAI-SearchBot does, then requests your page with the user agent above, alongside 29 other bots.

Also run by OpenAI: GPTBot, ChatGPT-User.

Other ai search: PerplexityBot, Claude-SearchBot, DuckAssistBot, Amazonbot, YouBot.

Build a complete file with the robots.txt generator.