Bot directory · Search engines
Bingbot
Bingbot, often just called the Bing bot, is Microsoft’s web crawler. It builds the index behind Bing search and Microsoft Copilot, and through them results on Yahoo, DuckDuckGo and other services. Here are its user agent strings, how it reads robots.txt, how to verify that a visitor is really Bingbot, and how to check that it can crawl your site.
- Operator
- Microsoft
- Purpose
- Search index. The crawlers behind Google, Bing and the other search engines. Blocking one drops you out of its results.
- robots.txt token
Bingbot- We test with
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/131.0.0.0 Safari/537.36
Bingbot’s desktop string, above, with a current Chrome version in place ofW.X.Y.Z.
What Bingbot crawls for
Bing and Copilot search share the same crawling and index, by Microsoft’s own description, and Microsoft says Bing powers search and AI experiences including Yahoo, DuckDuckGo, Microsoft Start and AI tools such as ChatGPT. DuckDuckGo says it sources most of its traditional links from Bing, and Ecosia draws on Bing among its providers. So a site Bingbot can’t crawl is missing from far more than bing.com. OpenAI also runs its own crawler for ChatGPT search, OAI-SearchBot, which you allow or block separately.
The Bingbot user agent strings
| Crawler | User agent string |
|---|---|
| Bingbot desktop | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36 |
| Bingbot mobile | Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) |
| Short form | Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) |
W.X.Y.Z is a placeholder: Bing renders pages with the current stable Microsoft Edge and puts that version in its place, so the number changes as Edge does. Match on bingbot, case-insensitively, never on a version.
The short form was Bingbot’s only string until 2022, when Bing moved to the desktop and mobile strings above and said it would retire the old one. Bing still lists a variant of it, and Bing Webmaster Tools’ Site Scan audit uses it, so it still turns up in logs.
Microsoft’s other crawlers
| Crawler | User agent | Used for |
|---|---|---|
| AdIdxBot | Mozilla/5.0 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)plus mobile variants containing adidxbot/2.0 | Microsoft Advertising: crawls ads and the sites they lead to, for quality control |
| BingPreview | Bingbot’s desktop and mobile strings | Page snapshots for Bing |
| MicrosoftPreview | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; MicrosoftPreview/2.0; +https://aka.ms/MicrosoftPreview) Chrome/W.X.Y.Z Safari/537.36plus a mobile variant | Page snapshots for other Microsoft products |
| BingVideoPreview | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; BingVideoPreview/1.0; +https://aka.ms/microsoftbots) Chrome/W.X.Y.Z Safari/537.36plus short and mobile variants | Video previews in Bing |
From Microsoft’s overview of Bing crawlers.
How Bingbot reads robots.txt
- The token is
Bingbot. When robots.txt has a group naming it, Bingbot follows that group and ignoresUser-agent: *entirely, so repeat any general rules you still want it to obey. msnbotstill counts. For backward compatibility Bing has said Bingbot follows amsnbotgroup when there is noBingbotgroup, before falling back to*. An oldUser-agent: msnbot/Disallow: /therefore blocks Bingbot today.- Crawl-delay is honoured. Unlike Googlebot, Bingbot reads
Crawl-delayas a window of 1 to 20 seconds in which it fetches at most one URL: a delay of 5 allows about 17,280 URLs a day, 10 about 8,640. A Crawl-delay in robots.txt overrides the Crawl Control setting in Bing Webmaster Tools, which Bing recommends using instead because it lets you set the rate hour by hour. - Changes take a few hours. Bing keeps robots.txt cached for at least a few hours.
- AdIdxBot is separate. Bing’s robots.txt tester lets you test rules for Bingbot and AdIdxBot independently.
User-agent: Bingbot
Crawl-delay: 2
Disallow: /search/
User-agent: *
Disallow: /search/
How to verify a real Bingbot
Fake Bingbots are common, because a site that welcomes Bing lets them through. Microsoft documents the same check Google does: a reverse DNS lookup of the IP must return a hostname ending in search.msn.com, and a forward lookup of that hostname must return the same IP.
$ host 157.55.39.1
1.39.55.157.in-addr.arpa domain name pointer msnbot-157-55-39-1.search.msn.com.
$ host msnbot-157-55-39-1.search.msn.com
msnbot-157-55-39-1.search.msn.com has address 157.55.39.1
Microsoft also publishes Bingbot’s addresses at bing.com/toolbox/bingbot.json: 28 IPv4 ranges as of October 2026 and no IPv6. It asks you to refresh the list daily rather than hard-code it, and offers a Verify Bingbot tool that checks one address. One known exception: Site Scan in Bing Webmaster Tools currently crawls with Bingbot’s user agent from addresses that are not Bingbot’s, so it fails this check.
Check an IP now
Paste an address from your logs. We run the DNS check and match it against Microsoft’s and Google’s current lists.
How to check that Bing can crawl your site
- The canaicrawl checker, below, applies your robots.txt the way Bingbot does, including its fallback to a
msnbotgroup, requests the page with Bingbot’s user agent and reads its noindex signals. - URL Inspection in Bing Webmaster Tools, with the Live URL tab, shows what Bingbot sees on a page right now, and lets you request indexing.
- The robots.txt tester shows which line blocks a URL, for Bingbot or AdIdxBot.
- Site Explorer and the crawl error alerts show URLs Bingbot couldn’t fetch, with 401, 403, 5xx, DNS and connection failures.
- IndexNow lets you tell Bing, and other search engines that support it such as Seznam.cz and Naver, the moment a URL is published, updated or deleted, instead of waiting for Bingbot to find the change.
Block Bingbot
Add a group naming it to /robots.txt. Compliant crawlers stop before requesting any page. A firewall rule on the user agent is the only way to enforce it against crawlers that ignore robots.txt. Disallowing Bingbot removes your pages from Bing, and with it from Copilot answers and the services that use Bing’s index.
User-agent: Bingbot
Disallow: /
Allow Bingbot when everything else is blocked
A group naming the bot wins over User-agent: *, so an explicit allow lets it in while your catch-all rules stay in place.
User-agent: Bingbot
Allow: /
User-agent: *
Disallow: /
Does Bingbot reach your site?
The checker applies your robots.txt the way Bingbot does, then requests your page with the user agent above, alongside 29 other bots, and opens the report on Bingbot.
Questions about Bingbot
What is Bingbot?
Bingbot is the web crawler Microsoft uses for Bing. It fetches pages to build the index behind Bing search and Microsoft Copilot, which other services such as Yahoo and DuckDuckGo also draw on.
What is the Bingbot user agent string?
On desktop it is “Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36” and on mobile “Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)”, where W.X.Y.Z is the Microsoft Edge version Bing currently renders with. An older short form, “Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)”, still appears.
Is msnbot the same as Bingbot?
msnbot was the crawler’s name before Bing. Bingbot replaced it, but Bing has said Bingbot still follows robots.txt rules written for msnbot when there is no group for Bingbot, and Bing’s verification help still mentions both names.
How do I verify that a visitor is really Bingbot?
Run a reverse DNS lookup on its IP: the hostname must end in search.msn.com. Then run a forward lookup on that hostname: it must return the same IP. You can also match the IP against Microsoft’s bingbot.json list, or paste it into the verifier on this page.
How do I slow Bingbot down?
Use Crawl Control in Bing Webmaster Tools to set the crawl rate for each hour of the day, or add a Crawl-delay line (1 to 20 seconds) to the Bingbot group in robots.txt. A Crawl-delay in robots.txt takes precedence over Crawl Control.
Does blocking Bingbot affect AI answers?
Yes. Microsoft Copilot answers from Bing’s index, and Microsoft says Bing also powers other AI tools. ChatGPT search additionally uses OpenAI’s own OAI-SearchBot, which robots.txt controls separately.
Other search engines: Googlebot, DuckDuckBot, Applebot, PetalBot, YandexBot, Baiduspider.
Build a complete file with the robots.txt generator.