Who blocks AI · #218 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does jotform.com block AI crawlers?
No. jotform.com’s robots.txt lets all 19 AI crawlers we track crawl the site, though it keeps PerplexityBot, GPTBot and 6 more out of some paths. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotPartly blockedOAI-SearchBotAllowedClaudeBotPartly blockedPerplexityBotPartly blockedGoogle-ExtendedAllowedCCBotPartly blocked- robots.txt
- www.jotform.com/robots.txt · 485 lines
- llms.txt
- none
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Partly blocked | line 172 · Disallow: /answers/ line 173 · Disallow: /API/user* and 145 more |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Allowed | no rule matches the home page |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Partly blocked | line 154 · Disallow: /ownerview.php |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Allowed | line 5 · Allow: / under User-agent: OAI-SearchBot |
PerplexityBot | Perplexity | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
Claude-SearchBot | Anthropic | Allowed | no rule matches the home page |
DuckAssistBot | DuckDuckGo | Allowed | no rule matches the home page |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Allowed | no rule matches the home page |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
ClaudeBot | Anthropic | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
Google-Extended | Allowed | no rule matches the home page | |
CCBot | Common Crawl | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
Applebot-Extended | Apple | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
Bytespider | ByteDance | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Allowed | no rule matches the home page |
Claude-User | Anthropic | Allowed | no rule matches the home page |
Perplexity-User | Perplexity | Allowed | no rule matches the home page |
MistralAI-User | Mistral | Allowed | no rule matches the home page |
Meta-ExternalFetcher | Meta | Partly blocked | line 334 · Disallow: /answers/ line 335 · Disallow: /API/user* and 145 more |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.jotform.com/robots.txt · 485 lines
1# www.jotform.com Robots.txt
2
3User-agent: OAI-AdsBot
4User-agent: OAI-SearchBot
5Allow: /
6
7User-agent: *
8Disallow: /app/
9Disallow: /uploads/
10Disallow: /grid/
11Disallow: /excel/
12Disallow: /ipns/
13Disallow: /min/
14Disallow: /cimg/
15Disallow: /page.php
16Disallow: /submit.php
17Disallow: /submission/
18Disallow: /submissions/
19Disallow: */form-templates/ur/
20Disallow: */form-templates/static/
21Disallow: */form-templates/standalone/
22Disallow: */pdf-templates/standalone/
23Disallow: */approval-templates/standalone/
24Disallow: */app-templates/standalone/
25Disallow: */agent-templates/standalone/
26Disallow: /announcement/
27Disallow: /forum/
28Disallow: /forum/viewtopic.php
29Disallow: /rssform.php
30Disallow: /invoice/
31Disallow: /pdf-view/
32Disallow: /tr/form/
33Disallow: /*?*entrymessage=*
34Disallow: /*?*em_x=*
35Disallow: /*?*u=*
36Disallow: /*?*source=post_page*
37Disallow: /ownerView.php
38Disallow: */nx/
39Disallow: */build/
40Disallow: */build?*
41Disallow: */build$
42Disallow: /edit/
43Disallow: /inbox/
44Disallow: */form-templates/search/
45Disallow: */pdf-templates/search?
46Disallow: */table-templates/search?
47Disallow: */app-templates/search?
48Disallow: */approval-templates/search?
49Disallow: */agent-templates/search?
50Disallow: */table-templates/demo/
51Disallow: /agent/
52Disallow: /analytics/
53Disallow: /calendar/
54Disallow: /report/
55Disallow: /tables/
56Disallow: /table/
57Disallow: /csv/
58Disallow: /API/user/combinedinfo
59Disallow: /API/formInitCatchLogger/
60Disallow: /API/forum/update-who-typing
61Disallow: /rss/
62Disallow: /server.php
63Disallow: */theme-store/search/
64Disallow: */theme-store/tagged/
65Disallow: */theme-store/theme/my-theme-
66Disallow: /server/update-user-traffic-source
67Disallow: /sign/
68Disallow: /assign/
69Disallow: /myforms/?createTeam=1
70Disallow: /myteams/
71Disallow: /mythemes/collection/
72Disallow: /answers/my_list_with_status.php
73Disallow: /answers/answer_listing.php
74Disallow: /answers/asked
75Disallow: /answers/?eco_tools
76Disallow: /unsubscribe/
77Disallow: *unsubscribe=*
78Disallow: /signup?fullscreen=*
79Disallow: /login?fullscreen=*
80Disallow: */app/createWithWidget*
81Disallow: /answers/search.php
82Disallow: /answers/tag/*
83Disallow: /server/check-olark-chat-support
84Disallow: /playground/
85Disallow: /platform/
86Disallow: /unsubscribecampaign/
87Disallow: */form-templates/preview/thank-you/
88Disallow: */theme-store/preview/thank-you/
89Disallow: /1*?
90Disallow: /2*?
91Disallow: /3*?
92Disallow: /4*?
93Disallow: /5*?
94Disallow: /6*?
95Disallow: /7*?
96Disallow: /8*?
97Disallow: /9*?
98Disallow: /form/*?
99Disallow: /form/*/event/
100Disallow: /workflow-form/
101Disallow: *?kuid=
102Disallow: *&kuid=
103Disallow: *?ref=isModalView
104Disallow: *&ref=isModalView
105Disallow: /widget-uploads/
106Disallow: /approver-actions/
107Disallow: /captcha?*
108Disallow: /draft/
109Disallow: /emails/
110Disallow: /hidebanner/
111Disallow: /logout.php
112Disallow: */signup/?rp=*
113Disallow: */login/?rp=*
114Disallow: /opt/widget-cache.php
115Disallow: /pdf-submission/
116Disallow: /preview/
117Disallow: /share/
118Disallow: /upgrade?username=
119Disallow: /upgrade/?username=
120Disallow: /API/ai-agent/
121Disallow: /API/user/abtest/
122Disallow: /uxr-survey-management/
123Disallow: /API/ep/
124Disallow: /API/user/growth-asset-manager/
125Disallow: /API/translation/
126Disallow: /API/actions/
127Disallow: /API/ai-reviewer/
128Disallow: /growth-tools-actions
129Disallow: /static/feedbackWP.js
130Disallow: */answers/user-threads?username=
131Disallow: */form-templates/*?card$
132Disallow: */amp/
133Disallow: /academy/*/verify
134Disallow: /academy/badge
135Disallow: /pdf-templates/*/clone
136Disallow: /workflow/withForm/
137Disallow: /widgets/fix/widget
138Disallow: /apps/fix/app
139Disallow: /ai/apps/features*
140Disallow: /_helpers/
141Disallow: *US_CENSUS_NAME*
142Disallow: *US_FEMALE_NAME*
143Disallow: *US_MALE_NAME*
144Disallow: /approval-form/
145Disallow: /deeplink*
146Disallow: */workflow-templates/standalone/
147Disallow: */workflow-templates/search?
148Disallow: */d/
149Disallow: /API/insight/form/question-actions
150Allow: /63463511625958
151Allow: /uploads/page-builder/
152
153User-agent: Yandexbot
154Disallow: /ownerview.php
155
156User-agent: LinkedInBot
157User-agent: Twitterbot
158User-agent: FacebookBot
159User-agent: FacebookExternalHit
160User-agent: Meta-ExternalAgent
161User-agent: Meta-ExternalFetcher
162Allow: /academy/*/verify
163Allow: /academy/badge
164Allow: /agent/
165
166User-agent: AdsBot-Google
167User-agent: AdsBot-Google-Mobile
168User-agent: AdIdxBot
169Allow: */d/
170
171User-agent: Bingbot
172Disallow: /answers/
173Disallow: /API/user*
174Disallow: /form/
175Disallow: /app/
176Disallow: /uploads/
177Disallow: /grid/
178Disallow: /excel/
179Disallow: /ipns/
180Disallow: /min/
181Disallow: /cimg/
182Disallow: /page.php
183Disallow: /submit.php
184Disallow: /submission/
185Disallow: /submissions/
186Disallow: */form-templates/ur/
187Disallow: */form-templates/static/
188Disallow: */form-templates/standalone/
189Disallow: */pdf-templates/standalone/
190Disallow: */approval-templates/standalone/
191Disallow: */app-templates/standalone/
192Disallow: */agent-templates/standalone/
193Disallow: /announcement/
194Disallow: /forum/
195Disallow: /forum/viewtopic.php
196Disallow: /rssform.php
197Disallow: /invoice/
198Disallow: /pdf-view/
199Disallow: /tr/form/
200Disallow: /*?*entrymessage=*
201Disallow: /*?*em_x=*
202Disallow: /*?*u=*
203Disallow: /*?*source=post_page*
204Disallow: /ownerView.php
205Disallow: */nx/
206Disallow: */build/
207Disallow: */build?*
208Disallow: */build$
209Disallow: /edit/
210Disallow: /inbox/
211Disallow: */form-templates/search/
212Disallow: */pdf-templates/search?
213Disallow: */table-templates/search?
214Disallow: */app-templates/search?
215Disallow: */approval-templates/search?
216Disallow: */agent-templates/search?
217Disallow: */table-templates/demo/
218Disallow: /agent/
219Disallow: /analytics/
220Disallow: /calendar/
221Disallow: /report/
222Disallow: /tables/
223Disallow: /table/
224Disallow: /csv/
225Disallow: /API/user/combinedinfo
226Disallow: /API/formInitCatchLogger/
227Disallow: /API/forum/update-who-typing
228Disallow: /rss/
229Disallow: /server.php
230Disallow: */theme-store/search/
231Disallow: */theme-store/tagged/
232Disallow: */theme-store/theme/my-theme-
233Disallow: /server/update-user-traffic-source
234Disallow: /sign/
235Disallow: /assign/
236Disallow: /myforms/?createTeam=1
237Disallow: /myteams/
238Disallow: /mythemes/collection/
239Disallow: /answers/my_list_with_status.php
240Disallow: /answers/answer_listing.php
241Disallow: /answers/asked
242Disallow: /answers/?eco_tools
243Disallow: /unsubscribe/
244Disallow: *unsubscribe=*
245Disallow: /signup?fullscreen=*
246Disallow: /login?fullscreen=*
247Disallow: */app/createWithWidget*
248Disallow: /answers/search.php
249Disallow: /answers/tag/*
250Disallow: /server/check-olark-chat-support
251Disallow: /playground/
252Disallow: /platform/
253Disallow: /unsubscribecampaign/
254Disallow: */form-templates/preview/thank-you/
255Disallow: */theme-store/preview/thank-you/
256Disallow: /1*?
257Disallow: /2*?
258Disallow: /3*?
259Disallow: /4*?
260Disallow: /5*?
261Disallow: /6*?
262Disallow: /7*?
263Disallow: /8*?
264Disallow: /9*?
265Disallow: /form/*?
266Disallow: /form/*/event/
267Disallow: /workflow-form/
268Disallow: *?kuid=
269Disallow: *&kuid=
270Disallow: *?ref=isModalView
271Disallow: *&ref=isModalView
272Disallow: /widget-uploads/
273Disallow: /approver-actions/
274Disallow: /captcha?*
275Disallow: /draft/
276Disallow: /emails/
277Disallow: /hidebanner/
278Disallow: /logout.php
279Disallow: */signup/?rp=*
280Disallow: */login/?rp=*
281Disallow: /opt/widget-cache.php
282Disallow: /pdf-submission/
283Disallow: /preview/
284Disallow: /share/
285Disallow: /upgrade?username=
286Disallow: /upgrade/?username=
287Disallow: /API/ai-agent/
288Disallow: /API/user/abtest/
289Disallow: /uxr-survey-management/
290Disallow: /API/ep/
291Disallow: /API/user/growth-asset-manager/
292Disallow: /API/translation/
293Disallow: /API/actions/
294Disallow: /API/ai-reviewer/
295Disallow: /growth-tools-actions
296Disallow: /static/feedbackWP.js
297Disallow: */answers/user-threads?username=
298Disallow: */form-templates/*?card$
299Disallow: */amp/
300Disallow: /academy/*/verify
301Disallow: /academy/badge
302Disallow: /pdf-templates/*/clone
303Disallow: /workflow/withForm/
304Disallow: /widgets/fix/widget
305Disallow: /apps/fix/app
306Disallow: /ai/apps/features*
307Disallow: /_helpers/
308Disallow: *US_CENSUS_NAME*
309Disallow: *US_FEMALE_NAME*
310Disallow: *US_MALE_NAME*
311Disallow: /approval-form/
312Disallow: /deeplink*
313Disallow: */workflow-templates/standalone/
314Disallow: */workflow-templates/search?
315Disallow: */d/
316Disallow: /jufs/
317Disallow: /blog/?s=*
318Disallow: /API/insight/form/question-actions
319Allow: /uploads/page-builder/
320
321User-agent: GPTBot
322User-agent: ClaudeBot
323User-agent: Claude-Web
324User-agent: CCBot
325User-agent: Applebot-Extended
326User-agent: PerplexityBot
327User-agent: Meta-ExternalAgent
328User-agent: Meta-ExternalFetcher
329User-agent: anthropic-ai
330User-agent: cohere-ai
331User-agent: Diffbot
332User-agent: FacebookBot
333User-agent: Bytespider
334Disallow: /answers/
335Disallow: /API/user*
336Disallow: /form/
337Disallow: /app/
338Disallow: /uploads/
339Disallow: /grid/
340Disallow: /excel/
341Disallow: /ipns/
342Disallow: /min/
343Disallow: /cimg/
344Disallow: /page.php
345Disallow: /submit.php
346Disallow: /submission/
347Disallow: /submissions/
348Disallow: */form-templates/ur/
349Disallow: */form-templates/static/
350Disallow: */form-templates/standalone/
351Disallow: */pdf-templates/standalone/
352Disallow: */approval-templates/standalone/
353Disallow: */app-templates/standalone/
354Disallow: */agent-templates/standalone/
355Disallow: /announcement/
356Disallow: /forum/
357Disallow: /forum/viewtopic.php
358Disallow: /rssform.php
359Disallow: /invoice/
360Disallow: /pdf-view/
361Disallow: /tr/form/
362Disallow: /*?*entrymessage=*
363Disallow: /*?*em_x=*
364Disallow: /*?*u=*
365Disallow: /*?*source=post_page*
366Disallow: /ownerView.php
367Disallow: */nx/
368Disallow: */build/
369Disallow: */build?*
370Disallow: */build$
371Disallow: /edit/
372Disallow: /inbox/
373Disallow: */form-templates/search/
374Disallow: */pdf-templates/search?
375Disallow: */table-templates/search?
376Disallow: */app-templates/search?
377Disallow: */approval-templates/search?
378Disallow: */agent-templates/search?
379Disallow: */table-templates/demo/
380Disallow: /agent/
381Disallow: /analytics/
382Disallow: /calendar/
383Disallow: /report/
384Disallow: /tables/
385Disallow: /table/
386Disallow: /csv/
387Disallow: /API/user/combinedinfo
388Disallow: /API/formInitCatchLogger/
389Disallow: /API/forum/update-who-typing
390Disallow: /rss/
391Disallow: /server.php
392Disallow: */theme-store/search/
393Disallow: */theme-store/tagged/
394Disallow: */theme-store/theme/my-theme-
395Disallow: /server/update-user-traffic-source
396Disallow: /sign/
397Disallow: /assign/
398Disallow: /myforms/?createTeam=1
399Disallow: /myteams/
400Disallow: /mythemes/collection/
401Disallow: /answers/my_list_with_status.php
402Disallow: /answers/answer_listing.php
403Disallow: /answers/asked
404Disallow: /answers/?eco_tools
405Disallow: /unsubscribe/
406Disallow: *unsubscribe=*
407Disallow: /signup?fullscreen=*
408Disallow: /login?fullscreen=*
409Disallow: */app/createWithWidget*
410Disallow: /answers/search.php
411Disallow: /answers/tag/*
412Disallow: /server/check-olark-chat-support
413Disallow: /playground/
414Disallow: /platform/
415Disallow: /unsubscribecampaign/
416Disallow: */form-templates/preview/thank-you/
417Disallow: */theme-store/preview/thank-you/
418Disallow: /1*?
419Disallow: /2*?
420Disallow: /3*?
421Disallow: /4*?
422Disallow: /5*?
423Disallow: /6*?
424Disallow: /7*?
425Disallow: /8*?
426Disallow: /9*?
427Disallow: /form/*?
428Disallow: /form/*/event/
429Disallow: /workflow-form/
430Disallow: *?kuid=
431Disallow: *&kuid=
432Disallow: *?ref=isModalView
433Disallow: *&ref=isModalView
434Disallow: /widget-uploads/
435Disallow: /approver-actions/
436Disallow: /captcha?*
437Disallow: /draft/
438Disallow: /emails/
439Disallow: /hidebanner/
440Disallow: /logout.php
441Disallow: */signup/?rp=*
442Disallow: */login/?rp=*
443Disallow: /opt/widget-cache.php
444Disallow: /pdf-submission/
445Disallow: /preview/
446Disallow: /share/
447Disallow: /upgrade?username=
448Disallow: /upgrade/?username=
449Disallow: /API/ai-agent/
450Disallow: /API/user/abtest/
451Disallow: /uxr-survey-management/
452Disallow: /API/ep/
453Disallow: /API/user/growth-asset-manager/
454Disallow: /API/translation/
455Disallow: /API/actions/
456Disallow: /API/ai-reviewer/
457Disallow: /growth-tools-actions
458Disallow: /static/feedbackWP.js
459Disallow: */answers/user-threads?username=
460Disallow: */form-templates/*?card$
461Disallow: */amp/
462Disallow: /academy/*/verify
463Disallow: /academy/badge
464Disallow: /pdf-templates/*/clone
465Disallow: /workflow/withForm/
466Disallow: /widgets/fix/widget
467Disallow: /apps/fix/app
468Disallow: /ai/apps/features*
469Disallow: /_helpers/
470Disallow: *US_CENSUS_NAME*
471Disallow: *US_FEMALE_NAME*
472Disallow: *US_MALE_NAME*
473Disallow: /approval-form/
474Disallow: /deeplink*
475Disallow: */workflow-templates/standalone/
476Disallow: */workflow-templates/search?
477Disallow: */d/
478Disallow: /jufs/
479Disallow: /blog/?s=*
480Disallow: /API/insight/form/question-actions
481Allow: /uploads/page-builder/
482
483Sitemap: https://www.jotform.com/sitemap.xml
484
485
What do the bots actually get?
This page reads robots.txt, which states what jotform.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on jotform.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
Questions
Does jotform.com block GPTBot?
Partly. jotform.com’s robots.txt keeps GPTBot out of some paths, such as /answers/, and lets it crawl the rest. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does jotform.com block ClaudeBot?
Partly. jotform.com’s robots.txt keeps ClaudeBot out of some paths, such as /answers/, and lets it crawl the rest. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does jotform.com block Google-Extended?
No. jotform.com’s robots.txt lets Google-Extended crawl the site. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does jotform.com block PerplexityBot?
Partly. jotform.com’s robots.txt keeps PerplexityBot out of some paths, such as /answers/, and lets it crawl the rest. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find jotform.com?
Yes. jotform.com’s robots.txt lets OAI-SearchBot crawl the site. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.