Who blocks AI · #725 in the Majestic Million
robots.txt · checked 9 Nov 2026
Does hostinger.com block AI crawlers?
Yes. hostinger.com’s robots.txt blocks 1 of the 19 AI crawlers we track, including Bytespider. Search engines such as Googlebot and Bingbot may crawl it.
GPTBotPartly blockedOAI-SearchBotPartly blockedClaudeBotPartly blockedPerplexityBotPartly blockedGoogle-ExtendedPartly blockedCCBotPartly blocked- robots.txt
- www.hostinger.com/robots.txt · 576 lines
- llms.txt
- found
- Checked
- 9 November 2026, as canaicrawl. We check again every week.
Every bot, and the line that decides
Search engines
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
Googlebot | Allowed | no rule matches the home page | |
Bingbot | Microsoft | Allowed | no rule matches the home page |
DuckDuckBot | DuckDuckGo | Allowed | no rule matches the home page |
Applebot | Apple | Allowed | no rule matches the home page |
PetalBot | Huawei | Allowed | no rule matches the home page |
YandexBot | Yandex | Allowed | no rule matches the home page |
Baiduspider | Baidu | Allowed | no rule matches the home page |
AI search
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
OAI-SearchBot | OpenAI | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
PerplexityBot | Perplexity | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Claude-SearchBot | Anthropic | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
DuckAssistBot | DuckDuckGo | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Amazonbot | Amazon | Allowed | no rule matches the home page |
YouBot | You.com | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
AI training
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
GPTBot | OpenAI | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
ClaudeBot | Anthropic | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Google-Extended | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more | |
CCBot | Common Crawl | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Applebot-Extended | Apple | Allowed | no rule matches the home page |
GoogleOther | Allowed | no rule matches the home page | |
Meta-ExternalAgent | Meta | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Bytespider | ByteDance | Blocked | line 572 · Disallow: / under User-agent: ByteSpider |
User-triggered fetchers
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
ChatGPT-User | OpenAI | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Claude-User | Anthropic | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Perplexity-User | Perplexity | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
MistralAI-User | Mistral | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
Meta-ExternalFetcher | Meta | Partly blocked | line 419 · Disallow: /*?*clid= line 420 · Disallow: /*?*_ga= and 147 more |
SEO tools
| Bot | Operator | robots.txt | Deciding line |
|---|---|---|---|
AhrefsBot | Ahrefs | Allowed | no rule matches the home page |
SemrushBot | Semrush | Allowed | no rule matches the home page |
MJ12bot | Majestic | Allowed | no rule matches the home page |
DotBot | Moz | Allowed | no rule matches the home page |
View www.hostinger.com/robots.txt · 576 lines
1# Hey there, curious crawler
2# We're hiring! Check out our career page: https://www.hostinger.com/career
3#
4# \
5# \
6# \\
7# \\
8# >\/7
9# _.-(6' \
10# (=___._/` \
11# ) \ |
12# / / |
13# / > /
14# j < _\
15# _.-' : ``.
16# \ r=._\ `.
17# <`\\_ \ .`-.
18# \ r-7 `-. ._ ' . `\
19# \', '7 7) )
20# \/ \| \' / `-._
21# || .'
22# \\ (
23# >\ >
24# ,.-' >.'
25# <.'_.''
26# <'
27#
28# SEO wizards welcome - if you found this, you're the kind of curious we love.
29
30# Content Signals declare our preferences for how this content may be used once accessed:
31# search - building a search index and returning links or short excerpts
32# ai-input - feeding content into an AI model at query time (RAG, grounding, AI answers)
33# ai-train - training or fine-tuning an AI model
34# "yes" states a permitted use, "no" states an objected-to use. See https://contentsignals.org
35
36User-agent: *
37Content-Signal: search=yes, ai-input=yes, ai-train=yes
38Disallow: /*?*clid=
39Disallow: /*?*_ga=
40Disallow: /*?e=
41Disallow: /*?j=
42Disallow: /*?b=
43Disallow: /*?m=
44Disallow: /*?detail/
45Disallow: /*?items/
46Disallow: /*?page_id=
47Disallow: /*?col=
48Disallow: /*?id=*&brand=
49Disallow: /*?_bdsid=
50Disallow: /*?_bd_prev_page=
51Disallow: */_nuxt/*
52Disallow: */tag/*
53Disallow: /cart-hosting/*
54Disallow: /api-proxy/
55Disallow: /cdn-cgi/
56Disallow: /cake/
57Disallow: /domain-name-results
58Disallow: /transfer-domain-results
59Disallow: /special/000webhost
60Disallow: /special/webhost
61Disallow: /ae/special/000webhost
62Disallow: /ae/special/webhost
63Disallow: /ar/special/000webhost
64Disallow: /ar/special/webhost
65Disallow: /ar/especial/000webhost
66Disallow: /at/special/000webhost
67Disallow: /at/special/webhost
68Disallow: /at/spezial/000webhost
69Disallow: /au/special/000webhost
70Disallow: /au/special/webhost
71Disallow: /bd/special/000webhost
72Disallow: /bd/special/webhost
73Disallow: /be-nl/special/000webhost
74Disallow: /be-nl/special/webhost
75Disallow: /be-fr/special/000webhost
76Disallow: /be-fr/special/webhost
77Disallow: /be-fr/speciales/000webhost
78Disallow: /br/special/000webhost
79Disallow: /br/special/webhost
80Disallow: /br/especial/000webhost
81Disallow: /ca/special/000webhost
82Disallow: /ca/special/webhost
83Disallow: /ca-fr/special/000webhost
84Disallow: /ca-fr/special/webhost
85Disallow: /ca-fr/speciales/000webhost
86Disallow: /ch-de/special/000webhost
87Disallow: /ch-de/special/webhost
88Disallow: /ch-de/spezial/000webhost
89Disallow: /ch-fr/special/000webhost
90Disallow: /ch-fr/special/webhost
91Disallow: /ch-fr/speciales/000webhost
92Disallow: /co/special/000webhost
93Disallow: /co/special/webhost
94Disallow: /co/especial/000webhost
95Disallow: /hr/special/000webhost
96Disallow: /hr/special/webhost
97Disallow: /hr/posebna-ponuda/000webhost
98Disallow: /hk/special/000webhost
99Disallow: /hk/special/webhost
100Disallow: /cz/special/000webhost
101Disallow: /cz/special/webhost
102Disallow: /de/special/000webhost
103Disallow: /de/special/webhost
104Disallow: /de/spezial/000webhost
105Disallow: /dk/special/000webhost
106Disallow: /dk/special/webhost
107Disallow: /ee/special/000webhost
108Disallow: /ee/special/webhost
109Disallow: /eg/special/000webhost
110Disallow: /eg/special/webhost
111Disallow: /es/special/000webhost
112Disallow: /es/special/webhost
113Disallow: /es/especial/000webhost
114Disallow: /fi/special/000webhost
115Disallow: /fi/special/webhost
116Disallow: /fr/special/000webhost
117Disallow: /fr/special/webhost
118Disallow: /fr/speciales/000webhost
119Disallow: /gr/special/000webhost
120Disallow: /gr/special/webhost
121Disallow: /hu/special/000webhost
122Disallow: /hu/special/webhost
123Disallow: /hu/specialis/000webhost
124Disallow: /id/special/000webhost
125Disallow: /id/special/webhost
126Disallow: /il/special/000webhost
127Disallow: /il/special/webhost
128Disallow: /in/special/000webhost
129Disallow: /in/special/webhost
130Disallow: /in-hi/special/000webhost
131Disallow: /in-hi/special/webhost
132Disallow: /it/special/000webhost
133Disallow: /it/special/webhost
134Disallow: /jp/special/000webhost
135Disallow: /jp/special/webhost
136Disallow: /kr/special/000webhost
137Disallow: /kr/special/webhost
138Disallow: /lt/special/000webhost
139Disallow: /lt/special/webhost
140Disallow: /lv/special/000webhost
141Disallow: /lv/special/webhost
142Disallow: /lv/ipasi/000webhost
143Disallow: /ma/special/000webhost
144Disallow: /ma/special/webhost
145Disallow: /ma-fr/special/000webhost
146Disallow: /ma-fr/special/webhost
147Disallow: /ma-fr/speciales/000webhost
148Disallow: /mx/special/000webhost
149Disallow: /mx/special/webhost
150Disallow: /my/special/000webhost
151Disallow: /my/special/webhost
152Disallow: /ng/special/000webhost
153Disallow: /ng/special/webhost
154Disallow: /nl/special/000webhost
155Disallow: /nl/special/webhost
156Disallow: /no/special/000webhost
157Disallow: /no/special/webhost
158Disallow: /no/spesial/000webhost
159Disallow: /pk/special/000webhost
160Disallow: /pk/special/webhost
161Disallow: /ph/special/000webhost
162Disallow: /ph/special/webhost
163Disallow: /pl/special/000webhost
164Disallow: /pl/special/webhost
165Disallow: /pt/special/000webhost
166Disallow: /pt/special/webhost
167Disallow: /pt/especial/000webhost
168Disallow: /ro/special/000webhost
169Disallow: /ro/special/webhost
170Disallow: /se/special/000webhost
171Disallow: /se/special/webhost
172Disallow: /sk/special/000webhost
173Disallow: /sk/special/webhost
174Disallow: /th/special/000webhost
175Disallow: /th/special/webhost
176Disallow: /tr/special/000webhost
177Disallow: /tr/special/webhost
178Disallow: /tr/ozellik/000webhost
179Disallow: /ua/special/000webhost
180Disallow: /ua/special/webhost
181Disallow: /ua/osobennyj/000webhost
182Disallow: /uk/special/000webhost
183Disallow: /uk/special/webhost
184Disallow: /vn/special/000webhost
185Disallow: /vn/special/webhost
186Disallow: /vn/dac-biet/000webhost
187
188Disallow: /tutorials/*_ga
189Disallow: /tutorials/search/*
190Disallow: /tutorials/?s=*
191Disallow: /blog/*_ga
192Sitemap: https://www.hostinger.com/sitemap.xml
193Sitemap: https://www.hostinger.com/tutorials/sitemap_index.xml
194Sitemap: https://www.hostinger.com/blog/sitemap_index.xml
195Sitemap: https://www.hostinger.com/support/sitemap_index.xml
196Sitemap: https://www.hostinger.com/sitemap_index.xml
197
198Disallow: /ae/tutorials/*_ga
199Disallow: /ae/tutorials/search/*
200Disallow: /ae/tutorials/?s=*
201Sitemap: https://www.hostinger.com/ae/sitemap.xml
202Sitemap: https://www.hostinger.com/ae/tutorials/sitemap_index.xml
203
204Disallow: /ar/tutoriales/*_ga
205Disallow: /ar/tutoriales/search/*
206Disallow: /ar/tutoriales/?s=*
207Sitemap: https://www.hostinger.com/ar/sitemap.xml
208Sitemap: https://www.hostinger.com/ar/tutoriales/sitemap_index.xml
209
210Sitemap: https://www.hostinger.com/at/sitemap.xml
211
212Disallow: /au/tutorials/*_ga
213Disallow: /au/tutorials/search/*
214Disallow: /au/tutorials/?s=*
215Sitemap: https://www.hostinger.com/au/sitemap.xml
216Sitemap: https://www.hostinger.com/au/tutorials/sitemap_index.xml
217Sitemap: https://www.hostinger.com/au/support/sitemap_index.xml
218
219Sitemap: https://www.hostinger.com/bd/sitemap.xml
220
221Sitemap: https://www.hostinger.com/be-nl/sitemap.xml
222
223Sitemap: https://www.hostinger.com/be-fr/sitemap.xml
224
225Disallow: /br/tutoriais/*_ga
226Disallow: /br/tutoriais/search/*
227Disallow: /br/tutoriais/?s=*
228Sitemap: https://www.hostinger.com/br/sitemap.xml
229Sitemap: https://www.hostinger.com/br/tutoriais/sitemap_index.xml
230Sitemap: https://www.hostinger.com/br/support/sitemap_index.xml
231
232Disallow: /ca/tutorials/*_ga
233Disallow: /ca/tutorials/search/*
234Disallow: /ca/tutorials/?s=*
235Sitemap: https://www.hostinger.com/ca/sitemap.xml
236Sitemap: https://www.hostinger.com/ca/tutorials/sitemap_index.xml
237Sitemap: https://www.hostinger.com/ca/support/sitemap_index.xml
238
239Disallow: /ca-fr/tutoriels/*_ga
240Disallow: /ca-fr/tutoriels/search/*
241Disallow: /ca-fr/tutoriels/?s=*
242Sitemap: https://www.hostinger.com/ca-fr/sitemap.xml
243Sitemap: https://www.hostinger.com/ca-fr/tutoriels/sitemap_index.xml
244Sitemap: https://www.hostinger.com/ca-fr/support/sitemap_index.xml
245
246Sitemap: https://www.hostinger.com/ch-de/sitemap.xml
247
248Sitemap: https://www.hostinger.com/ch-fr/sitemap.xml
249
250Disallow: /co/tutoriales/*_ga
251Disallow: /co/tutoriales/search/*
252Disallow: /co/tutoriales/?s=*
253Sitemap: https://www.hostinger.com/co/sitemap.xml
254Sitemap: https://www.hostinger.com/co/tutoriales/sitemap_index.xml
255
256Sitemap: https://www.hostinger.com/hr/sitemap.xml
257
258Sitemap: https://www.hostinger.com/hk/sitemap.xml
259
260Sitemap: https://www.hostinger.com/cz/sitemap.xml
261
262Disallow: /de/tutorials/*_ga
263Disallow: /de/tutorials/search/*
264Disallow: /de/tutorials/?s=*
265Sitemap: https://www.hostinger.com/de/sitemap.xml
266Sitemap: https://www.hostinger.com/de/tutorials/sitemap_index.xml
267
268Sitemap: https://www.hostinger.com/dk/sitemap.xml
269
270Sitemap: https://www.hostinger.com/ee/sitemap.xml
271
272Disallow: /eg/tutorials/*_ga
273Disallow: /eg/tutorials/search/*
274Disallow: /eg/tutorials/?s=*
275Sitemap: https://www.hostinger.com/eg/sitemap.xml
276Sitemap: https://www.hostinger.com/eg/tutorials/sitemap_index.xml
277
278Disallow: /es/tutoriales/*_ga
279Disallow: /es/tutoriales/search/*
280Disallow: /es/tutoriales/?s=*
281Sitemap: https://www.hostinger.com/es/sitemap.xml
282Sitemap: https://www.hostinger.com/es/tutoriales/sitemap_index.xml
283Sitemap: https://www.hostinger.com/es/support/sitemap_index.xml
284
285Sitemap: https://www.hostinger.com/fi/sitemap.xml
286
287Disallow: /fr/tutoriels/*_ga
288Disallow: /fr/tutoriels/search/*
289Disallow: /fr/tutoriels/?s=*
290Sitemap: https://www.hostinger.com/fr/sitemap.xml
291Sitemap: https://www.hostinger.com/fr/tutoriels/sitemap_index.xml
292Sitemap: https://www.hostinger.com/fr/support/sitemap_index.xml
293
294Sitemap: https://www.hostinger.com/gr/sitemap.xml
295
296Sitemap: https://www.hostinger.com/hu/sitemap.xml
297
298Disallow: /id/tutorial/*_ga
299Disallow: /id/tutorial/search/*
300Disallow: /id/tutorial/?s=*
301Sitemap: https://www.hostinger.com/id/sitemap.xml
302Sitemap: https://www.hostinger.com/id/tutorial/sitemap_index.xml
303Sitemap: https://www.hostinger.com/id/support/sitemap_index.xml
304
305Sitemap: https://www.hostinger.com/il/sitemap.xml
306
307Disallow: /in/tutorials/*_ga
308Disallow: /in/tutorials/search/*
309Disallow: /in/tutorials/?s=*
310Sitemap: https://www.hostinger.com/in/sitemap.xml
311Sitemap: https://www.hostinger.com/in/tutorials/sitemap_index.xml
312
313Disallow: /in-hi/tutorials/*_ga
314Disallow: /in-hi/tutorials/search/*
315Disallow: /in-hi/tutorials/?s=*
316Sitemap: https://www.hostinger.com/in-hi/sitemap.xml
317Sitemap: https://www.hostinger.com/in-hi/tutorials/sitemap_index.xml
318
319Disallow: /it/tutorial/*_ga
320Disallow: /it/tutorial/search/*
321Disallow: /it/tutorial/?s=*
322Sitemap: https://www.hostinger.com/it/sitemap.xml
323Sitemap: https://www.hostinger.com/it/tutorial/sitemap_index.xml
324
325Sitemap: https://www.hostinger.com/jp/sitemap.xml
326
327Disallow: /kr/tutorials/*_ga
328Disallow: /kr/tutorials/search/*
329Disallow: /kr/tutorials/?s=*
330Sitemap: https://www.hostinger.com/kr/sitemap.xml
331Sitemap: https://www.hostinger.com/kr/tutorials/sitemap_index.xml
332
333Sitemap: https://www.hostinger.com/lt/sitemap.xml
334Sitemap: https://www.hostinger.com/lt/support/sitemap_index.xml
335
336Sitemap: https://www.hostinger.com/lv/sitemap.xml
337
338Sitemap: https://www.hostinger.com/ma/sitemap.xml
339
340Sitemap: https://www.hostinger.com/ma-fr/sitemap.xml
341
342Disallow: /mx/tutoriales/*_ga
343Disallow: /mx/tutoriales/search/*
344Disallow: /mx/tutoriales/?s=*
345Sitemap: https://www.hostinger.com/mx/sitemap.xml
346Sitemap: https://www.hostinger.com/mx/tutoriales/sitemap_index.xml
347
348Disallow: /my/tutorials/*_ga
349Disallow: /my/tutorials/search/*
350Disallow: /my/tutorials/?s=*
351Sitemap: https://www.hostinger.com/my/sitemap.xml
352Sitemap: https://www.hostinger.com/my/tutorials/sitemap_index.xml
353
354Sitemap: https://www.hostinger.com/ng/sitemap.xml
355
356Sitemap: https://www.hostinger.com/nl/sitemap.xml
357
358Sitemap: https://www.hostinger.com/no/sitemap.xml
359
360Sitemap: https://www.hostinger.com/pk/sitemap.xml
361
362Disallow: /ph/tutorials/*_ga
363Disallow: /ph/tutorials/search/*
364Disallow: /ph/tutorials/?s=*
365Sitemap: https://www.hostinger.com/ph/sitemap.xml
366Sitemap: https://www.hostinger.com/ph/tutorials/sitemap_index.xml
367
368Sitemap: https://www.hostinger.com/pl/sitemap.xml
369
370Disallow: /pt/tutoriais/*_ga
371Disallow: /pt/tutoriais/search/*
372Disallow: /pt/tutoriais/?s=*
373Sitemap: https://www.hostinger.com/pt/sitemap.xml
374Sitemap: https://www.hostinger.com/pt/tutoriais/sitemap_index.xml
375
376Sitemap: https://www.hostinger.com/ro/sitemap.xml
377
378Sitemap: https://www.hostinger.com/se/sitemap.xml
379
380Sitemap: https://www.hostinger.com/sk/sitemap.xml
381
382Sitemap: https://www.hostinger.com/th/sitemap.xml
383
384Sitemap: https://www.hostinger.com/tr/sitemap.xml
385
386Sitemap: https://www.hostinger.com/ua/sitemap.xml
387Sitemap: https://www.hostinger.com/ua/support/sitemap_index.xml
388
389Disallow: /uk/tutorials/*_ga
390Disallow: /uk/tutorials/search/*
391Disallow: /uk/tutorials/?s=*
392Sitemap: https://www.hostinger.com/uk/sitemap.xml
393Sitemap: https://www.hostinger.com/uk/tutorials/sitemap_index.xml
394
395Sitemap: https://www.hostinger.com/vn/sitemap.xml
396
397# AI crawlers we welcome
398User-agent: GPTBot
399User-agent: OAI-SearchBot
400User-agent: ChatGPT-User
401User-agent: ClaudeBot
402User-agent: Claude-SearchBot
403User-agent: Claude-User
404User-agent: Google-Extended
405User-agent: Gemini-Fetch
406User-agent: Google-NotebookLM
407User-agent: Google-CloudVertexBot
408User-agent: PerplexityBot
409User-agent: Perplexity-User
410User-agent: Meta-ExternalAgent
411User-agent: Meta-ExternalFetcher
412User-agent: DuckAssistBot
413User-agent: YouBot
414User-agent: DeepSeek
415User-agent: MistralAI-User
416User-agent: CCBot
417Content-Signal: search=yes, ai-input=yes, ai-train=yes
418Allow: /
419Disallow: /*?*clid=
420Disallow: /*?*_ga=
421Disallow: /*?e=
422Disallow: /*?j=
423Disallow: /*?b=
424Disallow: /*?m=
425Disallow: /*?detail/
426Disallow: /*?items/
427Disallow: /*?page_id=
428Disallow: /*?col=
429Disallow: /*?id=*&brand=
430Disallow: /*?_bdsid=
431Disallow: /*?_bd_prev_page=
432Disallow: */_nuxt/*
433Disallow: */tag/*
434Disallow: /cart-hosting/*
435Disallow: /api-proxy/
436Disallow: /cdn-cgi/
437Disallow: /cake/
438Disallow: /domain-name-results
439Disallow: /transfer-domain-results
440Disallow: /special/000webhost
441Disallow: /special/webhost
442Disallow: /ae/special/000webhost
443Disallow: /ae/special/webhost
444Disallow: /ar/special/000webhost
445Disallow: /ar/special/webhost
446Disallow: /ar/especial/000webhost
447Disallow: /at/special/000webhost
448Disallow: /at/special/webhost
449Disallow: /at/spezial/000webhost
450Disallow: /au/special/000webhost
451Disallow: /au/special/webhost
452Disallow: /bd/special/000webhost
453Disallow: /bd/special/webhost
454Disallow: /be-nl/special/000webhost
455Disallow: /be-nl/special/webhost
456Disallow: /be-fr/special/000webhost
457Disallow: /be-fr/special/webhost
458Disallow: /be-fr/speciales/000webhost
459Disallow: /br/special/000webhost
460Disallow: /br/special/webhost
461Disallow: /br/especial/000webhost
462Disallow: /ca/special/000webhost
463Disallow: /ca/special/webhost
464Disallow: /ca-fr/special/000webhost
465Disallow: /ca-fr/special/webhost
466Disallow: /ca-fr/speciales/000webhost
467Disallow: /ch-de/special/000webhost
468Disallow: /ch-de/special/webhost
469Disallow: /ch-de/spezial/000webhost
470Disallow: /ch-fr/special/000webhost
471Disallow: /ch-fr/special/webhost
472Disallow: /ch-fr/speciales/000webhost
473Disallow: /co/special/000webhost
474Disallow: /co/special/webhost
475Disallow: /co/especial/000webhost
476Disallow: /hr/special/000webhost
477Disallow: /hr/special/webhost
478Disallow: /hr/posebna-ponuda/000webhost
479Disallow: /hk/special/000webhost
480Disallow: /hk/special/webhost
481Disallow: /cz/special/000webhost
482Disallow: /cz/special/webhost
483Disallow: /de/special/000webhost
484Disallow: /de/special/webhost
485Disallow: /de/spezial/000webhost
486Disallow: /dk/special/000webhost
487Disallow: /dk/special/webhost
488Disallow: /ee/special/000webhost
489Disallow: /ee/special/webhost
490Disallow: /eg/special/000webhost
491Disallow: /eg/special/webhost
492Disallow: /es/special/000webhost
493Disallow: /es/special/webhost
494Disallow: /es/especial/000webhost
495Disallow: /fi/special/000webhost
496Disallow: /fi/special/webhost
497Disallow: /fr/special/000webhost
498Disallow: /fr/special/webhost
499Disallow: /fr/speciales/000webhost
500Disallow: /gr/special/000webhost
501Disallow: /gr/special/webhost
502Disallow: /hu/special/000webhost
503Disallow: /hu/special/webhost
504Disallow: /hu/specialis/000webhost
505Disallow: /id/special/000webhost
506Disallow: /id/special/webhost
507Disallow: /il/special/000webhost
508Disallow: /il/special/webhost
509Disallow: /in/special/000webhost
510Disallow: /in/special/webhost
511Disallow: /in-hi/special/000webhost
512Disallow: /in-hi/special/webhost
513Disallow: /it/special/000webhost
514Disallow: /it/special/webhost
515Disallow: /jp/special/000webhost
516Disallow: /jp/special/webhost
517Disallow: /kr/special/000webhost
518Disallow: /kr/special/webhost
519Disallow: /lt/special/000webhost
520Disallow: /lt/special/webhost
521Disallow: /lv/special/000webhost
522Disallow: /lv/special/webhost
523Disallow: /lv/ipasi/000webhost
524Disallow: /ma/special/000webhost
525Disallow: /ma/special/webhost
526Disallow: /ma-fr/special/000webhost
527Disallow: /ma-fr/special/webhost
528Disallow: /ma-fr/speciales/000webhost
529Disallow: /mx/special/000webhost
530Disallow: /mx/special/webhost
531Disallow: /my/special/000webhost
532Disallow: /my/special/webhost
533Disallow: /ng/special/000webhost
534Disallow: /ng/special/webhost
535Disallow: /nl/special/000webhost
536Disallow: /nl/special/webhost
537Disallow: /no/special/000webhost
538Disallow: /no/special/webhost
539Disallow: /no/spesial/000webhost
540Disallow: /pk/special/000webhost
541Disallow: /pk/special/webhost
542Disallow: /ph/special/000webhost
543Disallow: /ph/special/webhost
544Disallow: /pl/special/000webhost
545Disallow: /pl/special/webhost
546Disallow: /pt/special/000webhost
547Disallow: /pt/special/webhost
548Disallow: /pt/especial/000webhost
549Disallow: /ro/special/000webhost
550Disallow: /ro/special/webhost
551Disallow: /se/special/000webhost
552Disallow: /se/special/webhost
553Disallow: /sk/special/000webhost
554Disallow: /sk/special/webhost
555Disallow: /th/special/000webhost
556Disallow: /th/special/webhost
557Disallow: /tr/special/000webhost
558Disallow: /tr/special/webhost
559Disallow: /tr/ozellik/000webhost
560Disallow: /ua/special/000webhost
561Disallow: /ua/special/webhost
562Disallow: /ua/osobennyj/000webhost
563Disallow: /uk/special/000webhost
564Disallow: /uk/special/webhost
565Disallow: /vn/special/000webhost
566Disallow: /vn/special/webhost
567Disallow: /vn/dac-biet/000webhost
568
569
570# Crawlers we block
571User-agent: ByteSpider
572Disallow: /
573
574Agentmap: https://www.hostinger.com/.well-known/ai-catalog.json
575EntityMap: https://www.hostinger.com/entitymap.json
576
What do the bots actually get?
This page reads robots.txt, which states what hostinger.com asks of crawlers. A firewall or CDN can still refuse a bot that robots.txt allows. The live check requests the page as each bot and shows the status it gets.
Run a live check on hostinger.com Test a path in the robots.txt tester
History
- 19 October 2026: first checked.
- 9 November 2026: now blocks part of the site to CCBot.
Questions
Does hostinger.com block GPTBot?
Partly. hostinger.com’s robots.txt keeps GPTBot out of some paths, such as /*?*clid=, and lets it crawl the rest. GPTBot is OpenAI’s crawler for training data; blocking it doesn’t affect ChatGPT search, which uses OAI-SearchBot. Checked 9 November 2026.
Does hostinger.com block ClaudeBot?
Partly. hostinger.com’s robots.txt keeps ClaudeBot out of some paths, such as /*?*clid=, and lets it crawl the rest. ClaudeBot is Anthropic’s crawler for training data. Checked 9 November 2026.
Does hostinger.com block Google-Extended?
Partly. hostinger.com’s robots.txt keeps Google-Extended out of some paths, such as /*?*clid=, and lets it crawl the rest. Google-Extended is the token that controls whether Google may use pages for Gemini training and grounding; it doesn’t affect Google Search. Checked 9 November 2026.
Does hostinger.com block PerplexityBot?
Partly. hostinger.com’s robots.txt keeps PerplexityBot out of some paths, such as /*?*clid=, and lets it crawl the rest. PerplexityBot is the crawler that indexes pages for Perplexity’s answers. Checked 9 November 2026.
Can ChatGPT search find hostinger.com?
Partly. hostinger.com’s robots.txt keeps OAI-SearchBot out of some paths, such as /*?*clid=, and lets it crawl the rest. OAI-SearchBot is the crawler behind ChatGPT search; blocking it keeps the site out of ChatGPT’s search answers. Checked 9 November 2026.