Domain Name: INTERNSHALA.COM
Registrar: GoDaddy.com, LLC
Domain Status: client delete prohibited
Domain Status: client renew prohibited
Domain Status: client transfer prohibited
Domain Status: client update prohibited
Creation Date: 2010-12-29T17:32:58Z
Registry Expiry Date: 2033-12-29T17:32:58Z
Updated Date: 2023-12-29T17:43:04Z
Name Server: NS-1013.AWSDNS-62.NET
Name Server: NS-114.AWSDNS-14.COM
Name Server: NS-1381.AWSDNS-44.ORG
Name Server: NS-1719.AWSDNS-22.CO.UK
REGISTRAR Contact: GoDaddy.com, LLC
>>> Last update of RDAP database: 2026-06-09T05:16:05Z
#### Rules for ANY User-Agent
User-Agent: *
Disallow: /*,*
Disallow: /*?*
Disallow: /*%3f*
Disallow: /*%3d*
Disallow: /*%3F*
Disallow: /*%3D*
Disallow: /ddos
Disallow: /student
Disallow: /internship/details/
Disallow: /job/details/
Disallow: /internship/search/
Disallow: /job/search/
#### END Rules for ANY User-Agent
#### Crawl Delay for Some Bots
User-agent: Bingbot
User-Agent: Baiduspider
User-Agent: Baiduspider-image
User-Agent: Baiduspider-video
User-Agent: Baiduspider-news
User-Agent: Baiduspider-favo
User-Agent: Baiduspider-cpro
User-Agent: Baiduspider-ads
Crawl-delay: 1
User-agent: MSNBot
User-agent: MSNBot-Media
User-agent: AdIdxBot
User-agent: BingPreview
Crawl-delay: 5
#### END Crawl Delay Rules for Bots
####Partially Block High-Quality AI/LLM Bots
User-agent: GPTBot
User-agent: Google-Extended
User-agent: meta-externalagent
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: GoogleOther
User-agent: Claude-Web
User-agent: Perplexity
User-agent: Cohere
User-agent: cohere-ai
User-agent: Applebot-Extended
User-agent: Google-CloudVertexBot
Disallow: /
User-agent: GPTBot
User-agent: Google-Extended
User-agent: meta-externalagent
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: GoogleOther
User-agent: Claude-Web
User-agent: Perplexity
User-agent: Cohere
User-agent: cohere-ai
User-agent: Applebot-Extended
User-agent: Google-CloudVertexBot
Allow: /about_us
#### Block Low-Quality AI/LLM Bots
User-Agent: DotBot
Disallow: /
User-Agent: spbot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: Omgili
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: Bytedance
Disallow: /
User-agent: Diffbot
Disallow: /
User-agent: Youbot
Disallow: /
User-agent: FriendlyCrawler
Disallow: /
User-agent: img2dataset
Disallow: /
#### End AI/LLM Bot Blocks
#### Crawl Delay for OpenAI & Meta (Facebook) Bots
User-agent: GPTBot
Crawl-delay: 5
User-agent: meta-webindexer
Crawl-delay: 5
User-agent: facebookexternalhit
Crawl-delay: 5
User-agent: FacebookBot
Crawl-delay: 5
#### END OpenAI & Meta Crawl Delays
Sitemap: https://internshala.com/sitemap.xml
Sitemap: https://internshala.com/sitemap-main.xml
Sitemap: https://internshala.com/sitemap-employers.xml
| Pozycja | Wyrażenie | Strona | Skrawek |
|---|---|---|---|
| 6 | /jobs/work-from-home... | ||
| 9 | /company/moretasks-b... | ||
| 24 | /jobs/part-time-work... |