Domain Name: SMARTCAT.COM
Registrar: GoDaddy.com, LLC
Domain Status: client delete prohibited
Domain Status: client renew prohibited
Domain Status: client transfer prohibited
Domain Status: client update prohibited
Creation Date: 1999-11-29T23:12:39Z
Registry Expiry Date: 2029-11-29T23:12:39Z
Updated Date: 2024-11-02T17:10:47Z
Name Server: CLARISSA.NS.CLOUDFLARE.COM
Name Server: FRED.NS.CLOUDFLARE.COM
REGISTRAR Contact: GoDaddy.com, LLC
>>> Last update of RDAP database: 2026-01-25T16:47:18Z
User-agent: Googlebot
Disallow:
User-agent: Yandex
Disallow:
# AI crawlers (explicitly allowed; same restrictions as the default group)
User-agent: GPTBot
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: ChatGPT-User
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: OAI-SearchBot
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: ClaudeBot
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: anthropic-ai
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: PerplexityBot
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: YouBot
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: Google-Extended
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: Applebot-Extended
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
User-agent: *
Crawl-delay: 10
Allow: /
Disallow: /lp/
Disallow: /c/
Disallow: /report-of-the-illegal-content/
Disallow: /ai-chatgpt-automation-translation-whitepaper/
Disallow: /contact-our-legal-support/
Disallow: /contact-our-support-team/
Disallow: /contact-support/
Disallow: /marketplace/user/
Disallow: /users/
Sitemap: https://www.smartcat.com/sitemap.xml
| Position | Phrase | Page | Snippet |
|---|---|---|---|
| 5 | /blog/elearning-content-types/ | ||
| 9 | /pdf-translator/ | ||
| 24 | / | ||
| 27 | / | ||
| 28 | / | ||
| 31 | /blog/translate-word-document/ | ||
| 35 | / |