Domain Name: BOTPENGUIN.COM
Registrar: GoDaddy.com, LLC
Domain Status: client delete prohibited
Domain Status: client renew prohibited
Domain Status: client transfer prohibited
Domain Status: client update prohibited
Creation Date: 2019-01-08T15:24:52Z
Registry Expiry Date: 2029-01-08T15:24:52Z
Updated Date: 2025-12-23T14:21:17Z
Name Server: MARTY.NS.CLOUDFLARE.COM
Name Server: VAL.NS.CLOUDFLARE.COM
REGISTRAR Contact: GoDaddy.com, LLC
>>> Last update of RDAP database: 2026-03-16T11:24:04Z
# ——— DEFAULT: ALL BOTS ——— User-agent: * Allow: / # Private & system areas Disallow: /admin/ Disallow: /dashboard/ Disallow: /login/ Disallow: /signup/ # Transaction pages (no SEO value) Disallow: /thank-you/ Disallow: /confirmation/ # API and system endpoints Disallow: /api/ Disallow: /search/ Disallow: /feed/ # Thin taxonomy pages Disallow: /blogs/category/ Disallow: /blogs/tag/ # NOTE: /blogs/author/ is intentionally ALLOWED — supports E-E-A-T signals # Tracking parameters (prevents duplicate URL crawling) Disallow: /*?utm_ Disallow: /*?ref= Disallow: /*?gclid= Disallow: /*?fbclid= # Priority content sections Allow: /blogs/ Allow: /blogs/author/ Allow: /glossary/ Allow: /case-studies/ Allow: /chatbot-integrations/ # ——— LLM & AI PLATFORMS (Explicitly allow for AI visibility) ——— # Ensures BotPenguin content appears in ChatGPT, Claude, Gemini, and Perplexity answers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: Applebot Allow: / User-agent: YouBot Allow: / User-agent: Diffbot Allow: / Disallow: /health-check Sitemap: https://botpenguin.com/sitemap.xml
| Položaj | Fraza | Stran | Izrezek |
|---|---|---|---|
| 4 | /blogs/the-complete-guide-to-mee6-discord-bot-with-commands | ||
| 6 | /blogs/what-is-nightbot-and-how-to-add-nightbot-to-twitch | ||
| 29 | /glossary/communication-model |