Domain Name: PANGOBOOKS.COM
Registrar: Squarespace Domains II LLC
Domain Status: active
Creation Date: 2020-11-07T20:31:10Z
Registry Expiry Date: 2028-11-07T20:31:10Z
Updated Date: 2026-03-05T06:54:21Z
Name Server: KHLOE.NS.CLOUDFLARE.COM
Name Server: REESE.NS.CLOUDFLARE.COM
REGISTRAR Contact: Squarespace Domains II LLC
>>> Last update of RDAP database: 2026-06-09T14:51:58Z
# PangoBooks robots.txt # https://pangobooks.com # === Default rules for all bots === User-agent: * Allow: / Crawl-delay: 1 Disallow: /api/ Disallow: /_next/ Disallow: /search? Disallow: /order/ Disallow: /settings/ Disallow: /checkout/ Sitemap: https://pangobooks.com/sitemaps/sitemap_index.xml # === AI training / LLM bots — block pricing & data, throttle hard === User-agent: GPTBot User-agent: ChatGPT-User User-agent: Google-Extended User-agent: anthropic-ai User-agent: ClaudeBot User-agent: cohere-ai User-agent: PerplexityBot User-agent: FacebookBot User-agent: Applebot-Extended Crawl-delay: 10 Disallow: /pricing/ Disallow: /data/ Disallow: /api/ Disallow: /order/ Disallow: /settings/ Disallow: /checkout/ # === SEO/Research crawlers — throttle + limit === User-agent: AhrefsBot User-agent: SemrushBot User-agent: PetalBot Crawl-delay: 10 Disallow: /pricing/ Disallow: /data/ Disallow: /api/ Disallow: /order/ Disallow: /settings/ # === Aggressive scrapers — block entirely === User-agent: Bytespider User-agent: DataForSeoBot User-agent: DotBot User-agent: MJ12bot User-agent: BLEXBot User-agent: Sogou User-agent: YisouSpider User-agent: MegaIndex Disallow: /
| Posição | Frase | Página | Trecho |
|---|---|---|---|
| 6 | /series/every-day?sr... | ||
| 7 | /titles/is-he-a-girl... | ||
| 8 | /titles/i-am-money/2... | ||
| 17 | /titles/rising-queen... | ||
| 18 | /books/c44e006e-ab8e... | ||
| 20 | /author/maki-minami?... | ||
| 21 | /titles/the-girl-in-... | ||
| 26 | /books/a4927306-93e7... | ||
| 34 | /blog/freida-mcfadde... | ||
| 36 | /titles/breaks?srslt... |