Снимак екрана главне странице од ed-thomas.dev, преузео на себе 02.08.2026
Domain Name: ED-THOMAS.DEV
Registrar: Name.com, Inc.
Domain Status: client transfer prohibited
Creation Date: 2025-08-04T21:17:40.901Z
Registry Expiry Date: 2026-08-04T21:17:40.901Z
Updated Date: 2026-04-06T19:15:20.022Z
Name Server: MEMPHIS.NS.CLOUDFLARE.COM
Name Server: RAPHAELA.NS.CLOUDFLARE.COM
REGISTRAR Contact: Name.com, Inc.
>>> Last update of RDAP database: 2026-08-02T21:36:06Z
# robots.txt - site-wide crawler rules
# Allow AI / indexing agents so the site can be found in AI chat tools like ChatGPT, Perplexity, etc.
# Note: robots.txt is advisory; some scrapers ignore it.
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: Anthropic-ai
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Claude-Web
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Mistral
Allow: /
# Allow standard search engine bots (explicit allow is optional)
User-agent: Googlebot
User-agent: Bingbot
User-agent: Slurp
User-agent: DuckDuckBot
User-agent: Yandex
User-agent: *
Disallow:
# Point search engines to the sitemap index
Sitemap: https://ed-thomas.dev/sitemap-index.xml
# Content Signals
# ai-train=no blocks base model training
# search=yes allows indexing
# ai-input=yes allows content to be shown in RAG/chat windows
Content-Signal: ai-train=no, search=yes, ai-input=yes