Domain Name: MTBDATA.COM
Registrar: Dinahosting s.l.
Domain Status: client delete prohibited
Domain Status: client transfer prohibited
Creation Date: 2020-12-22T18:18:34Z
Registry Expiry Date: 2027-12-22T18:18:34Z
Updated Date: 2022-12-23T15:54:23Z
Name Server: DUKE.NS.CLOUDFLARE.COM
Name Server: SANDY.NS.CLOUDFLARE.COM
REGISTRAR Contact: Dinahosting s.l.
>>> Last update of RDAP database: 2026-06-08T05:04:47Z
# # robots.txt # User-agent: Orthogaffe Disallow: / # Crawlers that are kind enough to obey, but which we'd rather not have # unless they're feeding search engines. User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: gsa-crawler Disallow: / # Some bots are known to be trouble, particularly those designed to copy # entire sites. Please obey robots.txt. User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / # Sorry, wget in its recursive mode is a frequent problem. # Please read the man page and use it properly; there is a # --wait option you can use to set the delay between hits, # for instance. # User-agent: wget Disallow: / # # The 'grub' distributed client has been *very* poorly behaved. # User-agent: grub-client Disallow: / # # Doesn't follow robots.txt anyway, but... # User-agent: k2spider Disallow: / # # Hits many times per second, not acceptable # http://www.nameprotect.com/botinfo.html User-agent: NPBot Disallow: / # A capture bot, downloads gazillions of pages with no public benefit # http://www.webreaper.net/ User-agent: WebReaper Disallow: / User-agent: CNCDialer Disallow: / User-agent: Maxthon Disallow: / User-agent: MJ12bot Disallow: / User-agent: Slurp Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: Screaming Frog SEO Spider Disallow: /BACore/ Disallow: / Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.png$ Disallow: /*.bmp$ Disallow: /*.xml$ #Disallow: /*.css$ #Disallow: /*.js$ #User-Agent: aranhabot #Crawl-delay: 10 user-agent: SeznamBot disallow: / user-agent: VigLink disallow: / user-agent: DotBot disallow: / user-agent: MJ12bot disallow: / User-agent: SputnikBot Disallow: / User-agent: Sputnik Disallow: / User-agent: SputnikBot/2.3 Disallow: / User-agent: Curious George Disallow: / User-agent: Curious George - www.analyticsseo.com Disallow: / User-agent: Curious George - www.analyticsseo.com/crawler Disallow: / User-agent: http://site.ru Disallow: / User-agent: site.ru Disallow: / User-agent: AhrefsBot Disallow:/ User-agent: MauiBot Disallow:/ User-agent: SEOkicks Disallow:/ User-agent: BLEXBot Disallow: / User-agent: BUbiNG Disallow: / User-agent: ScoutJet Disallow: / User-agent: grapeshot Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: zoominfobot Disallow: / User-agent: Barkrowler Disallow: / User-agent: Datanyze Disallow: / User-agent: YisouSpider Disallow: / User-agent: adscanner Disallow: / User-agent: Genieo Disallow: / User-agent: Genieo/1.0 Disallow: / User-Agent: The Knowledge AI Disallow: / User-agent: Zgrab Disallow: / User-Agent: ZoominfoBot Disallow: / User-agent: sogou spider Disallow: / # Blekkobot User-agent: Blekkobot Disallow: / # Block BlexBot User-agent: BLEXBot Disallow: / User-agent: Seobility Disallow: / #Baiduspider User-agent: Baiduspider Disallow: / User-agent: Baiduspider/2.0 Disallow: / #Yandex User-agent: Yandex Disallow: / User-agent: YandexBot/3.0 Disallow: / User-agent: IstellaBot Disallow: / User-agent: IstellaBot/1.01.18 Disallow: / User-agent: IstellaBot/1.01.18 +http://www.tiscali.it/ Disallow: / User-agent: IstellaBot/1.10.2 +http://www.tiscali.it/ Disallow: / User-agent: Mozilla/5.0 (compatible; IstellaBot/1.01.18 +http://www.tiscali.it/) Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Sogou web spider/4.0 Disallow: / User-agent: GroupHigh Disallow: / User-agent: GroupHigh/1.0 Disallow: / User-agent: coccocbot-web Disallow: / User-agent: ccbot Disallow: / User-agent: Mail.Ru Disallow: / User-agent: grapeshotcrawler Disallow: / User-agent: ia_archiver Disallow: / User-agent: james bot Disallow: / User-agent: leikibot Disallow: / User-agent: libcurl Disallow: / User-agent: linkdexbot Disallow: / User-agent: lipperhey Disallow: / User-agent: livelap Disallow: / User-agent: lssrocket Disallow: / User-agent: magpie Disallow: / User-agent : Uptimebot Disallow: / User-agent: Gluten Free Crawler/1.0 Disallow: / User-agent : serpstatbot/1.0 Disallow: / User-agent: DomainCrawler Disallow: / User-agent: Steeler disallow: / User-agent: Steeler/3.5 disallow: / User-agent: Daum Disallow: / User-agent :arquivo-web-crawler Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: MojeekBot Disallow: / #"Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)" #"Mozilla/5.0 (iPhone; CPU iPhone OS 5_0_1 like Mac OS X) (compatible;Yeti-Mobile/0.1; +http://help.naver.com/robots/)" User-agent: Yeti Disallow: / User-agent: Yeti-Mobile Disallow: / User-agent :Mr.4x3 Powered Disallow: / User-agent: SJUUPBot Disallow: / User-agent: VigLink Disallow: / User-agent: Pi-Monster Disallow : / User-agent: tracemyfile/1.0 Disallow: / User-agent: Xenu's Link Sleuth 1.1c Disallow: / User-agent: oBot/2.3.1 Disallow: / User-agent: CowBot/1.0 Disallow: / User-agent: Deskyobot Disallow: / User-agent: Deskyobot/1.0 Disallow: / User-agent: ltx71+-+(http://ltx71.com/) Disallow: / User-agent: Pandalytics/1.0 User-agent: CCBot/2.0 User-agent: SurdotlyBot User-agent: Cincraw/1.0 User-agent: Twingly Recon-Klondike/1.0 User-agent: YaK/1.0 User-agent: DF Bot 1.0 User-agent: Crawlson/1.0 user-agent: IonCrawl User-agent: ltx71 User-agent: woorankreview/2.0 Disallow: / User-agent: arquivo-web-crawler Disallow: / User-agent: PetalBot Disallow: / User-agent: filibot/1.0 Disallow: / User-Agent: panscient.com Disallow: / User-agent: Mediatoolkitbot Disallow: / User-agent: oBot/2.3.1 Disallow: / User-agent : Barkrowler/0.9 Disallow: / User-agent: MauiBot ([email protected]) Disallow: /
| Pozice | Fráze | Strana | Úryvek |
|---|---|---|---|
| 3 | /riders/jack-reading |