domain: VESTI42.RU
nserver: ns1.beget.com.
nserver: ns1.beget.pro.
nserver: ns2.beget.com.
nserver: ns2.beget.pro.
state: REGISTERED, DELEGATED, VERIFIED
org: Filial Vserossiiskoi gosudarstvennoi teleradiokompanii Gosudarstvennaya teleradiokompaniya "Kuzbass"
taxpayer-id: 7714072839
registrar: BEGET-RU
admin-contact: whois.beget.com
created: 2011-04-20T05:58:14Z
paid-till: 2027-04-20T06:58:14Z
free-date: 2027-05-21
source: TCI
Last updated on 2026-06-08T11:28:02Z
User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: */trackback/ Disallow: */feed/ Disallow: *?s=* Disallow: *?sf_paged=* Disallow: */page/ User-agent: * Disallow: /category/news/page/ Crawl-delay: 5 # Основной бот Яндекса - быстрый доступ User-agent: YandexBot Disallow: /news/?date=* Disallow: /*/archive/* Disallow: /archive/* Disallow: /*?year=* Disallow: /*?month=* Crawl-delay: 3 # Новостной бот Яндекса - приоритетный доступ к новостям User-agent: YandexNews Allow: / Allow: /news/ Allow: /category/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /archive/* Crawl-delay: 1 # Ограничения для остальных ботов Яндекса User-agent: YandexTurbo User-agent: YaDirectFetcher User-agent: YandexRenderResourcesBot User-agent: YandexMetrika User-agent: YandexWebmaster Disallow: /news/?date=* Disallow: /*/archive/* Disallow: /archive/* Disallow: /*?m=* Disallow: /*?year=* Disallow: /*?month=* Disallow: /category/*/page/* Crawl-delay: 15 # Ограничения для архивов Google User-agent: Googlebot Disallow: /news/?date=* Crawl-delay: 2 # Правила для Miralinks Robot - партнерский бот User-agent: Miralinks Robot Allow: / Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: */trackback/ Disallow: */feed/ Disallow: *?s=* Disallow: *?sf_paged=* Disallow: */page/ Disallow: /news/?date=* Disallow: /archive/* Crawl-delay: 15 # Правила для DotBot (Moz) User-agent: DotBot Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/cache/ Disallow: /wp-content/themes/ Disallow: */trackback/ Disallow: */feed/ Disallow: *?s=* Disallow: *?sf_paged=* Disallow: */page/ Crawl-delay: 10 # Блокировка вредоносных ботов User-agent: BLEXBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: MBCrawler Disallow: / User-agent: YaK/1.0 Disallow: / User-agent: niraiya.com/2.0 Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Cloudfind Disallow: / User-agent: GetIntent Disallow: / User-agent: SeopultContentAnalyzer/1.0 Disallow: / User-agent: serpstatbot/2.0 Disallow: / User-agent: LinkpadBot Disallow: / User-agent: Slurp Disallow: / User-agent: DataForSeoBot/1.0 Disallow: / User-agent: Rome Client Disallow: / User-agent: Scrapy Disallow: / User-agent: FlipboardRSS Disallow: / User-agent: FlipboardProxy Disallow: / User-agent: Proximic Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: SeznamBot/3.2 Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: Bytespider Disallow: / User-agent: GPTBot Disallow: / User-agent: Conficker Disallow: / User-agent: Mirai Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: Serendeputy Disallow: / # Дополнительные боты из Nginx конфигурации User-agent: 360Spider Disallow: / User-agent: 80legs Disallow: / User-agent: Abonti Disallow: / User-agent: Aboundex Disallow: / User-agent: Acunetix Disallow: / User-agent: ADmantX Disallow: / User-agent: AIBOT Disallow: / User-agent: AiHitBot Disallow: / User-agent: Aipbot Disallow: / User-agent: Alexibot Disallow: / User-agent: Alligator Disallow: / User-agent: AllSubmitter Disallow: / User-agent: AlphaBot Disallow: / User-agent: Anarchie Disallow: / User-agent: Apexoo Disallow: / User-agent: ASPSeek Disallow: / User-agent: Asterias Disallow: / User-agent: Attach Disallow: / User-agent: autoemailspider Disallow: / User-agent: BackDoorBot Disallow: / User-agent: Backlink Disallow: / User-agent: BackStreet Disallow: / User-agent: BackWeb Disallow: / User-agent: Badass Disallow: / User-agent: Bandit Disallow: / User-agent: Baiduspider Disallow: / User-agent: BatchFTP Disallow: / User-agent: Battleztar Disallow: / User-agent: BBBike Disallow: / User-agent: BDFetch Disallow: / User-agent: BetaBot Disallow: / User-agent: Bigfoot Disallow: / User-agent: Bitacle Disallow: / User-agent: BlackWidow Disallow: / User-agent: Blow Disallow: / User-agent: BlowFish Disallow: / User-agent: Boardreader Disallow: / User-agent: Bolt Disallow: / User-agent: BotALot Disallow: / User-agent: Brandprotect Disallow: / User-agent: Brandwatch Disallow: / User-agent: Buddy Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: BuiltWith Disallow: / User-agent: Bullseye Disallow: / User-agent: BunnySlippers Disallow: / User-agent: BuzzSumo Disallow: / User-agent: Calculon Disallow: / User-agent: CATExplorador Disallow: / User-agent: CazoodleBot Disallow: / User-agent: CCBot Disallow: / User-agent: Cegbfeieh Disallow: / User-agent: CheeseBot Disallow: / User-agent: CherryPicker Disallow: / User-agent: ChinaClaw Disallow: / User-agent: Chlooe Disallow: / User-agent: Claritybot Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Cloud mapping Disallow: / User-agent: coccocbot Disallow: / User-agent: Cogentbot Disallow: / User-agent: cognitiveseo Disallow: / User-agent: Collector Disallow: / User-agent: com.plumanalytics Disallow: / User-agent: Copier Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: Copyscape Disallow: / User-agent: Cosmos Disallow: / User-agent: Craftbot Disallow: / User-agent: crawl Disallow: / User-agent: Crawling Disallow: / User-agent: Crazy Disallow: / User-agent: CSHttp Disallow: / User-agent: Curious Disallow: / User-agent: Custo Disallow: / User-agent: DatabaseDriverMysqli Disallow: / User-agent: DataCha0s Disallow: / User-agent: DBLBot Disallow: / User-agent: Demo Disallow: / User-agent: Demon Disallow: / User-agent: Deusu Disallow: / User-agent: Devil Disallow: / User-agent: Digincore Disallow: / User-agent: DigitalPebble Disallow: / User-agent: DIIbot Disallow: / User-agent: Dirbuster Disallow: / User-agent: Disco Disallow: / User-agent: Discobot Disallow: / User-agent: Discoverybot Disallow: / User-agent: DittoSpyder Disallow: / User-agent: DomainAppender Disallow: / User-agent: DomainCrawler Disallow: / User-agent: DomainSigmaCrawler Disallow: / User-agent: DomainStatsBot Disallow: / User-agent: Download Disallow: / User-agent: DTS.Agent Disallow: / User-agent: EasyDL Disallow: / User-agent: Ebingbong Disallow: / User-agent: eCatch Disallow: / User-agent: ECCP/1.0 Disallow: / User-agent: Ecxi Disallow: / User-agent: EirGrabber Disallow: / User-agent: EMail Disallow: / User-agent: EMail Siphon Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Exabot Disallow: / User-agent: Express Disallow: / User-agent: ExtLinksBot Disallow: / User-agent: Extractor Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Extreme Disallow: / User-agent: EyeNetIE Disallow: / User-agent: Ezooms Disallow: / User-agent: FDM Disallow: / User-agent: FemtosearchBot Disallow: / User-agent: FHscan Disallow: / User-agent: Fimap Disallow: / User-agent: Firefox/7.0 Disallow: / User-agent: FlashGet Disallow: / User-agent: Flunky Disallow: / User-agent: Foobot Disallow: / User-agent: Freeuploader Disallow: / User-agent: FrontPage Disallow: / User-agent: Fuzz Disallow: / User-agent: FyberSpider Disallow: / User-agent: Fyrebot Disallow: / User-agent: GalaxyBot Disallow: / User-agent: Genieo Disallow: / User-agent: GermCrawler Disallow: / User-agent: GetRight Disallow: / User-agent: GetWeb Disallow: / User-agent: Gigablast Disallow: / User-agent: Gigabot Disallow: / User-agent: Go!Zilla Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: Gotit Disallow: / User-agent: GoZilla Disallow: / User-agent: Grabber Disallow: / User-agent: GrabNet Disallow: / User-agent: Grafula Disallow: / User-agent: GrapeFX Disallow: / User-agent: GrapeshotCrawler Disallow: / User-agent: GridBot Disallow: / User-agent: GT::WWW Disallow: / User-agent: Haansoft Disallow: / User-agent: HaosouSpider Disallow: / User-agent: Harvest Disallow: / User-agent: Havij Disallow: / User-agent: HEADMasterSEO Disallow: / User-agent: Heritrix Disallow: / User-agent: Hloader Disallow: / User-agent: HMView Disallow: / User-agent: HTMLparser Disallow: / User-agent: HTTP::Lite Disallow: / User-agent: HTTrack Disallow: / User-agent: Humanlinks Disallow: / User-agent: HybridBot Disallow: / User-agent: Iblog Disallow: / User-agent: IDBot Disallow: / User-agent: Id-search Disallow: / User-agent: IlseBot Disallow: / User-agent: Image Fetch Disallow: / User-agent: Image Sucker Disallow: / User-agent: IndeedBot Disallow: / User-agent: Indy Library Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: InfoTekies Disallow: / User-agent: instabid Disallow: / User-agent: Intelliseek Disallow: / User-agent: InterGET Disallow: / User-agent: Internet Ninja Disallow: / User-agent: InternetSeer Disallow: / User-agent: internetVista Disallow: / User-agent: Iria Disallow: / User-agent: IRLbot Disallow: / User-agent: Iskanie Disallow: / User-agent: IstellaBot Disallow: / User-agent: JamesBOT Disallow: / User-agent: Jbrofuzz Disallow: / User-agent: JennyBot Disallow: / User-agent: JetCar Disallow: / User-agent: JikeSpider Disallow: / User-agent: JOC Disallow: / User-agent: Joomla Disallow: / User-agent: Jorgee Disallow: / User-agent: JustView Disallow: / User-agent: Jyxobot Disallow: / User-agent: Kenjin Disallow: / User-agent: Keybot Disallow: / User-agent: Keyword Disallow: / User-agent: Kinza Disallow: / User-agent: Kozmosbot Disallow: / User-agent: Lanshanbot Disallow: / User-agent: Larbin Disallow: / User-agent: LeechFTP Disallow: / User-agent: LeechGet Disallow: / User-agent: LexiBot Disallow: / User-agent: Lftp Disallow: / User-agent: LibWeb Disallow: / User-agent: Libwhisker Disallow: / User-agent: Lightspeedsystems Disallow: / User-agent: Likse Disallow: / User-agent: Linkbot Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkScan Disallow: / User-agent: LinksManager Disallow: / User-agent: LinkWalker Disallow: / User-agent: LinqiaMetadataDownloaderBot Disallow: / User-agent: LinqiaRSSBot Disallow: / User-agent: LinqiaScrapeBot Disallow: / User-agent: Lipperhey Disallow: / User-agent: Litemage_walker Disallow: / User-agent: Lmspider Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: Ltx71 Disallow: / User-agent: lwp-request Disallow: / User-agent: LWP::Simple Disallow: / User-agent: lwp-trivial Disallow: / User-agent: Magnet Disallow: / User-agent: Mag-Net Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: Majestic Disallow: / User-agent: Majestic-SEO Disallow: / User-agent: Majestic12 Disallow: / User-agent: MarkMonitor Disallow: / User-agent: MarkWatch Disallow: / User-agent: Masscan Disallow: / User-agent: Mass Downloader Disallow: / User-agent: Mata Hari Disallow: / User-agent: MauiBot Disallow: / # Sitemap Sitemap: https://vesti42.ru/sitemap_index.xml
| Position | Udtryk | Side | Uddrag |
|---|---|---|---|
| 1 | /reklama/31318/ | ||
| 1 | /reklama/52203-kak-p... | ||
| 1 | / | ||
| 1 | /reklama/ustrojstvo-... | ||
| 1 | /novosti-so-vsego-sv... | ||
| 1 | /category/komanda/ | ||
| 2 | /novosti-so-vsego-sv... | ||
| 3 | / | ||
| 3 | /reklama/52203-kak-p... | ||
| 3 | /reklama/81359-elekt... |
| Position | Udtryk | Side | Uddrag |
|---|---|---|---|
| 1 | /novosti-so-vsego-sv... | ||
| 1 | / | ||
| 6 | /novosti-so-vsego-sv... | ||
| 7(-2) | /reklama/chem-otlich... | ||
| 7 | /reklama/81359-elekt... | ||
| 8 | /reklama/81359-elekt... | ||
| 9 | /novosti-so-vsego-sv... | ||
| 9 | /vse-novosti/vesti20... | ||
| 9 | /news/kuzbass-prisoe... | ||
| 10 | / |