Domain Name: JOBSTER.COM
Registrar: Key-Systems GmbH
Domain Status: client transfer prohibited
Creation Date: 1999-07-28T15:53:30Z
Registry Expiry Date: 2026-07-28T15:53:27Z
Updated Date: 2025-12-02T14:17:42Z
Name Server: NS0.TRANSIP.NET
Name Server: NS1.TRANSIP.NL
Name Server: NS2.TRANSIP.EU
REGISTRAR Contact: Key-Systems GmbH
>>> Last update of RDAP database: 2026-02-12T19:57:37Z
# WordPress Robots.txt - Best Practices Configuration # Place this file in your website root directory (same level as wp-config.php) # Allow all bots by default User-agent: * Allow: / # Disallow private/sensitive WordPress directories and files Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /wp-login.php Disallow: /wp-register.php # Disallow common WordPress files that shouldn't be indexed Disallow: /wp-*.php Disallow: /xmlrpc.php Disallow: /wp-json/ # Disallow search results and private pages Disallow: /*?*orderby= Disallow: /*?*s= Disallow: /*?*p=*&* Disallow: /search/ Disallow: /*?s= # Disallow admin pages and user pages Disallow: /author/ Disallow: /authors/ Disallow: /administrator/ Disallow: /?author=* # Disallow spam-prone pages Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/feed/ # Disallow temporary and backup files Disallow: /*.sql Disallow: /*.zip Disallow: /*.gz Disallow: /*.rar Disallow: /*.7z # Disallow common backup directories Disallow: /backup/ Disallow: /backups/ Disallow: /old/ Disallow: /temp/ Disallow: /tmp/ # Allow specific RSS feeds (optional - remove if you want to disallow all feeds) Allow: /feed/$ Allow: /*/feed/$ # Allow specific admin pages needed by search engines Allow: /wp-admin/admin-ajax.php # Disallow WooCommerce pages (if using WooCommerce) # Disallow: /shop/*?* # Disallow: /*?product_cat=* # Disallow: /*?product-page=* # Disallow specific query strings (duplicate content) Disallow: /*?utm_* Disallow: /*?fbclid=* # Crawl delay (in seconds) - optional # Crawl-delay: 1 # Sitemap location Sitemap: https://yoursite.com/sitemap.xml Sitemap: https://yoursite.com/sitemap_index.xml # Optional: More specific rules for particular bots # User-agent: AhrefsBot # Disallow: / # # User-agent: SemrushBot # Disallow: / # Optional: Block bad bots # User-agent: MJ12bot # Disallow: /
| 位置 | 短语 | 页 | 片段 |
|---|---|---|---|
| 2 | / | ||
| 2 | / | ||
| 21 | / | ||
| 38 | / | ||
| 47 | / | ||
| 75 | / |