# =================================================== # robots.txt for www.persianmizban.com # Structure: Custom Assets + WordPress Blog # Final Verified Version - Jan 2026 # =================================================== User-agent: * # 1. Allow Assets (CSS, JS, Fonts, Images) Allow: /assets/ Allow: /blog/wp-content/uploads/ # 2. Block System & Backup Files (Root) Disallow: /includes/ Disallow: /vendor/ Disallow: /tmp/ Disallow: /old/ Disallow: /backup/ Disallow: /draft/ Disallow: /error_log.txt Disallow: /README.txt Disallow: /LICENSE.txt # 3. Block WordPress System Paths (Inside /blog/) Disallow: /blog/wp-admin/ Disallow: /blog/wp-includes/ Disallow: /blog/xmlrpc.php # 4. Block Feeds & Trackbacks (The main cause of "Crawled - not indexed") Disallow: /blog/*/feed/ Disallow: /blog/*/feed$ Disallow: /blog/comments/feed/ Disallow: /blog/trackback/ # 5. Block Junk Parameters & Files Disallow: /*?replytocom= Disallow: /*?sort_by= Disallow: /*?currency= Disallow: /*.kml$ Disallow: /*.kml # 6. Block Legacy WHMCS Pages (Redirected to my. subdomain) Disallow: /cart.php Disallow: /login.php Disallow: /clientarea.php Disallow: /submitticket.php Disallow: /aff.php # Sitemap Sitemap: https://www.persianmizban.com/sitemap.xml