# Technical Thought - Optimized Robots.txt # Last Updated: [15-07-2025] User-agent: * Allow: /wp-content/uploads/ Allow: /wp-content/themes/technical-thought-child/*.(css|js)$ Allow: /wp-includes/js/jquery/jquery.min.js Allow: /wp-admin/admin-ajax.php Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /license.txt Disallow: /wp-config.php Disallow: /?s= Disallow: /search/ Disallow: */trackback/ Disallow: */feed/ Disallow: /author/ Disallow: */embed/ Disallow: */?replytocom Disallow: /wp-json/ Disallow: /wp-content/upgrade/ Disallow: /Demo/ # WooCommerce Protection Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /wishlist/ Disallow: /*?add-to-cart=* Disallow: /*?coupon_code=* Disallow: /wc-api/* Disallow: /wp-json/wc/* # Performance Optimization Crawl-delay: 5 # Bot-Specific Rules User-agent: AhrefsBot Crawl-delay: 15 Disallow: /wp-content/ User-agent: SemrushBot Crawl-delay: 20 User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Yandex Disallow: / # Sitemaps Sitemap: https://technicalthought.com/sitemap_index.xml Sitemap: https://technicalthought.com/post-sitemap.xml Sitemap: https://technicalthought.com/product-sitemap.xml Sitemap: https://technicalthought.com/page-sitemap.xml