# Carolina Trophy Roofs - Robots.txt User-agent: * # Do not list private or retired paths here: this file is public. Keep them out of search with # an X-Robots-Tag: noindex rule in public/_headers instead. Disallow: /*?*location=* # Allow all public pages Allow: / # /blog/* returns 410 (the 2,161 generated posts were removed 2026-08-26). /blog/ MUST stay # crawlable: Google only drops a URL once it can fetch it and see the 410. A Disallow here # (added 2026-08-27, removed 2026-09-30) froze them as "Indexed, though blocked by robots.txt". # Do not add a /blog/ Disallow back. sitemap-removed-2026-09.xml lists them for recrawl. Allow: /blog/ Allow: /locations/ Allow: /services/ Allow: /resources/ Allow: /about Allow: /contact # Sitemap locations Sitemap: https://www.carolinatrophyroofs.com/sitemap-index.xml Sitemap: https://www.carolinatrophyroofs.com/sitemap.xml Sitemap: https://www.carolinatrophyroofs.com/sitemap-locations.xml