# Robots.txt file for https://www.dexterindex.com/ # Version 1.0 07/29/2024 Sitemap:https://www.dexterindex.com/sitemap SiteMap:https://dexterindex.com/sitemap.xml User-agent: SemrushBot Disallow: / User-agent: YandexBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: UptimeRobot Disallow: / User-agent: webmeup-crawler Disallow: / User-Agent: * Disallow:/search Disallow:/user/