# Robots.txt file from https://clumi.ai # # All robots will spider the domain User-agent: DataForSeoBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: * #Disallow: Allow: / Sitemap: https://clumi.ai/sitemap.xml