# ============================================================ # robots.txt — www.welovesmallhotels.com # We Love Small Hotels # Deploy at: https://www.welovesmallhotels.com/robots.txt | Last updated: 2026-06-26 # ============================================================ User-agent: * Disallow: /ajax/ Disallow: /search/ Disallow: /pesquisa/ Disallow: /manutencao/ # SEO / marketing tool crawlers (crawl-rate control) User-agent: AhrefsBot User-agent: MJ12bot User-agent: Seekport Crawler User-agent: SemrushBot Crawl-delay: 5 Disallow: /ajax/ Disallow: /search/ Disallow: /pesquisa/ Disallow: /manutencao/ User-agent: msnbot User-agent: bingbot Crawl-delay: 1 Disallow: /ajax/ Disallow: /search/ Disallow: /pesquisa/ Disallow: /manutencao/ # Sitemap Sitemap: https://www.welovesmallhotels.com/sitemap.xml