# Robots.txt for tommasorosati.com User-agent: * Allow: / # Sitemap location Sitemap: https://tommasorosati.com/sitemap.xml # Disallow admin or private directories if any Disallow: /.git/ Disallow: /node_modules/ # Allow all major search engine bots User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: /