# Allow example to allow all crawlers User-agent: * Allow: / User-agent: dotbot Crawl-delay: 5 User-agent: SeekportBot Disallow: / User-agent: Owler Disallow: / User-agent: GenAI Disallow: / # Sitemap files Sitemap: https://ytsal.com/sitemap.xml