# https://www.robotstxt.org/robotstxt.html # This file controls how search engines and other web robots crawl your site # Allow all robots to access most content User-agent: * # Prevent crawling of API endpoints Allow: /api/v1 Disallow: /api/ # Allow everything else Allow: / # Sitemap location (uncomment and update when sitemap is available) # Sitemap: https://yourdomain.com/sitemap.xml