# robots.txt for Who Owns Your Vet? # https://whoownsyourvet.co.uk User-agent: * Allow: / # Block the feedback/correction form and its many pre-filled query-string # variants. Google was crawling 1,700+ /submit?... URLs ("Alternate page with # proper canonical tag"), wasting crawl budget that should go to practice pages. Disallow: /submit Disallow: /submit/ # Block /search/ query-string variants (?location=, ?region=, ?ownership=, ?q=). # The page is a client-side search UI: every variant serves identical HTML with # a canonical of /search/, so crawling them only burns crawl budget — the same # crawl-sink class as the /submit variants above. /search/ itself stays crawlable. Disallow: /search/? # Crawl-delay suggestion for polite crawlers Crawl-delay: 1 # Sitemap location Sitemap: https://whoownsyourvet.co.uk/sitemap-index.xml