User-agent: * Allow: / # Explicitly allow public-facing sections Allow: /tools/ Allow: /blog/ Allow: /docs/ Allow: /api # Block placeholder and internal pages Disallow: /account Disallow: /account/ Disallow: /__diagnostics Disallow: /__diagnostics/ # Block server-side API endpoints (JSON responses, not pages) Disallow: /api/contact Disallow: /api/tools/ # Block protected monitoring endpoint Disallow: /health # Block SvelteKit internal build assets Disallow: /_app/ # AdSense crawler — must crawl all pages for ad relevance matching User-agent: Mediapartners-Google Allow: / # Google Image Bot User-agent: Googlebot-Image Allow: /images/ # Bingbot courtesy delay User-agent: Bingbot Allow: / Crawl-delay: 2 Sitemap: https://epcybertools.com/sitemap.xml