Enter a site to read its robots.txt and see exactly which search engines and AI assistants can crawl it.