check_ai_crawler_access
Check if AI assistants can read a website
Checks one public web page the way AI crawlers do: reads its robots.txt, meta robots / X-Robots-Tag and /llms.txt, and reports, for each AI and search crawler (OpenAI, Anthropic, Perplexity, Google, Microsoft), whether it is allowed to read that page. Use when someone asks whether ChatGPT, Claude, Perplexity or Google AI can see, read or cite their site. Facts only, no score.
url必填