Can I Fetch This?
Check if a website allows bots/AI access — scan of robots.txt, AI rules, anti-bot, and pay-per-crawl signals. Not legal advice; only real findings shown. Known sites below are cached from a real scan; enter your own domain to check something new, or re-scan any row live.
⚠️ Every result reflects a single fetch, not sustained/bulk traffic. Many sites only trigger CAPTCHA or anti-bot defenses after repeated or high-volume requests — a site showing "Open" or no CAPTCHA here can still block or challenge you once you're actually making many requests. Categories can shift between scans for this reason; treat this as a snapshot, not a guarantee.
We check our cached index first (instant). If a domain isn't indexed yet, or its scan is more than 7 days old, we run a fresh live scan automatically.
Example site index
Real sites, scanned live and grouped by what we found. Type to filter, or click "Refresh" on any card to re-scan it right now.