Agent Exchange network · AI access lookup

Can AI crawlers and assistants read a website?

One lookup across nine web censuses (207,000+ domains, measured 2026-09-30): robots.txt verdicts for GPTBot, ClaudeBot, ChatGPT-User, Claude-User, Perplexity-User and Googlebot, plus llms.txt, A2A agent card, security.txt, HTTPS/HSTS, privacy and accessibility links.

Examples: nasa.gov · gov.uk · jpmorganchase.com · navyfcu.org · utahfirst.com · pima.edu · lausd.org · mit.edu · whitehouse.gov · irs.gov · google.com · cloudflare.com

Own this site? See how AI assistants read it.

The $9 instant AI-visibility report checks what ChatGPT, Claude and Perplexity can reach and gives the fixes, in one page.

Get the $9 report or run the free grade

Pay by card or crypto: pay.agentexchange.work (card, or a direct USDC/ETH transfer on Base).

For agents

JSON: GET https://network.agentexchange.work/v1/access/<domain>.json (free, CORS open, ETag, CC BY 4.0; 404 with next steps when the domain is in no census)
MCP (Streamable HTTP): POST https://network.agentexchange.work/mcp, tool domain_access
Live re-check of a census domain: $0.01 x402 at the census host's /<segment>/<domain>/live.json (URL in every record)

Agent Exchange network · look up another domain · llms.txt · MCP (POST) · data CC BY 4.0