Can crawlers enter?
HTTPS, homepage reachability, robots.txt, named AI user agents and Content Signals.
H/M · AGENT SURFACE SCANNER
Does your site allow ChatGPT, Claude and Perplexity crawlers?
Separate search discovery, user-directed retrieval and model training rules, then inspect the public interfaces an agent can observe.
REMOTE MCP / FREE TASK
Give your AI a real free audit task
Enter a URL above, then paste the task into a remote-MCP client. No payment.
agents.hogarmas.net/mcp/agent-surface
Live HTTP evidence
Not a ranking score
Private networks blocked
01 / LIVE AUDIT
Evidence surface
Enter a public domain to begin.
01Accesscrawler policy
02Retrievalcontent signals
03ActionAPIs and agents
04Trustpolicy and integrity
One URL, four evidence layers
The scanner requests only the homepage and common public machine artifacts. Response bodies are analyzed in memory and are never returned or stored.
Observed state
—
—
Surface coverage
0%
- Observed
- 0
- Attention
- 0
- Not observed
- 0
AI BUYER JOURNEY / OBSERVED EVIDENCE
Can an AI move from discovery to payment?
Five stages map only public evidence observed in this scan. They do not record a real agent session, predict conversion or test checkout.
ROBOTS.TXT / 9 AGENTS
AI crawler policy by purpose
Observed robots.txt rules only. This does not prove WAF access, crawler identity, compliance, indexing or citation.
LOCAL POLICY COMPOSER
Generate a purpose-specific robots.txt policy
Choose the policy that matches your intent. Generation stays in this browser and does not modify your website.
Merge this with existing rules. robots.txt expresses preferences; WAF/CDN enforcement is separate.
02 / METHOD
Evidence before advice
Each result names the requested public artifact, what was observed and which specification or convention it relates to. Missing evidence is not converted into a fake probability.
Can systems retrieve context?
Sitemap, llms.txt, metadata, JSON-LD and optional Markdown negotiation.
Can an agent act?
OpenAPI, API Catalog, MCP discovery, A2A Agent Card and payment discovery.
Can claims be checked?
security.txt, policy links, cache validators and evidence digests in the paid package.
03 / SOURCES
Standards and declared conventions stay separate
OpenAI Crawlers
OAI-SearchBot, GPTBot and ChatGPT-User have different purposes.
Anthropic Crawlers
Claude-SearchBot, Claude-User and ClaudeBot serve different purposes.
Perplexity Crawlers
PerplexityBot and Perplexity-User are separate retrieval paths.
Google-Extended
A control token for Gemini model use, separate from Google Search ranking.
Cloudflare Content Signals
Search, AI input, training and content-use preferences.
Model Context Protocol
Registry metadata and capability discovery are reported without a trust score.
A2A Agent Discovery
The well-known Agent Card describes identity, endpoint, skills and security.
04 / LIMITS
What this audit does not prove
It does not prove that ChatGPT, Claude, Gemini or another system indexed the site.
It does not estimate citation, ranking or traffic probability.
A self-declared MCP or A2A identity is not cryptographic identity proof.
It records one moment in time; CDN, WAF and origin behavior can change.
05 / NEXT READING
Turn an audit into a working plan.
Use the free guides below to make an AI-readable site easier to inspect, govern and maintain. They explain the evidence without promising traffic or citation.
01
Audit AI permissions
READ GUIDE
02Separate visible discovery, retrieval and training controls before you publish a policy.
Find permission drift
READ GUIDE
03Compare intent with the public rules that agents can actually observe today.
Browse agent resources
READ GUIDE
04Move from one scanner to practical MCP, A2A and verifiable-signal guides.
Read the signal method
READ GUIDE
Understand how evidence stays separate from confidence, rankings and legal conclusions.