AgentProbe
x.com
44/ 100
1.6s·2/12 passed·4/18/2026

Access

Whether AI bots can actually reach your content

67

AI Bot Access

Partial

1/3 AI bots appear blocked: GPTBot.

JS Independence

Partial

Limited content without JavaScript (0 chars, 1 heading(s)).

Performance

Pass

Fast response (452ms), no redirects.

Agent-Native

Support for agent-specific protocols and formats

50

Markdown Support

Fail

No markdown content negotiation support detected.

MCP Protocol

Partial

MCP JSON file found but contains invalid JSON.

Structured API

Pass

OpenAPI/Swagger spec found at /openapi.json.

Discovery

How easily AI agents can find and understand your site

38

llms.txt

Partial

llms.txt found but missing proper title or resource links.

robots.txt AI Bot Rules

Partial

robots.txt blocks 6/8 AI bots: GPTBot, ClaudeBot, PerplexityBot, ChatGPT-User, Amazonbot, cohere-ai.

XML Sitemap

Partial

sitemap.xml exists but does not appear to be valid XML sitemap format.

AI Manifest

Fail

No AI manifest files found (.well-known/ai-plugin.json or .well-known/mcp.json).

Metadata

Structured data and metadata quality

0

Schema.org

Fail

No JSON-LD structured data found.

HTML Metadata

Fail

Poor metadata. Missing: title, description, canonical, og tags.

Recommendations

6 suggestions
1

Add a /.well-known/ai-plugin.json or mcp.json to declare AI capabilities.

2

Support content negotiation for text/markdown to serve agent-friendly content.

3

Add JSON-LD structured data (Schema.org) to help AI understand your content.

4

Improve HTML metadata: add lang, description, canonical, and proper heading structure.

5

Consider unblocking these AI bots in robots.txt: GPTBot, ClaudeBot, PerplexityBot, ChatGPT-User, Amazonbot, cohere-ai.

6

Increase the amount of server-rendered content for better AI agent accessibility.