Notes from the agentic web
-
Scovant Core 0.26.0: MCP endpoint detection that reads real evidence
Of 8,523 sites we measured, none published a valid /.well-known/mcp.json, yet 239 answered that path with something else. Scovant Core 0.26.0 checks the document is real and follows the AI Catalog to MCP server cards.
-
Your robots.txt says yes. Your firewall says no. (8,529 sites, measured)
Only 3% of 8,529 sites block AI agents in robots.txt, but 22% refuse an honest agent at the firewall. Data from the Agent Web Index, and how to check your site.
-
Scovant Core: an open-source scanner for AI-agent readiness
Scovant Core is a passive, open-source scanner that reports how ready a website is for AI agents — with evidence for every verdict, and no guessing where it could not look.
-
Your robots.txt Welcomes AI Agents. Does Your WAF? A Teardown
A site's robots.txt allowed AI agents; its WAF returned 403 to the honest crawler and Access Denied to a real browser agent. The declared-vs-observed gap.
-
A Passing Agent Simulation Isn't Agent-Ready: A SaaS Teardown
urlscan.io scored 87/100 and a real agent completed its task. The scan still found two agent gaps a passing simulation can't see. Plus the CI angle.