AI Agents Prefer Structured Queries Over Natural Language in Cala MCP Server Test
The team at Cala recently shipped an MCP server that provides three distinct ways for AI agents to access their knowledge graph: natural language queries, a structured query language, and direct entity/relationship traversal.
Unexpected Agent Behavior
Despite expectations that agents would default to natural language interfaces (the typical strength of LLMs), most agents abandoned natural language queries within minutes. Without any prompting or nudging, they autonomously switched to using structured queries and graph traversal methods.
Why This Makes Sense
The source explains this behavior by noting that LLMs aren't explicitly trained to be "efficient" but rather to be correct through RLHF. This correctness leads to efficient behavior as a side effect - agents learn to take the shortest reliable path to solutions. Natural language interfaces add an interpretation layer that introduces uncertainty, while structured queries provide deterministic results.
When presented with three access methods, agents consistently chose the option that minimized uncertainty rather than the most "natural" interface.
Key Questions Raised
- Are we over-indexing on natural language interfaces for agent tooling?
- Should MCP servers prioritize structured/graph-based access patterns over natural language by default?
- If agents prefer deterministic paths, how should this influence tool design?
The Reddit discussion seeks input from others building agent tooling to see if they've observed similar patterns.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Claude Code Postmortem: Three Bugs Caused Quality Degradation, Now Fixed
Anthropic traced recent Claude Code quality complaints to three separate changes: default reasoning effort was lowered, a caching bug dropped session memory, and a verbosity prompt hurt coding quality. All fixed as of April 20 (v2.1.116).
Coasty AI Agent Solves CAPTCHA Challenges Up to Level 6 Without Training
Coasty's Computer Using Agent (CUA) achieved 82% on the OSWorld benchmark, solving CAPTCHAs up to Level 6, browser popups, and cookie banners without specific training for 'I'm not a robot' challenges.
OpenAI's Pentagon Contract Terms Allow 'Any Lawful Use' Including Potential Surveillance
OpenAI negotiated new terms with the Pentagon that include the phrase 'any lawful use,' which sources say allows the military to use OpenAI's technology for mass surveillance programs if they're technically legal. Anthropic was blacklisted for refusing to budge on two red lines: no mass surveillance of Americans and no lethal autonomous weapons.
AI tools need practical integration for small businesses, not just hype
The AI community focuses on technical debates while small business owners need existing tools integrated into their workflows to handle repetitive tasks like scheduling, follow-ups, and bookkeeping.