Open-source structural hallucination checker for AI agent pipelines

What it does
A structural hallucination checker specifically designed for AI agent pipelines. Unlike truth checking, this tool focuses on catching structural failures that break downstream tools.
Problem it solves
Most agent issues aren't factual errors but structural problems like:
- The model inventing a field in a JSON tool response
- Citing a source that wasn't in the retrieved set
- Prompt injection hidden inside retrieved content
- Claiming a tool returned something it didn't
Four suppressors
The tool includes four suppressors built in Claude Code that run as a single step before agent output reaches users:
grounding_enforcer- checks whether model output is actually supported by the sources you passed inprompt_suppressor- catches injection attempts in retrieved content and tool resultsjson_suppressor- validates structured tool responses against expected schemastool_response_suppressor- flags when a tool's claimed output doesn't match what it returned
Availability
The tool is available in two formats:
- A REST API
- An MCP server (works with Claude Desktop, Cursor, Windsurf, etc.)
Free tier offers 500 requests/month with no credit card required.
Source and documentation
GitHub repository: https://github.com/steveswain14/mcp-hallucination-suite
API and documentation: https://certifai.dev
📖 Read the full source: r/ClaudeAI
👀 See Also

InsForge: Open-Source Backend Platform for AI Coding Agents
InsForge is an open-source backend platform (Apache 2.0) that provides AI coding agents with managed database, auth, storage, compute, hosting, and AI gateway, controllable via CLI or MCP.

CodeLedger: Open-source Claude Code plugin tracks token usage and background agents
CodeLedger is an open-source MCP server plugin for Claude Code that automatically tracks token usage across projects, identifies background agents, and provides cost optimization recommendations based on analysis of local JSONL session files.

Real-World Insights on Using OpenClaw with LLMs: Challenges and Limitations
An OpenClaw user describes integration issues with LLMs, citing nonsensical responses from a Discord bot.

Layered Defense Framework for Claude Code Rule Enforcement
An IT operations professional built an 8-layer defense framework to enforce Claude Code rules after discovering that both CLAUDE.md prompts and blocking hooks could be bypassed. The approach adapts the Swiss cheese model from accident investigation to prevent workarounds.