Hugging Face's physics-intern: Multi-Agent Framework Doubles Gemini on CritPt Benchmark

Hugging Face released physics-intern, an open-source multi-agent framework designed for theoretical physics research. It mimics the scientific research process by decomposing complex problems into focused tasks dispatched to specialized subagents—including computing, claim reviewing, and research strategy challenge agents.

Architecture and Workflow

The framework decomposes research-level problems into several subtasks, each handled by a dedicated subagent:

• Computing agent: Handles numerical calculations and simulations.
• Reviewing agent: Evaluates claims for correctness and consistency.
• Strategy challenge agent: Critiques the overall research direction and suggests alternatives.

This agentic harness is designed to be domain-agnostic but was specifically tuned for theoretical physics.

Benchmark Performance

On the CritPt benchmark (critical point analysis in physics), physics-intern doubled the performance of Gemini models and achieved a new state-of-the-art result, surpassing GPT-5.5 Pro—all at a significantly lower cost. Specific numbers were not detailed in the source, but the performance gain is described as “doubling” and “new SOTA.”

Availability

The framework is available as a Hugging Face Space. The blog post detailing the architecture and design decisions can be found at the link below. Community contributions and extensions are encouraged.

Who it's for: Researchers and developers building agentic workflows for scientific domains, especially theoretical physics.