Karpathy's Autoresearch Ported to Apple Neural Engine for Better Throughput per Watt
A new prototype project combines Andrej Karpathy's autoresearch with reverse-engineered Apple Neural Engine (ANE) performance, available at github.com/fiale-plus/autoresearch-ane. The primary appeal is achieving better throughput per watt compared to official APIs.
Project Details
The project was described as "gluing the concepts together" and is currently a prototype that needs longer testing runs. The author credits Claude for the implementation and acknowledges miolini for the original MacOS port idea.
Technical References
- Autoresearch: github.com/karpathy/autoresearch - Andrej Karpathy's original project
- ANE Project: github.com/maderix/ANE - Reverse-engineered Apple Neural Engine performance
- MacOS Port: github.com/miolini/autoresearch-macos - Original MacOS implementation
The project represents an experimental approach to hardware utilization optimization, with the expectation that performance will improve as the underlying ANE project matures. This is particularly relevant for developers working on Apple silicon hardware who want to maximize local inference efficiency.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Council: A Structured Dialogue Framework for Claude
Council — A Crucible is a structured dialogue framework that runs inside a single Claude context window, using persona framing to produce four distinct modes of engagement: rigorous interrogation, generative action, lived experience, and unformed intuition.
Memora v0.2.25 MCP Server: 5× Faster Writes on D1 Database
Memora v0.2.25, an MCP server for Claude persistent memory, achieves 5× faster writes on Cloudflare D1 with memory_create dropping from 10s+ to ~1.8s and memory_update from 10s+ to ~1.1s per call.
latexnav: Python Tool for LLM and Human Navigation of LaTeX Files
latexnav is a free open source Python tool that parses LaTeX files to extract structural elements like theorems, definitions, sections, labels, cross-references, and dependencies, providing summaries with authoritative line numbers to help LLMs and humans navigate large manuscripts efficiently.
PRECC Tool Cuts Claude Code API Costs with Pre-Tool-Call Compression
A developer built PRECC, an open source tool that intercepts Claude Code tool calls and compresses payloads using RTK (Redundancy-aware Token Kompression), reducing input tokens by 40-66% with no perceptible latency impact.