Selfware: Rust-based local AI agent framework with PDVR architecture
Selfware is an open-source AI agent framework specifically optimized for local inference, built to handle complex, multi-step engineering tasks autonomously without relying on centralized APIs.
Core Architecture
The framework implements a strict PDVR (Plan, Do, Verify, Report) cognitive cycle and is built completely in Rust for memory safety and bare-metal performance. The project has transitioned into a formal charity to focus on privacy and open-source preservation rather than commercial API extraction.
Key Features
- Supports 54 local tools out of the box
- Designed around a "4-hour patience" configuration to allow slower, highly complex inference to run reliably overnight on consumer hardware without timing out
- Built for local inference to combat the convenience of centralized APIs
Current Status and Community
The creator is seeking codebase reviews, particularly regarding context management and multi-model routing on limited VRAM. The project is organizing IRL meetups including a hands-on technical workshop in NYC and a privacy/policy discussion in DC.
For developers working with local AI models, this framework addresses the challenge of running complex agent workflows without cloud dependencies. The PDVR architecture provides a structured approach to multi-step tasks, while the Rust implementation offers performance benefits for resource-constrained environments.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Local RAG Tool Built with Nemotron Nano 9B v2 and vLLM Tool Calling
A developer built a local-first RAG research tool that runs entirely on a single GPU using Nemotron Nano 9B v2 Japanese on vLLM with custom parser plugins for tool calling. The system features a two-step extract-execute flow with bilingual keyword extraction and parallel FTS5/DuckDuckGo search.
Building a Programming Language with Claude Code: The Cutlet Experiment
Ankur Sethi built a complete programming language called Cutlet using Claude Code over four weeks, with the AI generating every line of code while he focused on guardrails and testing. The language features dynamic typing, vectorized operations, and a REPL, running on macOS and Linux.
JANG Quantization Method Improves MLX Performance for Large Models
A new quantization method called JANG enables running large models like MiniMax-M2.5 and Qwen 3.5 on Apple's MLX framework with significantly better performance than standard MLX quantization, achieving near-native speeds while maintaining accuracy comparable to higher-bit quantizations.
Fine-Tuning Qwen 14B for Discord Autocomplete
A developer fine-tuned the Qwen 14B model using his Discord message dataset to create an autocomplete tool.