BaseLayer: Open-Source Behavioral Compression Pipeline for AI Memory Systems
BaseLayer is an open-source behavioral compression pipeline that extracts structured identity data from text sources for use in AI memory systems. The tool creates an identity brief containing beliefs, behaviors, tensions, and contradictions that any model or memory system can use, with every claim tracing back to source facts.
Key Details
The pipeline currently uses Claude for processing. API costs are <$1 for small datasets and <$5 for large ones, covering the entire process from fact extraction to final brief assembly.
The system has been tested on multiple data scales and types:
- As little as 8 personal journal entries from a secondary subject
- GPT conversation exports (30K+ messages)
- Large document corpora including Warren Buffett's Annual Shareholder Letters (350k words)
- Howard Marks Investment Memos (600k words)
- Dense autobiographies from Franklin, Douglass, Roosevelt, and Wollstonecraft
The brief assembly process includes multiple output formats: haiku, sonnet, and opus versions of the compressed identity data.
All research, benchmarks, documentation, and examples are available on the project website and GitHub repository. The developer is actively seeking feedback on evolution, struggles, research, and future improvements.
📖 Read the full source: r/ClaudeAI
👀 See Also
OpenClaw Smart Router Open-Sourced for Automatic Model Selection
A developer has open-sourced a Smart Router for OpenClaw that automatically classifies queries by complexity and routes them to optimal models, saving 60-80% on API costs compared to always using premium models like Claude or GPT-4o.
Anamnese: A Personal Memory System for Claude via MCP
Anamnese is a free tool that stores personal context—facts, projects, goals, tasks—and connects to Claude via MCP, allowing the AI to access this information at the start of every conversation.
Delimit Governance Layer for Multi-Agent AI Development
Delimit is an open-source governance layer that coordinates multiple AI coding agents to prevent conflicts. It provides shared memory, collision detection, and audit tracking for agents like Claude Code, Codex, and Gemini.
LLM Cost Profiler: Open-source tool tracks API spending to make case for local models
LLM Cost Profiler is a Python tool that tracks every API call to OpenAI/Anthropic, showing exactly what you're spending and where. It exposes tasks that are overpriced relative to their complexity, providing concrete dollar amounts to justify moving to local models.