AIsbf 0.9.8 adds caching, routing improvements, and expanded AI service support
AIsbf (AI Should Be Free) 0.9.8 is an API proxy/router that provides an OpenAI-compatible interface to various AI endpoint services, aiming to make LLM usage more cost-effective. It's multiuser and can scale from small setups to large infrastructure.
Key features in version 0.9.8
- Cache support for Redis, SQLite, MySQL, and file-based storage
- Additional context condensation methods
- Native prompt caching and request caching support
- Faster and improved semantic prompt-based routing for automatic service selection
- Full OAuth2 support for Claude.ai subscribers
- Full OAuth2 support for Amazon Kiro-cli subscribers
- Full OAuth2 support for OpenAI Codex subscribers
- Full support for Kilo.ai subscribers using tokens or OAuth2
- Multiple bug fixes and minor feature additions
This type of tool is useful for developers who work with multiple AI services and want a unified interface while optimizing costs through intelligent routing and caching.
📖 Read the full source: r/LocalLLaMA
👀 See Also
OpenClaw A2A Plugin: Delegate Work to Remote Agents and Replay Continuation State
A new open-source plugin adds the `remote_agent` tool to OpenClaw, enabling cross-agent delegation with A2A protocol support and continuation state replay.
MCP Server Enables AI Agents to Make Real Purchases with Ephemeral Virtual Cards
A developer has built an MCP server that allows AI agents to complete real purchases using ephemeral virtual Visa cards issued just-in-time. The system requires user approval via MFA and issues cards locked to specific merchants with 15-minute TTLs.
Running OpenClaw in an Isolated Micro-VM with Void-Box
OpenClaw can be run as a service inside an isolated micro-VM using Void-Box, a capability-bound runtime that executes workflows in KVM micro-VMs, providing a clean execution boundary without container runtime involvement.
ZSE: Open-source LLM inference engine with 3.9-second cold starts
ZSE is an open-source LLM inference engine that reduces 32B model memory requirements from 64GB to 19.3GB VRAM and achieves 3.9-second cold starts for 7B models using a pre-quantized .zse format with memory-mapped weights.