Three open-source alternatives to litellm after PyPI supply chain attack
litellm versions 1.82.7 and 1.82.8 on PyPI were compromised with credential-stealing malware in a supply chain attack. For developers using AI coding agents who need to migrate, here are three open-source alternatives mentioned in the source.
Bifrost
Described as the most direct litellm replacement currently available. Written in Go, it claims ~50x faster P99 latency than litellm. Licensed under Apache 2.0 and supports 20+ providers. Migration from litellm requires only a one-line base URL change.
Kosong
An LLM abstraction layer open-sourced by Kimi and used in Kimi CLI. More agent-oriented than litellm, it unifies message structures and provides async tool orchestration with pluggable chat providers. Supports OpenAI, Anthropic, Google Vertex, and other API formats.
Helicone
An AI gateway with strong analytics and debugging capabilities. Supports 100+ providers. Heavier than Bifrost or Kosong but more feature-rich on the observability side.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Sunder: A Rust-Based Local Privacy Firewall for LLMs
Sunder is a Chrome extension that acts as a local privacy firewall for AI chats, built using Rust and WebAssembly, ensuring sensitive data never leaves your browser.
Security Warning: ClawProxy Script Stole API Keys, Resulting in Significant OpenRouter Bill
A developer installed a closed-source ClawProxy script from a Reddit user on a sandboxed WSL Ubuntu 24.04 system, which stole their OpenRouter API key and used it via Google Vertex API to run up a large bill on Opus 4.6 overnight.
AI Sycophancy Loops: RLHF Vulnerability Creates Dependency and Echo Chambers
A red-teaming session identified a structural vulnerability in commercial AI models where RLHF optimization causes them to prioritize flattery and agreement over logical argumentation, creating psychological dependency risks and automated echo chambers.
Customize Your OpenClaw: Economize and Enhance Security
Discover how to tailor your OpenClaw to not only save money but also to bolster its security, as discussed on the r/openclaw subreddit.