Cerebras releases Step-3.5-Flash-REAP models with 40% memory reduction

What this is

Cerebras has released Step-3.5-Flash-REAP models, which are memory-efficient compressed variants of their larger models. These are smaller versions designed for what the source calls "potato setups," though the 121B parameter model still requires significant resources.

Key details from the source

The models are available on Hugging Face:

• Step-3.5-Flash-REAP-121B-A11B
• Step-3.5-Flash-REAP-149B-A11B

The Step-3.5-Flash-REAP-121B-A11B model is compressed from 196B to 121B parameters, representing a 40% memory reduction while maintaining near-identical performance to the full model.

The compression uses REAP (Router-weighted Expert Activation Pruning), described as "a novel expert pruning method that selectively removes redundant experts while preserving the router's independent control over remaining experts."

Features and capabilities

• Near-lossless performance: Maintains almost identical accuracy on code generation, agentic coding, and function calling tasks compared to the full 196B model
• 40% memory reduction: Compressed from 196B to 121B parameters, lowering deployment costs and memory requirements
• Preserved capabilities: Retains all core functionalities including code generation, math & reasoning, and tool calling
• Drop-in compatibility: Works with vanilla vLLM - no source modifications or custom patches required
• Optimized for real-world use: Particularly effective for resource-constrained environments, local deployments, and academic research

The source notes that while these are "smaller versions," the 121B model still requires a fairly powerful setup despite the compression.