Qwen3.5-122B-A10B-MINT-MLX runs smoothly on M5 Pro with 64GB RAM
Local LLM Performance on Apple Silicon
A Reddit user has shared their experience running the Qwen3.5-122B-A10B-MINT-MLX model locally on an M5 Pro with 64GB RAM. The setup demonstrates that large language models can run effectively on consumer hardware with proper configuration.
Configuration Details
The user achieved smooth performance using specific terminal commands for VRAM allocation:
sysctl iogpu.unified_memory_limit_percentage
sudo sysctl iogpu.wired_limit_mb=61440In LM Studio, they set the context window to 16384 tokens. With this configuration, the system maintained stable performance while running Safari with multiple tabs, Messages, and Activity Monitor simultaneously.
Performance Benchmarks
The Qwen3.5-122B-A10B-MINT-MLX model delivered:
- Time to First Token: 0.86 seconds
- Token Generation Speed: 39.58 tokens/second
The user noted the model "solved a bunch of riddles correctly and did a bit of vibe coding" with no complaints about the 3-bit MINT quantization. The only issue occurred when the context window filled up near 59GB VRAM usage, causing system lockup.
Comparison with Other Models
The user also tested "Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking Mxfp8," which they found to be more accurate than the 122B model but significantly slower:
- Token Generation Speed: 6.93 tokens/second
- Prompt processing remained fast despite slower generation
This demonstrates the trade-off between model size, quantization, and inference speed that developers face when choosing local LLM configurations.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Kimi K2.6 beats Claude, GPT-5.5 and Gemini in coding challenge with aggressive sliding strategy
In the AI Coding Contest's Day 12 Word Gem Puzzle, Moonshot AI's open-weights Kimi K2.6 scored 22 match points (7-1-0), outperforming GPT-5.5 (16), Claude Opus 4.7 (12), and Gemini Pro 3.1 (9). MiMo V2-Pro took second. Kimi won by sliding aggressively.
Reddit Post Critiques Virtual CEO Agent Workflows, Advocates for Skill-Based Approach
A Reddit post on r/openclaw criticizes creating AI agents with job titles like 'backend developer' or 'growth hacker' as unnecessary overhead, proposing instead to package abilities as reusable skills that can be called when needed.
Cerebras releases Step-3.5-Flash-REAP models with 40% memory reduction
Cerebras has released Step-3.5-Flash-REAP models that use REAP (Router-weighted Expert Activation Pruning) to compress 196B parameter models to 121B while maintaining near-identical performance. The models work with vanilla vLLM and are optimized for resource-constrained environments.
AI Learns the 'Dark Art' of RFIC Design — Faster Chips, No Human Intuition Required
Princeton researchers use reinforcement learning and inverse design to create RFICs from scratch. Diffusion models generate novel layouts with record performance, cutting design time drastically.