AMD Ryzen AI NPUs Gain Linux LLM Support via Lemonade 10.0 and FastFlowLM
What's New
AMD Ryzen AI NPUs can now run large language models on Linux through the open-source Lemonade server version 10.0, which includes Linux NPU support for LLMs and Whisper. This marks the first practical use of Ryzen AI NPUs on Linux beyond niche code.
Technical Details
The implementation builds on FastFlowLM 0.9.35, an NPU-first runtime built exclusively for Ryzen AI that can support context lengths up to 256k tokens with current-gen Ryzen AI NPUs. Lemonade 10.0 also adds native integration with Claude Code.
System requirements:
- Linux 7.0 kernel OR AMDXDNA driver back-ports to existing stable kernel versions
- FastFlowLM 0.9.35 runtime
- Lemonade 10.0 server
This support should work with all current AMD Ryzen AI 300/400 series SoCs. AMD has developed the AMDXDNA accelerator driver in the mainline Linux kernel over the past two years, but until now user-space software support has been extremely limited.
Context
Previously, AMD's own GAIA software on Linux used Vulkan with iGPUs rather than NPU support. The timing of this Linux support is notable with the Ryzen AI Embedded P100 series coming to market and the Ryzen AI PRO 400 series, which are likely to see more Linux use than consumer Windows deployments.
Lemonade provides documentation for running LLMs on Linux with FastFlowLM and Lemonade.
📖 Read the full source: HN AI Agents
👀 See Also
Research: AI 'Unbundling' Jobs into Narrower, Lower-Paid Tasks
A new paper argues AI isn't eliminating jobs outright but 'unbundling' them into narrower tasks, with weak-bundle occupations seeing reduced scope and pay while strong-bundle jobs may see performance improvements.
Claude Code v2.1.169: Safe Mode, /cd Command, and Dozens of Bug Fixes
v2.1.169 adds --safe-mode to disable all customizations for troubleshooting, a /cd command to switch directories mid-session without cache loss, and fixes ~30-50ms UI stall, clipboard hangs on Windows, and enterprise MCP policy enforcement gaps.
Maryland Residents Hit with $2B Grid Upgrade for Out-of-State AI Data Centers — State Files FERC Complaint
Maryland's Office of People's Counsel filed a FERC complaint against PJM Interconnection, which allocated $2 billion of a $22 billion grid upgrade to Maryland customers — costing residential users ~$345 each, primarily to benefit out-of-state AI data centers.
70% of devs say AI code has more vulns; 30% ship it anyway — Checkmarx survey
70% of developers believe AI-generated code has significantly more vulnerabilities, yet 30% knowingly ship vulnerable code into production. The Checkmarx survey of 2,350 respondents also finds 93% of orgs suffered security breaches from vulnerable apps.