Running OpenClaw with Local LLM on a Contabo VPS: Qwen 3:4B Hangs, Workarounds

A user on r/openclaw is testing OpenClaw with a local LLM on a Contabo VPS to cut token costs. Their setup: 6 CPU cores, 12 GB RAM, 200 GB SSD, no GPU, Ubuntu. They installed Ollama and used Codex to get the heartbeat running with a tiny model, but Qwen 3:4B keeps hanging after a compaction error. Here's what they found.

Hardware constraints

The VPS has no GPU, so model size is limited. The user's Contabo box: 6 vCPUs, 12 GB RAM, 200 GB NVMe. That's enough for small Ollama models, but Qwen 3:4B (4B parameters) is pushing it—especially during inference where memory spikes.

Qwen 3:4B issues

• First error: compaction error—likely from memory pressure or filesystem issues.
• After resolving that, the model just hangs—no output, no crash.
• Codex (the AI coding agent) said Qwen should work on the server, but it's unstable in practice.

The user gave up and went back to Grok as the default LLM because they have a good deal on it—but they want a reliable local option.

What works

The tiny Ollama model (likely tinyllama or phi3:mini) runs fine and handles the heartbeat without external API calls. The user suggests using a local model for basic reasoning and reserving cloud LLMs like Grok or Claude for complex tasks.

Practical tips

• Start with a smaller model: llama3.2:1b or phi3:mini (3.8B) may run better than Qwen 3:4B on 12GB RAM.
• Monitor memory with htop or free -m—if swap is used, performance tanks.
• Set OLLAMA_NUM_PARALLEL=1 to reduce memory usage.
• Consider adding a swap file if you haven't: fallocate -l 4G /swapfile && chmod 600 /swapfile && mkswap /swapfile && swapon /swapfile.

The thread is a reminder that local LLMs on low-end VPSs are possible but require careful model selection. If you're a non-programmer (like the original poster, a mortgage guy), the learning curve is steep, but the community is willing to help.