Senior Government AI Lead Lacks Local LLM Awareness: A Developer's Account

A developer from the local LLM community recently spent an hour with a senior government AI leader from a smaller European country. The leader, despite a strong tech background, showed little awareness of practical local LLM use cases for businesses.

Key Disconnects

• Data sovereignty: The developer raised data sovereignty concerns, but the leader countered with 'Copilot data protection agreements', seemingly unaware of the differences.
• Legal firms building local stacks: The developer cited legal firms that read big AI agreements and chose local LLMs for data security — this was news to the leader.
• API cost risk: Businesses relying on OpenAI/Anthropic APIs face vulnerability if those companies raise prices. The leader had not considered this.
• Model inconsistency: The same prompt via API can return different answers — a business concern for reproducibility.
• Ethical/green backlash: Some organizations avoid big AI due to values misalignment or environmental concerns; local LLMs offer an alternative.

The leader's focus was entirely on pushing businesses toward US cloud AI providers (Copilot was mentioned repeatedly). The developer suggests the local LLM community needs to actively educate senior leaders about local LLMs as viable business solutions.