UK Sovereign LLM Inference: Relax.ai Launches Public Docs
Relax.ai has published documentation for its UK sovereign LLM inference service. The docs site at relax.ai/docs redirects to /docs/getting-started/introduction for a getting started guide. The service was discussed on Hacker News (thread: 48146424) with 104 points and 109 comments at the time of writing.
The term "UK sovereign" implies the inference infrastructure is hosted within the United Kingdom, likely on government-approved or domestic cloud infrastructure, which is a key requirement for UK public sector and regulated industries. This aligns with the UK National AI Strategy and initiatives like the UK's AI Safety Institute.
The documentation appears to be in early stages — the main /docs URL immediately redirects to a getting started page, suggesting a structured onboarding path but not yet showing full API reference or model details. Given the HN attention (104 upvotes), the community is actively discussing the move toward localized inference for compliance and data residency.
If you need low-latency, UK-resident LLM inference for your applications, check the docs for supported models, endpoints, and authentication. The HN comments may contain additional benchmarks or integration tips from early users.
📖 Read the full source: HN LLM Tools
👀 See Also
Markdown as Protocol for Agentic UI with Streaming Execution
A prototype uses Markdown as a unified protocol for AI agents to stream text, executable code, and data in a single response. It features streaming execution where code runs statement-by-statement as it arrives and a mount() primitive for creating React UIs with data flow between client, server, and LLM.
Layerkit: AI Image Editor with Editable Layers Built with Claude Code
A developer built Layerkit, a browser-based AI image editor that generates scenes with editable layers to avoid constant re-prompting. The tool uses a multi-stage AI pipeline where one LLM plans composition, an image model generates the scene, and another LLM analyzes the actual image to place readable text.
Rivet Actors adds SQLite storage: one database per agent, tenant, or document
Rivet Actors now supports SQLite storage where each actor gets its own SQLite database, enabling millions of independent databases for AI agents, multi-tenant SaaS, collaborative documents, or per-user isolation.
Unsloth and NVIDIA Collaborate to Speed Up LLM Training by ~25%
Unsloth and NVIDIA release optimizations for LLM training: caching packed-sequence metadata (~14.3% speedup) and double-buffered async gradient checkpointing (~8% speedup), with no accuracy loss. Auto-enabled on RTX laptops, data center GPUs, and DGX Spark.