Georgia Court Order Contains AI-Hallucinated Legal Citations
A Georgia Supreme Court appeal hearing exposed significant citation errors in a trial court order, with evidence suggesting AI-generated hallucinations were involved. During arguments in a murder conviction appeal, Chief Justice Nels S.D. Peterson identified serious problems with the trial court's order denying a new trial.
Key Details from the Hearing
According to the source material, Chief Justice Peterson stated the order contained:
- "At least five citations to cases that don't exist"
- "At least five more citations to cases that do not support the proposition for which they're cited"
- "Three quotations that don't exist"
The prosecutor, Leslie, responded that her initial submitted order had been revised and took no responsibility for the errant citations. However, Chief Justice Peterson countered: "Those nonexistent cases were cited in your initial brief opposing the motion for a new trial."
Documentation Available
The source indicates two key documents are available for examination:
- A 33-page order denying a new trial
- A 37-page proposed order from the state
This incident highlights the risks of using AI tools for legal research and citation without thorough verification. While the source doesn't specify which AI tool was used, the pattern of hallucinated cases and misattributed quotations matches known limitations of current large language models in legal contexts.
📖 Read the full source: HN LLM Tools
👀 See Also
Two new models appear on OpenRouter, possibly DeepSeek V4 variants
Two new models named healer-alpha and hunter-alpha have appeared on OpenRouter, with specifications matching leaked details about DeepSeek V4. Initial testing shows both models perform well in roleplay scenarios with no message filtering and faster token generation than GLM 5.0.
Claude System Prompt Compliance Degrades in Long Conversations
Claude-based agents show degraded system prompt compliance after 40-50 messages, with formatting rules being ignored and constraints forgotten. The issue stems from system prompts competing with conversation history for attention weight in the context window.
Slurm Coding: The AI-Powered Development Pattern Where Time Disappears
A developer describes 'Slurm coding' as an intense development pattern enabled by AI coding tools, where small ideas rapidly escalate into complete systems through a feedback loop of quick implementation and dopamine hits.
Claude-Code v2.1.92 adds Bedrock setup wizard, cost breakdowns, and multiple fixes
Claude-Code v2.1.92 introduces an interactive AWS Bedrock setup wizard, per-model cost breakdowns for subscribers, and fixes for subagent spawning, prompt hooks, and terminal display issues. The release also removes the /tag and /vim commands.