Cowork vs. Claude Chat: Document Extraction Accuracy Comparison
A developer building a tool for analyzing publicly traded stock annual reports conducted a controlled comparison between Claude.ai chat and Cowork for extracting data from dense financial PDFs. The test used identical prompts and the same 140+ page PDFs containing financial tables, footnotes, and cross-referenced disclosures.
Test Results
Test 1 - Claude.ai chat: Uploaded PDF, pasted prompt. Output was institutional-grade with every line item verified against the source. The model demonstrated self-correcting behavior, catching its own mistakes mid-extraction and fixing them. No errors were found across 150+ data points checked.
Test 2 - Cowork (workflow with existing project folder): Produced 5 factual errors, extracted 30% less content, and missed most forensic-depth material. While headline numbers were correct, detail on sub-components was lost.
Test 3 - Cowork (clean folder, just PDF and prompt): Still produced errors including:
- Fabricated reconciling line items
- Reverse-engineered unit counts
- Multiple categories off by 20-90% from actual financial statement notes
- Prior-year column contamination (current-year figures correct, but FY2024 comparative figures had errors across earnings and FCF tables)
Pattern Analysis
The developer observed that Cowork consistently produced correct current-year totals but unreliable line-item breakdowns. The model appeared to paper over gaps by fabricating reconciling plugs and back-solving to hit known diluted totals rather than reading from the document. In contrast, Claude chat either extracted details correctly or flagged what it couldn't find.
The conclusion suggests that Cowork's agentic task decomposition (chunking, sub-agents, parallel processing) cannot maintain the sustained attention required for long, cross-referenced financial documents. Chat processes PDFs in a single deep pass, while Cowork breaks them up and loses fidelity.
This accuracy gap matters for professional use cases where fabrication is invisible without independent verification of every number. The developer is seeking community feedback on whether others have observed similar patterns with Cowork producing plausible but fabricated detail that Claude chat handles cleanly.
📖 Read the full source: r/ClaudeAI
👀 See Also
Sgai: Goal-Driven Multi-Agent Software Development Tool
Sgai is an open-source Go tool that coordinates AI agents to execute software goals defined in GOAL.md files. It decomposes goals into DAG workflows, runs tests for completion gates, and operates locally with a web dashboard for monitoring.
IM for Agents: REST-based chat room for AI agent communication without SDKs
A developer built IM for Agents, a tool that creates shared chat rooms where AI agents communicate directly via REST API without SDKs or configuration files. Agents use a simple prompt to join rooms and can negotiate APIs, write code, and verify work while humans observe.
RunAnywhere RCLI: On-Device Voice AI Pipeline for Apple Silicon
RunAnywhere has released RCLI, an open-source voice AI pipeline for macOS that runs STT, LLM, and TTS entirely on Apple Silicon devices. The tool uses their proprietary MetalRT inference engine and claims significant performance improvements over existing solutions.
Custom Output Styles Collection for Claude Code
A developer has created 13 custom output styles for Claude Code that modify the AI's behavior through system prompts. The styles include Roast for brutal code critique, Socratic for guided questioning, Breaker for adversarial testing, Ship It for pragmatic solutions, Paranoid for security focus, and TDD for test-driven development.