Developer Considers Switching from DeepSeek to Grok for Finance AI Agent
Finance AI Agent Performance Issues and Potential Switch
A developer has built a finance AI web app in FastAPI/Python that functions similarly to Perplexity but for stocks. The application runs a parallel pipeline before the LLM processes queries, including live stock quotes from several finance APIs, live web search from finance search APIs, and earnings calendar data. All this structured context gets injected into the system prompt, with the model handling only reasoning and formatting while facts come from APIs, making hallucination rates less relevant for this use case.
Current Model Performance Problems
The developer is currently using DeepSeek V3.2 Reasoning and reports significant performance issues:
- TTFT (Time to First Token): ~70 seconds
- Output speed: ~25 tokens per second
- Streaming experience described as "terrible"
- Stream start timeout set to 75 seconds to avoid constant timeouts
Application Requirements
The finance AI agent has two main features:
- Chat stream: Perplexity-style finance analysis with inline source citations
- Trade check stream: Trade coach that outputs GO/NO-GO/WAIT with entry, stop-loss, target, and R:R ratio
Model requirements include:
- Fast performance with low TTFT and high tokens per second for streaming UX
- Low cost for a small project
- Smart enough for multi-step trade reasoning
- Good instruction following for strict output formats in trade checks
Considering Grok 4.1 Fast Reasoning
The developer is considering switching to Grok 4.1 Fast Reasoning based on these comparisons:
- TTFT: ~15 seconds (vs DeepSeek's ~70s)
- Output speed: ~75 tokens per second (vs DeepSeek's ~25 t/s)
- AA intelligence score: 64 vs DeepSeek's 57
- Input cost: $0.20 vs $0.28 per million tokens
Other Models Considered
The developer has also looked at Minimax 2.5, Kimi K2.5, new Qwen 3.5 models, and Gemini 3 Flash, but notes most are relatively expensive and not better for their specific use case.
📖 Read the full source: r/LocalLLaMA
👀 See Also
Patient uses Claude AI to interpret medical data and navigate brain cancer treatment
A 27-year-old patient with primary mediastinal B-cell lymphoma with CNS involvement uses Claude AI daily to interpret immunohistochemistry panels, analyze PET-CT scan results, evaluate CAR-T clinical trial data, understand drug mechanisms, and prepare questions for medical team.
Using Claude Code to Automate AI Research Experiments for 12 Hours
A developer used Claude Code to run automated AI research experiments for 12 hours, tuning a continual learning framework to maximize model compliance to preference verifiers. The system ran 9 experiments, fixed a model collapse bug, and achieved 100% compliance from 0%.
Claude + Remotion: Building a Product Launch Video with Zero Animation Skills
A developer used Claude's deep knowledge of Remotion's API to build a 30-second animated product launch video for a stock market app — no CSS transitions, spring physics, typewriter effects, and staggered animations across 10 scene files.
Case Study: Building a Full-Stack Web App with Claude in Six Weeks
A 19-year-old developer from Nepal used Claude to build and ship Somnia, a dream journal web app with 100 users and 7 paying customers in six weeks. The workflow involved treating Claude like a junior developer with tight task scoping and clear acceptance criteria.