Trading Strategy Benchmark: Cheaper AI Models Outperform Claude Opus 4.6

A Reddit user conducted a benchmark comparing 10 different large language models on their ability to develop trading strategies. The results showed that cheaper models consistently outperformed more expensive options, with Claude Opus 4.6 failing to crack the top four despite costing 10 times more than some competitors.

Models Tested

• Claude Opus 4.6
• Gemini 3
• Gemini 3.1 Pro
• GPT-5.2
• Gemini Flash 3
• GPT-5-mini
• Kimi K2.5
• Minimax 2.5

Key Findings

The benchmark asked all models to "create the best trading strategy" using the same prompt. Models like Minimax 2.5 and Gemini 3.1 topped the leaderboard, while Anthropic's models performed poorly in comparison. Kimi K2.5 dominated Claude in this competition while costing 10 times less.

The experiment was run three times to ensure consistent results. The author noted that being good at coding doesn't necessarily translate to being good at other tasks like strategy development.

This type of specialized benchmarking is useful for developers who need to select AI models for specific tasks beyond general coding assistance. The results suggest that model selection should be task-specific rather than based solely on general reputation or price.