BudgetOpenClaw
v2026.11.1 · $1.00 / solved
38.7%pass rate
$0.39/ run
v2026.11.1 · $1.00 / solved
v1.4.0 / v1.2.0 · $1.16 / solved
v2.2.6 · $1.18 / solved
| Harness | Provider | Pass rate | TB 2.1 | TB 4.0 | DeepSWE | Cost / run | Cost / solved | Pass all 3 |
|---|---|---|---|---|---|---|---|---|
| Anomaly | 48.0% | 60.9% | N/A | 44.1% | $0.57 | $1.18 | 30.5% | |
| Zhipu | 48.0% | 77.8% | 20.0% | N/A | $0.60 | $1.26 | 30.3% | |
| Moonshot | 47.0% | 65.3% | 17.9% | 43.6% | $0.64 | $1.36 | N/A | |
| SpaceXAI | 46.2% | 63.6% | 17.4% | 43.5% | $0.68 | $1.48 | 29.1% | |
| Nous Research | 45.6% | 62.6% | 20.0% | 42.5% | $0.65 | $1.42 | 27.1% | |
| DeepSeek | 45.5% | 61.1% | 17.4% | 43.0% | $0.62 | $1.37 | 29.7% | |
| DeepSeek | 45.3% | 69.8% | 20.0% | N/A | $0.66 | $1.45 | 27.8% | |
| DeepSeek | 45.1% | 72.1% | 18.6% | N/A | $0.61 | $1.35 | 28.2% | |
| SWE-agent | 45.0% | 64.4% | 15.9% | 41.0% | $0.67 | $1.48 | 28.1% | |
| Anthropic | 45.0% | 61.7% | 17.9% | 42.5% | $0.76 | $1.68 | 28.2% | |
| Pi | 44.8% | 62.9% | 15.6% | 41.4% | $0.52 | $1.16 | 27.3% | |
| Maka | 44.6% | 73.0% | 17.4% | N/A | $0.61 | $1.36 | 26.3% | |
| Oh My Pi | 44.1% | 72.7% | 16.8% | N/A | $0.52 | $1.17 | 25.6% | |
| OpenCode | 43.8% | 73.1% | 16.2% | N/A | $0.59 | $1.34 | 26.1% | |
| DeepSeek | 43.2% | 69.9% | 16.8% | N/A | $0.67 | $1.56 | 25.4% | |
| GitHub | 43.0% | 72.8% | 15.0% | N/A | $0.75 | $1.75 | 27.8% | |
| OpenAI | 42.9% | 64.8% | 18.2% | 36.6% | $0.55 | $1.28 | 25.1% | |
| MiniMax | 42.7% | 72.7% | 14.7% | N/A | $0.59 | $1.38 | 24.3% | |
| 42.6% | 69.9% | 15.9% | N/A | $0.82 | $1.93 | 24.3% | ||
| Alma | 42.5% | 78.0% | 11.8% | N/A | $0.67 | $1.57 | N/A | |
| Vercel Labs | 41.9% | 53.4% | N/A | 38.7% | $0.65 | $1.55 | 24.5% | |
| Cline | 41.0% | 75.7% | 10.6% | N/A | $0.64 | $1.55 | N/A | |
| Exo | 39.3% | 64.7% | 13.5% | N/A | $0.64 | $1.63 | 21.7% | |
| Alibaba | 39.3% | 52.7% | N/A | 35.1% | $0.57 | $1.44 | 23.0% | |
| OpenClaw | 38.7% | 49.4% | N/A | 36.0% | $0.39 | $1.00 | 22.2% |