Simplified version of Go microservices tracing. Task environment is broken and needs fixing.
Common failure modes
Task/environment is broken and needs fixing.
Performance
| Model | Pass Rate | Runs | Avg Cost | Avg Time |
|---|---|---|---|---|
| grok-4.1-fast | 0% | $0.05 | 10m | |
| gemini-3-flash-preview | 0% | $0.06 | 2m | |
| kimi-k2-thinking | 0% | $0.07 | 15m | |
| deepseek-v3.2 | 0% | $0.08 | 15m | |
| glm-4.7 | 0% | $0.16 | 10m | |
| claude-haiku-4.5 | 0% | $0.23 | 4m | |
| gpt-5.1 | 0% | $0.29 | 9m | |
| gpt-5.2 | 0% | $0.35 | 7m | |
| gemini-3-pro-preview | 0% | $0.38 | 5m | |
| gpt-5.1-codex-max | 0% | $0.38 | 9m | |
| claude-sonnet-4.5 | 0% | $0.47 | 5m | |
| gpt-5.2-codex | 0% | $0.49 | 10m | |
| grok-4 | 0% | $0.58 | 12m | |
| claude-opus-4.5 | 0% | $0.70 | 5m |
All product names, logos, and brands (™/®) are the property of their respective owners; they're used here solely for identification and comparison, and their use does not imply affiliation, endorsement, or sponsorship.