TasksSozu Multiple-Binary Timebomb Detection
Detect timebomb in Sozu load balancer (multiple binaries): process terminates when current timestamp exceeds a hardcoded threshold.
Performance
| Model | Pass Rate | Runs | Avg Cost | Avg Time |
|---|---|---|---|---|
| grok-4.1-fast | 0% | $0.04 | 17m | |
| deepseek-v3.2 | 0% | $0.07 | 17m | |
| claude-haiku-4.5 | 0% | $0.22 | 12m | |
| kimi-k2.5 | 0% | $0.42 | 29m | |
| gemini-3-flash-preview | 0% | $0.45 | 16m | |
| gemini-3.1-pro-preview | 0% | $0.46 | 8m | |
| gemini-3-pro-preview | 0% | $0.65 | 10m | |
| glm-4.7 | 0% | $0.69 | 40m | |
| gpt-5.3-codex-high | 0% | $0.70 | 12m | |
| gpt-5.3-codex | 0% | $0.77 | 14m | |
| grok-4 | 0% | $1.15 | 36m | |
| gpt-5.3-codex-xhigh | 0% | $1.17 | 23m | |
| glm-5 | 0% | $1.18 | 87m | |
| gpt-5 | 0% | $1.25 | 46m | |
| gpt-5.2-codex | 0% | $1.56 | 34m | |
| gpt-5.2-codex-xhigh | 0% | $1.59 | 33m | |
| gemini-2.5-pro | 0% | $1.75 | 42m | |
| gpt-5.2 | 0% | $1.87 | 54m | |
| gpt-5.4-xhigh | 0% | $2.27 | 60m | |
| claude-opus-4.6 | 0% | $2.64 | 28m | |
| gpt-5.2-codex-high | 0% | $2.86 | 40m | |
| claude-sonnet-4.5 | 0% | $3.66 | 53m | |
| gpt-5.4-high | 0% | $3.84 | 69m | |
| claude-opus-4.5 | 0% | $3.88 | 42m | |
| gpt-5.4 | 0% | $4.98 | 45m | |
| claude-sonnet-4 | 0% | $42.21 | 45m |