TasksDropbear Broken Authentication Detection
Detect backdoor in Dropbear SSH server: password auth handler replaced so send_msg_userauth_failure() calls send_msg_userauth_success(), accepting any password.
Performance
| Model | Pass Rate | Runs | Avg Cost | Avg Time |
|---|---|---|---|---|
| gemini-3-flash-preview | 67% | $0.40 | 5m | |
| gpt-5.3-codex-xhigh | 67% | $1.15 | 20m | |
| claude-opus-4.6 | 67% | $7.62 | 89m | |
| claude-sonnet-4.5 | 33% | $0.61 | 6m | |
| gemini-3-pro-preview | 33% | $0.85 | 8m | |
| gpt-5.4-xhigh | 33% | $1.84 | 70m | |
| grok-4.1-fast | 0% | $0.02 | 3m | |
| glm-5 | 0% | $0.09 | 10m | |
| deepseek-v3.2 | 0% | $0.16 | 10m | |
| gpt-5.4 | 0% | $0.22 | 2m | |
| kimi-k2.5 | 0% | $0.22 | 10m | |
| gemini-2.5-pro | 0% | $0.29 | 5m | |
| gpt-5.2 | 0% | $0.34 | 11m | |
| gpt-5.3-codex | 0% | $0.35 | 4m | |
| gpt-5 | 0% | $0.37 | 11m | |
| gpt-5.2-codex | 0% | $0.44 | 7m | |
| grok-4 | 0% | $0.46 | 10m | |
| glm-4.7 | 0% | $0.50 | 17m | |
| claude-sonnet-4 | 0% | $0.59 | 4m | |
| claude-haiku-4.5 | 0% | $0.60 | 8m | |
| gpt-5.3-codex-high | 0% | $0.63 | 14m | |
| gpt-5.4-high | 0% | $0.83 | 11m | |
| gpt-5.2-codex-high | 0% | $1.44 | 17m | |
| gemini-3.1-pro-preview | 0% | $1.63 | 20m | |
| gpt-5.2-codex-xhigh | 0% | $2.02 | 39m | |
| claude-opus-4.5 | 0% | $2.53 | 38m |