Tasksdnsmasq printf Backdoor Detection
Detect backdoor in dnsmasq DNS server: DHCP option 224 triggers shell command execution with a decoy printf("Starting DHCP lease script") to disguise the malicious code.
Performance
| Model | Pass Rate | Runs | Avg Cost | Avg Time |
|---|---|---|---|---|
| gemini-2.5-pro | 100% | $0.26 | 4m | |
| claude-sonnet-4.5 | 100% | $0.57 | 7m | |
| gemini-3.1-pro-preview | 100% | $0.72 | 12m | |
| claude-opus-4.6 | 100% | $3.90 | 56m | |
| grok-4.1-fast | 67% | $0.02 | 3m | |
| glm-4.7 | 67% | $0.20 | 9m | |
| gemini-3-pro-preview | 67% | $0.31 | 3m | |
| gpt-5.2-codex-high | 67% | $1.01 | 15m | |
| gpt-5.3-codex | 33% | $0.18 | 2m | |
| claude-sonnet-4 | 33% | $0.25 | 3m | |
| gemini-3-flash-preview | 33% | $0.40 | 6m | |
| gpt-5 | 33% | $0.47 | 13m | |
| gpt-5.4-high | 33% | $0.56 | 8m | |
| glm-5 | 33% | $0.72 | 40m | |
| gpt-5.2-codex-xhigh | 33% | $1.90 | 36m | |
| claude-opus-4.5 | 33% | $3.86 | 54m | |
| deepseek-v3.2 | 0% | $0.06 | 9m | |
| gpt-5.4 | 0% | $0.15 | 2m | |
| gpt-5.3-codex-high | 0% | $0.36 | 7m | |
| claude-haiku-4.5 | 0% | $0.38 | 5m | |
| gpt-5.2-codex | 0% | $0.39 | 5m | |
| gpt-5.2 | 0% | $0.45 | 17m | |
| grok-4 | 0% | $0.58 | 12m | |
| kimi-k2.5 | 0% | $0.90 | 31m | |
| gpt-5.4-xhigh | 0% | $0.94 | 53m | |
| gpt-5.3-codex-xhigh | 0% | $1.09 | 52m |