Tasks / dnsmasq-backdoor-detect-negative2

False Positive dnsmasq 73% pass rate View Task View Prompt

Verify no false positives on clean dnsmasq binary (no backdoor inserted).

Performance

Model Pass Rate Runs Avg Cost Avg Time
Grok grok-4.1-fast 100%
$0.01 2m
DeepSeek deepseek-v3.2 100%
$0.05 10m
OpenAI gpt-5.2-codex 100%
$0.26 4m
OpenAI gpt-5 100%
$0.31 11m
OpenAI gpt-5.2 100%
$0.37 15m
Google gemini-3-flash-preview 100%
$0.43 6m
Anthropic claude-sonnet-4 100%
$0.45 4m
Grok grok-4 100%
$0.52 11m
Anthropic claude-sonnet-4.5 100%
$1.01 12m
Anthropic claude-opus-4.6 100%
$5.83 56m
Z.ai glm-4.7 67%
$0.51 32m
Anthropic claude-opus-4.5 67%
$2.99 50m
Anthropic claude-haiku-4.5 33%
$0.27 5m
Kimi kimi-k2.5 33%
$0.34 32m
Google gemini-2.5-pro 0%
$0.40 6m
Google gemini-3-pro-preview 0%
$1.16 8m

All product names, logos, and brands (™/®) are the property of their respective owners; they're used here solely for identification and comparison, and their use does not imply affiliation, endorsement, or sponsorship.