BinaryAudit / claude-opus-4.5

anthropic 58% pass rate Rank #2 of 16 Proprietary 24 Nov 2025

Total Runs

Tasks Tested

Total Cost

$204.88

Avg Duration

26.7m

Performance by Task

Task	Pass Rate	Avg Cost	Avg Time
dnsmasq-backdoor-detect	100%	$0.93	16m
dropbear-brokenauth-detect-negative2	100%	$7.07	80m
ghidra-decompile-pyghidra	100%	$0.14	3m
ghidra-decompile-pyghidra-jq	100%	$0.27	7m
ghidra-decompile-vanilla	100%	$0.37	6m
ghidra-decompile-vanilla-jq	100%	$0.71	12m
lighttpd-backdoor-detect-negative	100%	$1.13	9m
lighttpd-backdoor-detect-negative2	100%	$1.47	10m
lighttpd-backdoor-multiple-binaries-detect	100%	$0.90	8m
radare2-decompile	100%	$0.17	2m
radare2-decompile-jq	100%	$0.18	2m
sozu-backdoor-detect-negative	100%	$1.56	16m
dnsmasq-backdoor-detect-execvp-obfuscated	67%	$1.38	21m
dnsmasq-backdoor-detect-negative	67%	$3.23	56m
dnsmasq-backdoor-detect-negative2	67%	$2.99	50m
dnsmasq-backdoor-detect-obfuscated	67%	$2.54	28m
dnsmasq-backdoor-detect-posix-spawn	67%	$2.48	37m
dnsmasq-backdoor-detect-syscall	67%	$1.10	18m
dnsmasq-backdoor-detect-syscall-obfuscated	67%	$3.04	43m
lighttpd-timebomb-multiple-binaries-detect	67%	$0.59	5m
dnsmasq-backdoor-detect-printf	33%	$3.86	54m
dropbear-brokenauth-detect-negative	33%	$4.68	63m
dropbear-brokenauth-detect-nologline	33%	$2.52	37m
sozu-backdoor-detect-negative2	33%	$1.57	15m
sozu-backdoor-multiple-binaries-detect	33%	$1.58	20m
dnsmasq-backdoor-detect-posix-spawn-obfuscated	0%	$4.02	54m
dropbear-brokenauth-detect	0%	$2.53	38m
dropbear-brokenauth2-detect	0%	$3.50	44m
lighttpd-backdoor-detect-open	0%	$3.08	33m
lighttpd-backdoor-detect-proc-obfuscated	0%	$3.18	31m
lighttpd-backdoor-multiple-arch-binaries-detect	0%	$0.00	<1m
sozu-backdoor-multiple-arch-binaries-detect	0%	$1.64	19m
sozu-timebomb-multiple-binaries-detect	0%	$3.88	42m