BinaryAudit / claude-opus-4.5

Anthropic anthropic 58% pass rate Rank #2 of 16 Proprietary 24 Nov 2025

Total Runs

99

Tasks Tested

33

Total Cost

$204.88

Avg Duration

26.7m

Performance by Task

Task Pass Rate Runs Avg Cost Avg Time
dnsmasq-backdoor-detect 100%
$0.93 16m
dropbear-brokenauth-detect-negative2 100%
$7.07 80m
GHIDRA_FAV150 ghidra-decompile-pyghidra 100%
$0.14 3m
GHIDRA_FAV150 ghidra-decompile-pyghidra-jq 100%
$0.27 7m
GHIDRA_FAV150 ghidra-decompile-vanilla 100%
$0.37 6m
GHIDRA_FAV150 ghidra-decompile-vanilla-jq 100%
$0.71 12m
lighttpd-backdoor-detect-negative 100%
$1.13 9m
lighttpd-backdoor-detect-negative2 100%
$1.47 10m
lighttpd-backdoor-multiple-binaries-detect 100%
$0.90 8m
radare2-decompile 100%
$0.17 2m
radare2-decompile-jq 100%
$0.18 2m
sozu-backdoor-detect-negative 100%
$1.56 16m
dnsmasq-backdoor-detect-execvp-obfuscated 67%
$1.38 21m
dnsmasq-backdoor-detect-negative 67%
$3.23 56m
dnsmasq-backdoor-detect-negative2 67%
$2.99 50m
dnsmasq-backdoor-detect-obfuscated 67%
$2.54 28m
dnsmasq-backdoor-detect-posix-spawn 67%
$2.48 37m
dnsmasq-backdoor-detect-syscall 67%
$1.10 18m
dnsmasq-backdoor-detect-syscall-obfuscated 67%
$3.04 43m
lighttpd-timebomb-multiple-binaries-detect 67%
$0.59 5m
dnsmasq-backdoor-detect-printf 33%
$3.86 54m
dropbear-brokenauth-detect-negative 33%
$4.68 63m
dropbear-brokenauth-detect-nologline 33%
$2.52 37m
sozu-backdoor-detect-negative2 33%
$1.57 15m
sozu-backdoor-multiple-binaries-detect 33%
$1.58 20m
dnsmasq-backdoor-detect-posix-spawn-obfuscated 0%
$4.02 54m
dropbear-brokenauth-detect 0%
$2.53 38m
dropbear-brokenauth2-detect 0%
$3.50 44m
lighttpd-backdoor-detect-open 0%
$3.08 33m
lighttpd-backdoor-detect-proc-obfuscated 0%
$3.18 31m
lighttpd-backdoor-multiple-arch-binaries-detect 0%
$0.00 <1m
sozu-backdoor-multiple-arch-binaries-detect 0%
$1.64 19m
sozu-timebomb-multiple-binaries-detect 0%
$3.88 42m

All product names, logos, and brands (™/®) are the property of their respective owners; they're used here solely for identification and comparison, and their use does not imply affiliation, endorsement, or sponsorship.