Skip to main content

BinaryAuditClaude Sonnet 4.5

Anthropicanthropic49% pass rateRank #9 of 26 Proprietary 29 Sept 2025
Total Runs
97
Tasks Tested
33
Total Cost
$69.52
Avg Duration
9.3m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
dnsmasq-backdoor-detect-negative100%
$0.928m
dnsmasq-backdoor-detect-negative2100%
$1.0112m
dnsmasq-backdoor-detect-printf100%
$0.577m
GHIDRA_FAV150ghidra-decompile-pyghidra100%
$0.277m
GHIDRA_FAV150ghidra-decompile-pyghidra-jq100%
$0.199m
GHIDRA_FAV150ghidra-decompile-vanilla100%
$0.305m
lighttpd-backdoor-detect-negative100%
$0.334m
lighttpd-backdoor-detect-negative2100%
$0.517m
radare2-decompile100%
$0.072m
radare2-decompile-jq100%
$0.133m
sozu-backdoor-detect-negative100%
$0.294m
sozu-backdoor-detect-negative2100%
$0.394m
dnsmasq-backdoor-detect-obfuscated67%
$0.587m
dnsmasq-backdoor-detect-syscall67%
$0.616m
GHIDRA_FAV150ghidra-decompile-vanilla-jq67%
$0.4014m
lighttpd-backdoor-detect-open67%
$1.0511m
lighttpd-timebomb-multiple-binaries-detect67%
$0.386m
dnsmasq-backdoor-detect33%
$0.928m
dropbear-brokenauth-detect33%
$0.616m
lighttpd-backdoor-multiple-binaries-detect33%
$0.529m
sozu-backdoor-multiple-arch-binaries-detect33%
$1.1617m
dnsmasq-backdoor-detect-execvp-obfuscated0%
$0.887m
dnsmasq-backdoor-detect-posix-spawn0%
$1.1211m
dnsmasq-backdoor-detect-posix-spawn-obfuscated0%
$0.837m
dnsmasq-backdoor-detect-syscall-obfuscated0%
$0.9011m
dropbear-brokenauth-detect-negative0%
$0.736m
dropbear-brokenauth-detect-negative20%
$0.679m
dropbear-brokenauth-detect-nologline0%
$0.313m
dropbear-brokenauth2-detect0%
$0.716m
lighttpd-backdoor-detect-proc-obfuscated0%
$1.3010m
lighttpd-backdoor-multiple-arch-binaries-detect0%
$0.00<1m
sozu-backdoor-multiple-binaries-detect0%
$1.0525m
sozu-timebomb-multiple-binaries-detect0%
$3.6653m