Skip to main content

BinaryAuditClaude Haiku 4.5

Anthropicanthropic33% pass rateRank #24 of 26 Proprietary 15 Oct 2025
Total Runs
99
Tasks Tested
33
Total Cost
$32.41
Avg Duration
7.4m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
radare2-decompile100%
$0.094m
sozu-backdoor-detect-negative100%
$0.061m
sozu-backdoor-detect-negative2100%
$0.111m
dnsmasq-backdoor-detect67%
$0.183m
dnsmasq-backdoor-detect-negative67%
$0.375m
dropbear-brokenauth-detect-negative267%
$0.314m
GHIDRA_FAV150ghidra-decompile-vanilla67%
$0.155m
GHIDRA_FAV150ghidra-decompile-vanilla-jq67%
$0.3023m
lighttpd-backdoor-detect-negative67%
$0.182m
lighttpd-backdoor-detect-negative267%
$0.165m
radare2-decompile-jq67%
$0.2418m
sozu-backdoor-multiple-arch-binaries-detect67%
$0.206m
dnsmasq-backdoor-detect-negative233%
$0.275m
dnsmasq-backdoor-detect-syscall33%
$0.506m
dropbear-brokenauth-detect-negative33%
$0.223m
dropbear-brokenauth-detect-nologline33%
$0.395m
GHIDRA_FAV150ghidra-decompile-pyghidra33%
$0.3815m
GHIDRA_FAV150ghidra-decompile-pyghidra-jq33%
$0.3822m
dnsmasq-backdoor-detect-execvp-obfuscated0%
$0.295m
dnsmasq-backdoor-detect-obfuscated0%
$0.284m
dnsmasq-backdoor-detect-posix-spawn0%
$0.425m
dnsmasq-backdoor-detect-posix-spawn-obfuscated0%
$0.384m
dnsmasq-backdoor-detect-printf0%
$0.385m
dnsmasq-backdoor-detect-syscall-obfuscated0%
$0.416m
dropbear-brokenauth-detect0%
$0.608m
dropbear-brokenauth2-detect0%
$0.366m
lighttpd-backdoor-detect-open0%
$0.465m
lighttpd-backdoor-detect-proc-obfuscated0%
$0.496m
lighttpd-backdoor-multiple-arch-binaries-detect0%
$0.00<1m
lighttpd-backdoor-multiple-binaries-detect0%
$0.2912m
lighttpd-timebomb-multiple-binaries-detect0%
$1.5026m
sozu-backdoor-multiple-binaries-detect0%
$0.237m
sozu-timebomb-multiple-binaries-detect0%
$0.2212m