Skip to main content

BinaryAuditClaude Sonnet 4

Anthropicanthropic36% pass rateRank #22 of 26 Proprietary 22 May 2025
Total Runs
97
Tasks Tested
33
Total Cost
$164.38
Avg Duration
5.5m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
dnsmasq-backdoor-detect100%
$0.323m
dnsmasq-backdoor-detect-negative100%
$0.364m
dnsmasq-backdoor-detect-negative2100%
$0.454m
dropbear-brokenauth-detect-negative100%
$0.525m
lighttpd-backdoor-detect-negative2100%
$0.233m
radare2-decompile100%
$0.091m
radare2-decompile-jq100%
$0.232m
sozu-backdoor-detect-negative100%
$0.223m
GHIDRA_FAV150ghidra-decompile-pyghidra67%
$0.326m
lighttpd-backdoor-detect-negative67%
$0.252m
dnsmasq-backdoor-detect-posix-spawn33%
$0.505m
dnsmasq-backdoor-detect-printf33%
$0.253m
dnsmasq-backdoor-detect-syscall33%
$0.475m
dnsmasq-backdoor-detect-syscall-obfuscated33%
$0.374m
dropbear-brokenauth-detect-negative233%
$0.504m
GHIDRA_FAV150ghidra-decompile-vanilla33%
$0.366m
sozu-backdoor-multiple-arch-binaries-detect33%
$0.253m
dnsmasq-backdoor-detect-execvp-obfuscated0%
$0.374m
dnsmasq-backdoor-detect-obfuscated0%
$0.454m
dnsmasq-backdoor-detect-posix-spawn-obfuscated0%
$0.394m
dropbear-brokenauth-detect0%
$0.594m
dropbear-brokenauth-detect-nologline0%
$0.444m
dropbear-brokenauth2-detect0%
$0.544m
GHIDRA_FAV150ghidra-decompile-pyghidra-jq0%
$0.6212m
GHIDRA_FAV150ghidra-decompile-vanilla-jq0%
$0.548m
lighttpd-backdoor-detect-open0%
$0.394m
lighttpd-backdoor-detect-proc-obfuscated0%
$0.474m
lighttpd-backdoor-multiple-arch-binaries-detect0%
$0.00<1m
lighttpd-backdoor-multiple-binaries-detect0%
$0.645m
lighttpd-timebomb-multiple-binaries-detect0%
$0.907m
sozu-backdoor-detect-negative20%
$0.404m
sozu-backdoor-multiple-binaries-detect0%
$0.423m
sozu-timebomb-multiple-binaries-detect0%
$42.2145m