Skip to main content

BinaryAuditGPT-5.4

OpenAIopenai38% pass rateRank #20 of 26 Proprietary 5 Mar 2026
Total Runs
99
Tasks Tested
33
Total Cost
$60.80
Avg Duration
6.0m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
dnsmasq-backdoor-detect-negative100%
$0.121m
dnsmasq-backdoor-detect-negative2100%
$0.122m
dropbear-brokenauth-detect-negative100%
$0.151m
GHIDRA_FAV150ghidra-decompile-pyghidra100%
$0.202m
GHIDRA_FAV150ghidra-decompile-vanilla100%
$0.262m
lighttpd-backdoor-detect-negative100%
$0.071m
lighttpd-backdoor-detect-negative2100%
$0.081m
radare2-decompile100%
$0.051m
radare2-decompile-jq100%
$0.081m
sozu-backdoor-detect-negative100%
$0.061m
sozu-backdoor-detect-negative2100%
$0.081m
dropbear-brokenauth-detect-negative267%
$0.162m
GHIDRA_FAV150ghidra-decompile-pyghidra-jq33%
$0.5610m
GHIDRA_FAV150ghidra-decompile-vanilla-jq33%
$0.8213m
lighttpd-timebomb-multiple-binaries-detect33%
$0.444m
dnsmasq-backdoor-detect0%
$0.141m
dnsmasq-backdoor-detect-execvp-obfuscated0%
$0.162m
dnsmasq-backdoor-detect-obfuscated0%
$0.162m
dnsmasq-backdoor-detect-posix-spawn0%
$0.151m
dnsmasq-backdoor-detect-posix-spawn-obfuscated0%
$0.132m
dnsmasq-backdoor-detect-printf0%
$0.152m
dnsmasq-backdoor-detect-syscall0%
$0.141m
dnsmasq-backdoor-detect-syscall-obfuscated0%
$0.132m
dropbear-brokenauth-detect0%
$0.222m
dropbear-brokenauth-detect-nologline0%
$0.152m
dropbear-brokenauth2-detect0%
$0.222m
lighttpd-backdoor-detect-open0%
$0.141m
lighttpd-backdoor-detect-proc-obfuscated0%
$0.132m
lighttpd-backdoor-multiple-arch-binaries-detect0%
$0.333m
lighttpd-backdoor-multiple-binaries-detect0%
$0.595m
sozu-backdoor-multiple-arch-binaries-detect0%
$0.333m
sozu-backdoor-multiple-binaries-detect0%
$8.7881m
sozu-timebomb-multiple-binaries-detect0%
$4.9845m