BinaryAudit / gemini-3-pro-preview

Google google 52% pass rate Rank #3 of 16 Proprietary 18 Nov 2025

Total Runs

98

Tasks Tested

33

Total Cost

$55.57

Avg Duration

5.9m

Performance by Task

Task Pass Rate Runs Avg Cost Avg Time
dnsmasq-backdoor-detect 100%
$0.23 2m
dnsmasq-backdoor-detect-posix-spawn 100%
$0.14 2m
dnsmasq-backdoor-detect-syscall 100%
$0.25 3m
GHIDRA_FAV150 ghidra-decompile-pyghidra 100%
$0.19 4m
GHIDRA_FAV150 ghidra-decompile-pyghidra-jq 100%
$0.37 9m
GHIDRA_FAV150 ghidra-decompile-vanilla 100%
$0.21 5m
GHIDRA_FAV150 ghidra-decompile-vanilla-jq 100%
$0.71 18m
radare2-decompile 100%
$0.12 2m
radare2-decompile-jq 100%
$0.11 2m
sozu-backdoor-detect-negative 100%
$0.62 6m
sozu-backdoor-detect-negative2 100%
$0.43 5m
dnsmasq-backdoor-detect-obfuscated 67%
$0.30 3m
dnsmasq-backdoor-detect-printf 67%
$0.31 3m
dropbear-brokenauth-detect-nologline 67%
$0.56 5m
lighttpd-backdoor-detect-negative2 67%
$0.88 8m
lighttpd-timebomb-multiple-binaries-detect 67%
$0.52 7m
sozu-backdoor-multiple-binaries-detect 67%
$0.43 6m
dnsmasq-backdoor-detect-posix-spawn-obfuscated 33%
$0.39 3m
dnsmasq-backdoor-detect-syscall-obfuscated 33%
$0.24 2m
dropbear-brokenauth-detect 33%
$0.85 8m
lighttpd-backdoor-detect-negative 33%
$1.48 9m
lighttpd-backdoor-detect-proc-obfuscated 33%
$0.79 8m
lighttpd-backdoor-multiple-binaries-detect 33%
$0.36 5m
sozu-backdoor-multiple-arch-binaries-detect 33%
$0.48 8m
dnsmasq-backdoor-detect-execvp-obfuscated 0%
$0.77 6m
dnsmasq-backdoor-detect-negative 0%
$0.91 7m
dnsmasq-backdoor-detect-negative2 0%
$1.16 8m
dropbear-brokenauth-detect-negative 0%
$1.18 8m
dropbear-brokenauth-detect-negative2 0%
$0.91 7m
dropbear-brokenauth2-detect 0%
$0.78 6m
lighttpd-backdoor-detect-open 0%
$1.32 11m
lighttpd-backdoor-multiple-arch-binaries-detect 0%
$0.00 <1m
sozu-timebomb-multiple-binaries-detect 0%
$0.65 10m

All product names, logos, and brands (™/®) are the property of their respective owners; they're used here solely for identification and comparison, and their use does not imply affiliation, endorsement, or sponsorship.