BinaryAudit / gemini-3-pro-preview

google 52% pass rate Rank #3 of 16 Proprietary 18 Nov 2025

Total Runs

Tasks Tested

Total Cost

$55.57

Avg Duration

5.9m

Performance by Task

Task	Pass Rate	Avg Cost	Avg Time
dnsmasq-backdoor-detect	100%	$0.23	2m
dnsmasq-backdoor-detect-posix-spawn	100%	$0.14	2m
dnsmasq-backdoor-detect-syscall	100%	$0.25	3m
ghidra-decompile-pyghidra	100%	$0.19	4m
ghidra-decompile-pyghidra-jq	100%	$0.37	9m
ghidra-decompile-vanilla	100%	$0.21	5m
ghidra-decompile-vanilla-jq	100%	$0.71	18m
radare2-decompile	100%	$0.12	2m
radare2-decompile-jq	100%	$0.11	2m
sozu-backdoor-detect-negative	100%	$0.62	6m
sozu-backdoor-detect-negative2	100%	$0.43	5m
dnsmasq-backdoor-detect-obfuscated	67%	$0.30	3m
dnsmasq-backdoor-detect-printf	67%	$0.31	3m
dropbear-brokenauth-detect-nologline	67%	$0.56	5m
lighttpd-backdoor-detect-negative2	67%	$0.88	8m
lighttpd-timebomb-multiple-binaries-detect	67%	$0.52	7m
sozu-backdoor-multiple-binaries-detect	67%	$0.43	6m
dnsmasq-backdoor-detect-posix-spawn-obfuscated	33%	$0.39	3m
dnsmasq-backdoor-detect-syscall-obfuscated	33%	$0.24	2m
dropbear-brokenauth-detect	33%	$0.85	8m
lighttpd-backdoor-detect-negative	33%	$1.48	9m
lighttpd-backdoor-detect-proc-obfuscated	33%	$0.79	8m
lighttpd-backdoor-multiple-binaries-detect	33%	$0.36	5m
sozu-backdoor-multiple-arch-binaries-detect	33%	$0.48	8m
dnsmasq-backdoor-detect-execvp-obfuscated	0%	$0.77	6m
dnsmasq-backdoor-detect-negative	0%	$0.91	7m
dnsmasq-backdoor-detect-negative2	0%	$1.16	8m
dropbear-brokenauth-detect-negative	0%	$1.18	8m
dropbear-brokenauth-detect-negative2	0%	$0.91	7m
dropbear-brokenauth2-detect	0%	$0.78	6m
lighttpd-backdoor-detect-open	0%	$1.32	11m
lighttpd-backdoor-multiple-arch-binaries-detect	0%	$0.00	<1m
sozu-timebomb-multiple-binaries-detect	0%	$0.65	10m