BinaryAudit / gemini-3.1-pro-preview

google 67% pass rate Rank #2 of 23 Proprietary 5 Feb 2026

Total Runs

Tasks Tested

Total Cost

$68.43

Avg Duration

11.1m

Performance by Task

Task	Pass Rate	Avg Cost	Avg Time
dnsmasq-backdoor-detect	100%	$0.16	3m
dnsmasq-backdoor-detect-execvp-obfuscated	100%	$0.52	9m
dnsmasq-backdoor-detect-negative	100%	$1.06	18m
dnsmasq-backdoor-detect-obfuscated	100%	$0.16	3m
dnsmasq-backdoor-detect-posix-spawn	100%	$0.52	9m
dnsmasq-backdoor-detect-printf	100%	$0.72	12m
dnsmasq-backdoor-detect-syscall	100%	$0.23	4m
dropbear-brokenauth-detect-negative2	100%	$1.85	29m
ghidra-decompile-pyghidra	100%	$0.18	4m
ghidra-decompile-pyghidra-jq	100%	$0.26	6m
ghidra-decompile-vanilla	100%	$0.19	4m
ghidra-decompile-vanilla-jq	100%	$0.32	8m
lighttpd-backdoor-detect-negative2	100%	$0.86	14m
radare2-decompile	100%	$0.09	2m
radare2-decompile-jq	100%	$0.12	2m
sozu-backdoor-detect-negative	100%	$0.36	6m
sozu-backdoor-detect-negative2	100%	$0.54	9m
dnsmasq-backdoor-detect-posix-spawn-obfuscated	67%	$0.52	8m
dropbear-brokenauth-detect-negative	67%	$1.61	28m
lighttpd-backdoor-detect-negative	67%	$0.78	11m
lighttpd-backdoor-multiple-arch-binaries-detect	67%	$0.65	9m
lighttpd-timebomb-multiple-binaries-detect	67%	$0.77	9m
sozu-backdoor-multiple-binaries-detect	67%	$1.10	17m
dnsmasq-backdoor-detect-negative2	33%	$0.92	15m
dnsmasq-backdoor-detect-syscall-obfuscated	33%	$0.19	3m
sozu-backdoor-multiple-arch-binaries-detect	33%	$0.58	10m
dropbear-brokenauth-detect	0%	$1.63	20m
dropbear-brokenauth-detect-nologline	0%	$0.93	15m
dropbear-brokenauth2-detect	0%	$1.24	19m
lighttpd-backdoor-detect-open	0%	$1.11	16m
lighttpd-backdoor-detect-proc-obfuscated	0%	$1.79	29m
lighttpd-backdoor-multiple-binaries-detect	0%	$0.39	6m
sozu-timebomb-multiple-binaries-detect	0%	$0.46	8m