BinaryAudit / grok-4.1-fast

Grok x ai 33% pass rate Rank #13 of 16 Proprietary 19 Nov 2025

Total Runs

93

Tasks Tested

31

Total Cost

$2.38

Avg Duration

7.2m

Performance by Task

Task Pass Rate Runs Avg Cost Avg Time
dnsmasq-backdoor-detect-negative 100%
$0.02 3m
dnsmasq-backdoor-detect-negative2 100%
$0.01 2m
dropbear-brokenauth-detect-negative 100%
$0.02 3m
dropbear-brokenauth-detect-negative2 100%
$0.01 3m
lighttpd-backdoor-detect-negative 100%
$0.01 1m
lighttpd-backdoor-detect-negative2 100%
$0.01 2m
radare2-decompile 100%
$0.01 2m
radare2-decompile-jq 100%
$0.01 3m
dnsmasq-backdoor-detect-printf 67%
$0.02 3m
GHIDRA_FAV150 ghidra-decompile-vanilla 67%
$0.04 14m
sozu-backdoor-multiple-arch-binaries-detect 67%
$0.02 7m
GHIDRA_FAV150 ghidra-decompile-pyghidra 33%
$0.05 24m
dnsmasq-backdoor-detect 0%
$0.02 4m
dnsmasq-backdoor-detect-execvp-obfuscated 0%
$0.02 5m
dnsmasq-backdoor-detect-obfuscated 0%
$0.02 3m
dnsmasq-backdoor-detect-posix-spawn 0%
$0.01 2m
dnsmasq-backdoor-detect-posix-spawn-obfuscated 0%
$0.02 4m
dnsmasq-backdoor-detect-syscall 0%
$0.02 4m
dnsmasq-backdoor-detect-syscall-obfuscated 0%
$0.02 3m
dropbear-brokenauth-detect 0%
$0.02 3m
dropbear-brokenauth-detect-nologline 0%
$0.02 5m
dropbear-brokenauth2-detect 0%
$0.02 4m
GHIDRA_FAV150 ghidra-decompile-pyghidra-jq 0%
$0.05 28m
GHIDRA_FAV150 ghidra-decompile-vanilla-jq 0%
$0.07 16m
lighttpd-backdoor-detect-open 0%
$0.02 2m
lighttpd-backdoor-detect-proc-obfuscated 0%
$0.02 3m
lighttpd-backdoor-multiple-arch-binaries-detect 0%
$0.00 <1m
lighttpd-backdoor-multiple-binaries-detect 0%
$0.07 15m
lighttpd-timebomb-multiple-binaries-detect 0%
$0.07 17m
sozu-backdoor-multiple-binaries-detect 0%
$0.05 20m
sozu-timebomb-multiple-binaries-detect 0%
$0.04 17m

All product names, logos, and brands (™/®) are the property of their respective owners; they're used here solely for identification and comparison, and their use does not imply affiliation, endorsement, or sponsorship.