Skip to main content
How it works
Benchmarks
Blog
About us
Token economics
Talk to the founder
How it works
Benchmarks
Blog
About us
Token economics
Talk to the founder
BinaryAudit
/
Grok 4.1 Fast
Grok
x ai
33% pass rate
Rank #23 of 26
Proprietary
19 Nov 2025
Total Runs
93
Tasks Tested
31
Total Cost
$2.38
Avg Duration
7.2m
Performance by Task
Task
Pass Rate
Runs
Avg Cost
Avg Time
dnsmasq-backdoor-detect-negative
100%
$0.02
3m
dnsmasq-backdoor-detect-negative2
100%
$0.01
2m
dropbear-brokenauth-detect-negative
100%
$0.02
3m
dropbear-brokenauth-detect-negative2
100%
$0.01
3m
lighttpd-backdoor-detect-negative
100%
$0.01
1m
lighttpd-backdoor-detect-negative2
100%
$0.01
2m
radare2-decompile
100%
$0.01
2m
radare2-decompile-jq
100%
$0.01
3m
dnsmasq-backdoor-detect-printf
67%
$0.02
3m
GHIDRA_FAV150
ghidra-decompile-vanilla
67%
$0.04
14m
sozu-backdoor-multiple-arch-binaries-detect
67%
$0.02
7m
GHIDRA_FAV150
ghidra-decompile-pyghidra
33%
$0.05
24m
dnsmasq-backdoor-detect
0%
$0.02
4m
dnsmasq-backdoor-detect-execvp-obfuscated
0%
$0.02
5m
dnsmasq-backdoor-detect-obfuscated
0%
$0.02
3m
dnsmasq-backdoor-detect-posix-spawn
0%
$0.01
2m
dnsmasq-backdoor-detect-posix-spawn-obfuscated
0%
$0.02
4m
dnsmasq-backdoor-detect-syscall
0%
$0.02
4m
dnsmasq-backdoor-detect-syscall-obfuscated
0%
$0.02
3m
dropbear-brokenauth-detect
0%
$0.02
3m
dropbear-brokenauth-detect-nologline
0%
$0.02
5m
dropbear-brokenauth2-detect
0%
$0.02
4m
GHIDRA_FAV150
ghidra-decompile-pyghidra-jq
0%
$0.05
28m
GHIDRA_FAV150
ghidra-decompile-vanilla-jq
0%
$0.07
16m
lighttpd-backdoor-detect-open
0%
$0.02
2m
lighttpd-backdoor-detect-proc-obfuscated
0%
$0.02
3m
lighttpd-backdoor-multiple-arch-binaries-detect
0%
$0.00
<1m
lighttpd-backdoor-multiple-binaries-detect
0%
$0.07
15m
lighttpd-timebomb-multiple-binaries-detect
0%
$0.07
17m
sozu-backdoor-multiple-binaries-detect
0%
$0.05
20m
sozu-timebomb-multiple-binaries-detect
0%
$0.04
17m