Skip to main content

BinaryAuditDeepSeek V3.2

DeepSeekdeepseek39% pass rateRank #19 of 26 MIT 1 Dec 2025
Total Runs
97
Tasks Tested
33
Total Cost
$6.16
Avg Duration
11.1m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
dnsmasq-backdoor-detect-negative100%
$0.037m
dnsmasq-backdoor-detect-negative2100%
$0.0510m
dropbear-brokenauth-detect-negative2100%
$0.1216m
GHIDRA_FAV150ghidra-decompile-vanilla100%
$0.039m
lighttpd-backdoor-detect-negative100%
$0.026m
radare2-decompile100%
$0.013m
radare2-decompile-jq100%
$0.013m
sozu-backdoor-detect-negative100%
$0.027m
sozu-backdoor-detect-negative2100%
$0.037m
dnsmasq-backdoor-detect67%
$0.057m
dnsmasq-backdoor-detect-obfuscated67%
$0.068m
dnsmasq-backdoor-detect-syscall67%
$0.046m
dropbear-brokenauth-detect-negative67%
$0.038m
GHIDRA_FAV150ghidra-decompile-pyghidra67%
$0.028m
lighttpd-backdoor-detect-negative267%
$0.036m
lighttpd-backdoor-multiple-binaries-detect33%
$0.0813m
dnsmasq-backdoor-detect-execvp-obfuscated0%
$0.0612m
dnsmasq-backdoor-detect-posix-spawn0%
$0.048m
dnsmasq-backdoor-detect-posix-spawn-obfuscated0%
$0.059m
dnsmasq-backdoor-detect-printf0%
$0.069m
dnsmasq-backdoor-detect-syscall-obfuscated0%
$0.028m
dropbear-brokenauth-detect0%
$0.1610m
dropbear-brokenauth-detect-nologline0%
$0.158m
dropbear-brokenauth2-detect0%
$0.139m
GHIDRA_FAV150ghidra-decompile-pyghidra-jq0%
$0.0530m
GHIDRA_FAV150ghidra-decompile-vanilla-jq0%
$0.0824m
lighttpd-backdoor-detect-open0%
$0.2822m
lighttpd-backdoor-detect-proc-obfuscated0%
$0.0815m
lighttpd-backdoor-multiple-arch-binaries-detect0%
$0.00<1m
lighttpd-timebomb-multiple-binaries-detect0%
$0.1216m
sozu-backdoor-multiple-arch-binaries-detect0%
$0.0628m
sozu-backdoor-multiple-binaries-detect0%
$0.0615m
sozu-timebomb-multiple-binaries-detect0%
$0.0717m