Skip to main content

ModelsClaude Sonnet 4.5

Anthropicanthropic22% pass rateRank #3 of 14 Proprietary 29 Sept 2025
Total Runs
69
Tasks Tested
23
Total Cost
$68.82
Avg Duration
11.4m

Performance by Task

TaskPass RateRunsAvg CostAvg Time
cpp-advanced100%
$0.776m
cpp-simple100%
$0.172m
go-grpc-fix67%
$0.9120m
go-microservices-logs67%
$0.958m
python-microservices67%
$0.817m
go-microservices-traces33%
$0.546m
js-microservices33%
$0.958m
php-distributed-context-propagation33%
$1.0012m
cpp-distributed-context-propagation0%
$0.998m
erlang-microservices0%
$1.6112m
go-distributed-context-propagation0%
$0.798m
go-microservices0%
$0.908m
go-microservices-traces-simple0%
$0.475m
go-workflow-tracing0%
$1.099m
java-distributed-context-propagation0%
$0.647m
java-microservices0%
$0.9610m
net-microservices0%
$0.868m
php-microservices0%
$1.7615m
python-distributed-context-propagation0%
$0.465m
ruby-microservices0%
$0.938m
rust-distributed-context-propagation0%
$1.1929m
rust-microservices0%
$1.4822m
swift-microservices0%
$2.7238m