OTelBench
OpenTelemetry instrumentation benchmark for AI coding agents. Tests models on real-world tasks adding distributed tracing, metrics, and logging to multi-language codebases.
Quesma Benchmarks
Open-source benchmarks for evaluating AI coding agents on real-world software engineering tasks.
CompileBench
Build system benchmark for AI coding agents. Tests models on fixing compilation errors, updating dependencies, and navigating complex build configurations.