Quesma Blog

Insights on agentic coding tools, LLM evaluation, benchmarking, and simulation environments.

Stay tuned for future posts and releases

Claude Code pricing: same tokens, same model, up to 40x the price

Claude Code buyer’s guide, August 2026: what Max, Team, and Enterprise cost, how to get the best deal, and how Uber and Shopify cap the spend.

I burned all my tokens researching how to save tokens

How I burned a full Claude limit in 30 minutes and built my own deep research pipeline instead: 3 subscriptions, shared memory, a clear role for each model. You can build the same from what you already pay for.

Qwen3.6 27B is the sweet spot for local development

Qwen3.6 27B is finally a smart model we can use for coding on MacBook or NVIDIA RTX - with llama.cpp and OpenCode.

We hid backdoors in ~40 MB binaries and asked AI + Ghidra to find them

BinaryAudit benchmarks AI agents using Ghidra to find backdoors in compiled binaries of real open-source servers, proxies, and network infrastructure.

Benchmarking OpenTelemetry: can AI trace your failed login?

A lot of vendors pitch AI SRE. We tested 14 models across 11 programming languages; even the best ones struggle with instrumenting code with the leading open-source standard, OpenTelemetry.

The security paradox of local LLMs

Local LLMs prioritize privacy over security. Our research reveals a 95% backdoor injection success rate.

CompileBench: can AI compile 22-year-old code?

We tested 19 LLMs on their ability to handle real-world software engineering tasks like compiling old code and cross-compiling. See how Anthropic, OpenAI, and Google models stack up in our new benchmark – CompileBench.

Tau² benchmark: how a prompt rewrite boosted GPT-5-mini by 22%

We expected small models to be fast, but our benchmarks revealed a common reliability trap. Here’s our deep dive on finding and fixing it.