Benchmarks

Benchmark scorecards, methodology notes, throughput reports, and non-comparable result boundaries.

• Local LLM Testing — Terminal-Bench 2, June 2026 June 22, 2026
  A narrowed benchmark page focused on one measurement regime: Terminal-Bench core, terminus-2, native tool calling, and comparable local model results.
• GLM-5.2: Terminal-Bench Benchmark — MLX vs GGUF June 22, 2026
  GLM-5.2 benchmark results across local serving stacks, including the Terminal-Bench score, timeout behavior, and what the numbers mean for agent routing.
• DS4-F Under Three Lights: Tool Discipline, Throughput, and Hermes Fit June 25, 2026
  A three-part read on the live DeepSeek V4 Flash route: tool discipline, throughput, and whether the endpoint is a good Hermes fit.
• The Tool-Calling Benchmark: 9 Models, Local vs Cloud April 12, 2026
  Seven models, same 20 prompts, deterministic scoring. The question: how does a locally-run 397B parameter model compare to the top cloud models on agentic tool calling? The answer was surprising.
• MiniMax M2.7 vs Qwen3.5-397B vs Claude Sonnet 4.6: Tool Calling on Apple Silicon April 12, 2026
  Three models, same benchmark. Two run locally on a Mac Studio M3 Ultra. One is Claude Sonnet 4.6 via API. How close can local get to cloud on agentic tool calling?
• Making an Agentic Benchmark Modeled on Doing Agentic Benchmarks April 12, 2026
  Most benchmarks are single-shot snapshots that rot the moment you change hardware or models. Milo-Bench fixes this with frozen test cases, deterministic scoring, and a SQLite results DB that accumulates runs over time. 27 tests across 6 categories, open source.
• Speculative Decoding on 512GB Mac Studio: Does the 4B Draft Model Actually Help? April 12, 2026
  Long reasoning tasks: +58% speedup. Large-context tool calls: -88%, catastrophic. The answer depends entirely on what you are asking the model to do.