Models / Coding & Agentic Same model as GLM-5 in Language Models, listed again here because it’s used as a coding model and scored on that rubric. It counts once in the directory’s totals.
Maker Zhipu AI
Released Jan 20, 2026 Strengths & weaknesses + Resolves 72.8% of SWE-bench Verified issues, the best open-weights result measured in this directory + Open weights served by several independent hosts, so a team can run it inside its own environment − Rated below the closed frontier tiers on the WebDev arena − A 200k-token context is limiting next to the million-token tiers when working across a large codebase
Evaluation 100% of weight measured Scored on GLM-5 · sources as of Sep 26, 2026
Confidence band 6.3–6.4 · a model inside this range isn’t meaningfully apart from this one
Code qualityw45 7.3
Rule A 72.8% resolved · 72.8% ÷ 10 · SWE-bench Verified, % resolved (mini-SWE-agent harness) (GLM 5) · Feb 17, 2026
Web developmentw40 5.0
Rule B 1,434 rating (95% 1,426–1,442) from 7,504 votes · Scale 1,050–1,800, 0 to 10 · LMArena WebDev arena (glm-5) · Sep 25, 2026
Codebase contextw15 6.6
Rule B 204,800 tokens · Scale 8,192–1,048,576 tokens, 0 to 10 · OpenRouter, context window · Sep 26, 2026
Price & availability Measured the same way, deliberately kept out of the score: what a model costs doesn’t change what it can do.
w = weight, each criterion’s share of the overall score. Missing marks don’t count for or against. How scoring works
+ 600B mixture-of-experts with 27B active and a 1M-token context, built for long-horizon agentic work + $1.00 input and $2.70 output per million tokens, with open weights promised for October 2026 − Generated roughly 1.7× the median output tokens on Artificial Analysis's index, so real cost runs well above the headline rate − A preview with no independent coding-benchmark result yet, so it carries no overall score here
+ Excellent terminal automation, git operations, and CI/CD debugging + Far more token-efficient than reasoning-heavy rivals on routine tasks − Needs detailed, unambiguous instructions; struggles with vague requests − Smaller context window than some rivals, a constraint on huge monorepos
+ Strong at inferring intent from vague prompts and architectural context + 1M-token context supports coherent multi-file, cross-repo refactors − Can use many more tokens than leaner coding models on routine work − Narrates its reasoning at length, which slows down quick tasks
+ Open-weight performance within striking distance of proprietary leaders + Free to self-host, appealing for cost-sensitive or air-gapped teams − Requires serious infrastructure to run at full size − Tooling and IDE integrations are less mature than Copilot, Cursor, or Codex