Try for free

Measured · release 2026-10-12

GLM code review, measured

GLM 5.3 Flash and GLM 5.3 reviewed the same pull requests as every other model on 7 of IonWarp’s 8 benchmark lanes, each finding matched against the pull request’s known issues. GLM 5.3 Flash is the best model we ran on Security Review (F1 66.7%) and SOC 2 Review (F1 66.7%). On general code review, GLM 5.3 Flash scored F1 42.8% at $0.018 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.

GLM on every lane
GLM on every lane
LaneModelF1Rank among modelsTime (p50)$ / review
Code Review benchmarkGLM 5.3 Flash42.8%4 of 52m 15s$0.018
Security Review benchmarkGLM 5.3 Flash66.7%1 of 71m 38s$0.012
AI Architecture benchmarkGLM 5.347.1%1 of 81m 30s$0.075
AI Architecture benchmarkGLM 5.3 Flash15.4%8 of 81m 02s$0.0064
Log & Errors benchmarkGLM 5.3 Flash36.1%4 of 51m 14s$0.0058
API Performance benchmarkGLM 5.3 Flash48.3%5 of 649s$0.0049
SOC 2 Review benchmarkGLM 5.3 Flash66.7%1 of 534s$0.0095
CI/CD Performance benchmarkGLM 5.3 Flash55.0%3 of 550s$0.0027

Highlighted rows are what the agent runs today. Green: the best model on that lane.

FAQ

GLM for review

Is GLM good for code review?

For some reviews. GLM 5.3 Flash is the best model we ran on Security Review (F1 66.7%) and SOC 2 Review (F1 66.7%). On general code review, GLM 5.3 Flash scored F1 42.8% at $0.018 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.

What does a GLM review cost?

In model charges on the benchmark, from $0.0027 a review on CI/CD Performance to $0.075 on AI Architecture. On IonWarp, model spend comes out of the review spend your plan includes.

Which GLM models has IonWarp benchmarked?

GLM 5.3 Flash and GLM 5.3, on 7 of the 8 lanes: Code Review, Security Review, AI Architecture, Log & Errors, API Performance, SOC 2 Review and CI/CD Performance.

Does IonWarp run GLM?

Not by default: the agents start on DeepSeek V4.1 Flash. Security Review, AI Architecture and SOC 2 Review retry a failed attempt on GLM. An agent moves to another model only when IonWarpBench finds one that clears its quality bar for less, and every review names its model.

Every agent names its model.

Try for free

14 days free, no card. Then Pro is $49 a month per workspace with 5 seats, or Max $149 with 10.