Measured · release 2026-10-12
GLM code review, measured
GLM 5.3 Flash and GLM 5.3 reviewed the same pull requests as every other model on 7 of IonWarp’s 8 benchmark lanes, each finding matched against the pull request’s known issues. GLM 5.3 Flash is the best model we ran on Security Review (F1 66.7%) and SOC 2 Review (F1 66.7%). On general code review, GLM 5.3 Flash scored F1 42.8% at $0.018 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.
| Lane | Model | F1 | Rank among models | Time (p50) | $ / review |
|---|---|---|---|---|---|
| Code Review benchmark | GLM 5.3 Flash | 42.8% | 4 of 5 | 2m 15s | $0.018 |
| Security Review benchmark | GLM 5.3 Flash | 66.7% | 1 of 7 | 1m 38s | $0.012 |
| AI Architecture benchmark | GLM 5.3 | 47.1% | 1 of 8 | 1m 30s | $0.075 |
| AI Architecture benchmark | GLM 5.3 Flash | 15.4% | 8 of 8 | 1m 02s | $0.0064 |
| Log & Errors benchmark | GLM 5.3 Flash | 36.1% | 4 of 5 | 1m 14s | $0.0058 |
| API Performance benchmark | GLM 5.3 Flash | 48.3% | 5 of 6 | 49s | $0.0049 |
| SOC 2 Review benchmark | GLM 5.3 Flash | 66.7% | 1 of 5 | 34s | $0.0095 |
| CI/CD Performance benchmark | GLM 5.3 Flash | 55.0% | 3 of 5 | 50s | $0.0027 |
Highlighted rows are what the agent runs today. Green: the best model on that lane.
FAQ
GLM for review
Is GLM good for code review?
For some reviews. GLM 5.3 Flash is the best model we ran on Security Review (F1 66.7%) and SOC 2 Review (F1 66.7%). On general code review, GLM 5.3 Flash scored F1 42.8% at $0.018 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.
What does a GLM review cost?
In model charges on the benchmark, from $0.0027 a review on CI/CD Performance to $0.075 on AI Architecture. On IonWarp, model spend comes out of the review spend your plan includes.
Which GLM models has IonWarp benchmarked?
GLM 5.3 Flash and GLM 5.3, on 7 of the 8 lanes: Code Review, Security Review, AI Architecture, Log & Errors, API Performance, SOC 2 Review and CI/CD Performance.
Does IonWarp run GLM?
Not by default: the agents start on DeepSeek V4.1 Flash. Security Review, AI Architecture and SOC 2 Review retry a failed attempt on GLM. An agent moves to another model only when IonWarpBench finds one that clears its quality bar for less, and every review names its model.

Every agent names its model.
Try for free14 days free, no card. Then Pro is $49 a month per workspace with 5 seats, or Max $149 with 10.