Try for free

Measured · release 2026-10-12

GPT Luna code review, measured

GPT 5.6 Luna Pro reviewed the same pull requests as every other model on 7 of IonWarp’s 8 benchmark lanes, each finding matched against the pull request’s known issues. GPT Luna is not the best model on any lane we ran; its best F1 was 64.5%, on SOC 2 Review. On general code review, GPT 5.6 Luna Pro scored F1 41.6% at $0.116 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.

GPT Luna on every lane
GPT Luna on every lane
LaneModelF1Rank among modelsTime (p50)$ / review
Code Review benchmarkGPT 5.6 Luna Pro41.6%5 of 51m 47s$0.116
Security Review benchmarkGPT 5.6 Luna Pro28.6%7 of 71m 16s$0.105
AI Architecture benchmarkGPT 5.6 Luna Pro35.3%4 of 851s$0.046
Log & Errors benchmarkGPT 5.6 Luna Pro36.0%5 of 544s$0.046
API Performance benchmarkGPT 5.6 Luna Pro50.0%4 of 628s$0.030
SOC 2 Review benchmarkGPT 5.6 Luna Pro64.5%3 of 537s$0.072
CI/CD Performance benchmarkGPT 5.6 Luna Pro54.5%4 of 533s$0.014

Highlighted rows are what the agent runs today. Green: the best model on that lane.

FAQ

GPT Luna for review

Is GPT Luna good for code review?

GPT Luna is not the best model on any lane we ran; its best F1 was 64.5%, on SOC 2 Review. On general code review, GPT 5.6 Luna Pro scored F1 41.6% at $0.116 a review; Muse Spark 1.3 led the models at 56.6%, and DeepSeek V4.1 Flash, which IonWarp’s Code Review runs, scored 49.2% at $0.102.

What does a GPT Luna review cost?

In model charges on the benchmark, from $0.014 a review on CI/CD Performance to $0.116 on Code Review. On IonWarp, model spend comes out of the review spend your plan includes.

Which GPT Luna models has IonWarp benchmarked?

GPT 5.6 Luna Pro, on 7 of the 8 lanes: Code Review, Security Review, AI Architecture, Log & Errors, API Performance, SOC 2 Review and CI/CD Performance.

Does IonWarp run GPT Luna?

Not by default: the agents start on DeepSeek V4.1 Flash. An agent moves to another model only when IonWarpBench finds one that clears its quality bar for less, and every review names its model.

Every agent names its model.

Try for free

See pricing