Try for free

Open benchmark · CC BY 4.0

Which model reviews code best

Every review app and model we measure, on the same real pull requests with known issues. 9 lanes, 186 pull requests, 4 apps and 9 models. The cases and the verdicts are public, so you can check our numbers, including where we lose.

Code review: 50 pull requests, 158 known issuesRanked
Code review: 50 pull requests, 158 known issues
Model / AppReviewer ScoreF1Latency$/run
IonWarp · Muse Spark 1.371.256.6%3m 18s$0.424
Qodo v264.758.5%5m 40s~$1.67
IonWarp · DeepSeek V4 Pro48.751.4%5m 59s$0.165
IonWarp · DeepSeek V4.1 FlashRuns on your PRs41.049.2%6m 56s$0.102
IonWarp · GLM 5.3 Flash40.842.8%2m 15s$0.018
Greptile v4.139.951.1%4m 58s~$1.75
Cursor Bugbot36.251.4%7m 52s~$1.25
IonWarp · GPT 5.6 Luna Pro31.841.6%1m 47s$0.116
CodeRabbit3.142.1%7m 34s~$1.50

Reviewer Score = (3 × F1 + time + $/run) ÷ 5, each part 0 to 100 within this table. IonWarp rows cost the model’s inference; ~$ is each app’s list price for 5 seats at 100 reviews a month. Pinned Martian Core reproduction. Release 2026-10-12, CC BY 4.0.

Qodo v2 leads on F1 at 58.5%. IonWarp’s Code Review runs DeepSeek V4.1 Flash: 49.2% at $0.102 a review. Every row and every PR →

We also publish a comparison of ten AI code review tools by price and Git host at aicodereviewtools.dev.

Code Review

IonWarp inferenceApp price estimatesF1 on the same 50 open-source pull requests for every reviewer

40%50%60%$0.03$0.10$0.30$1.00Cost per review · USD · log scaleQodo v2Muse Spark 1.3DeepSeek V4 ProCursor BugbotGreptile v4.1DeepSeek V4.1 FlashGLM 5.3 FlashCodeRabbitGPT 5.6 Luna Pro

API

The same data, as JSON

Read-only, open to any origin, cached at the edge. Cite it as “IonWarp AI code review benchmark, CC BY 4.0”.

curl https://ionwarp.com/benchmarks/v1/families
curl https://ionwarp.com/benchmarks/v1/reviewers/ionwarp-code-review/metrics

FAQ

About the benchmark

What is the best AI code review tool?

On the code review lane (50 pull requests, 158 known issues), Qodo v2 has the best F1 at 58.5%. IonWarp’s Code Review, on DeepSeek V4.1 Flash, scores 49.2% at $0.102 a review in model cost. The full table is below.

How is an AI code reviewer scored?

A judge model matches each review comment to the pull request’s known issues. Precision is the share of comments that match one, recall the share of known issues caught, and F1 balances the two. The Reviewer Score adds speed and cost: (3 × F1 + time + cost) ÷ 5.

Can I check the numbers?

Yes. Every row, pull request and verdict is on GitHub under CC BY 4.0, and the same data is served at /benchmarks/v1 as JSON.

Why is only Code Review ranked?

Its 50 pull requests and labels come from a public corpus. The specialist lanes are smaller, some labels are ours, and they stay provisional until two raters agree on them.

Put the leaders on your next PR.

Try for free

14 days free, no card. Then Pro is $49 a month per workspace with 5 seats, or Max $149 with 10.