IonWarpbotexample reviewionwarp review --legacy --pr 42ionwarp review --pr 42
This PR removes --legacy from the command parser but keeps it in the edited README. Replace the stale invocation so a reader following the guide can still run a review.
Flags docs, comments and error messages the change made wrong.
IonWarpbotexample reviewionwarp review --legacy --pr 42ionwarp review --pr 42
This PR removes --legacy from the command parser but keeps it in the edited README. Replace the stale invocation so a reader following the guide can still run a review.
Real IonWarp comments on open-source pull requests, graded against the benchmark's answer key.
Missed byCodeRabbit 3Cursor Bugbot 5Greptile 5Qodo 5
4 of 6 · See the benchmark
MediumKnown issue in the Docs Review benchmark · caught by Gemini 3.8 FlashSee the graded case
P2Log message refers to login on 2FA disable endpoint · Docs Review
The error log states 'cannot proceed with backup code login', but this handler is the 2FA disable endpoint (/api/auth/two-factor/totp/disable), misleading operators diagnosing disable failures.
LowKnown issue in the Docs Review benchmark · caught by Gemini 3.8 FlashSee the graded case
P2Test docstring contradicts assertion verifying no commits occur · Docs Review
The docstring states errors do not block offset commits for other messages, but the test body asserts no offsets are committed (len(committed_offsets) == 0 or test_partition not in committed_offsets).
LowKnown issue in the Docs Review benchmark · caught by Gemini 3.8 FlashSee the graded case
P2Test comment contradicts test setup where permission cache entry is false · Docs Review
Comment says 'Allow access to the dashboard to prove this is not checked', but the map sets '"dashboards:uid:dash1": false'. The entry denies access rather than granting it, failing to verify that denial cache preempts allowed permissions.
LowKnown issue in the Docs Review benchmark · caught by Gemini 3.8 FlashSee the graded case
Gemini 3.8 Flash is its best model on this benchmark; Docs Review runs DeepSeek V4.1 Flash unless you pick another.
IonWarp's models and the review apps, graded on the same open-source pull requests.
| PRs | |||||
|---|---|---|---|---|---|
| IonWarp Docs · Gemini 3.8 Flash | |||||
| IonWarp Docs · DeepSeek V4 Pro | |||||
| IonWarp Docs · Muse Spark 1.3 | |||||
| CodeRabbit | |||||
| Cursor Bugbot | |||||
| Greptile v4.1 | |||||
| Qodo v2 |
Why IonWarp runs DeepSeek V4.1 Flash: in a trial of our specialist reviewers on production pull requests on 23 September 2026 it filed about as many findings per review as GLM 5.3 Flash at high effort (0.93 against 1.02) for a third of the cost ($0.039 against $0.125), and 3 of its 64 findings were refuted.
One workspace price with seats included. Credits pool across your team. Unlimited repos on every plan.
Docs Review is on Pro and Max, from $49 a month with 5 seats and a 7-day trial.
Try AI PR review.
Get AI PR review right from day 1.
Scale AI PR review.
Custom reviewers + credits · GitHub Enterprise · SSO/SAML + audit logs · Custom security review + SLA
P1Italian string in Lithuanian account messages · Docs Review
When a user with Lithuanian locale views OTP setup in the account console, the first step instruction is displayed in Italian instead of Lithuanian.