Skip to content
IonWarpGet started
Best LLM for code review

The best LLM for code review, measured

The best LLM for code review we have measured is Muse Spark 1.3. On the 50 pull requests of Martian's open code review benchmark,[1] which hold 158 known issues, it found 79, with 42 findings that matched none: an F1 of 56.6%, for 42 cents a review.[2] We ran five models and four review apps, and Claude Opus 4.5 graded every finding (the 6 October 2026 release of our AI code review benchmarks). The Qodo app found the most, 98, and scored a little higher: 58.5%.

Example pull request#310

What lands on your pull request · Code Review

P1Retry charges the same order twice
billing/checkout.ts:42 · A timed-out response can charge the order twice
- await payments.charge(order);+ await payments.charge(order, {+   idempotencyKey: order.id,+ });
When payment succeeds but the response times out, the caller retries the same order. Both calls charge it. Pass the stable order ID as the payment idempotency key.

DeepSeek V4.1 Flash, the model IonWarp's Code Review runs by default, scored 49.2% for 10 cents a review. The most precise reviewers found the fewest bugs: 73% of GPT 5.6 Luna Pro's findings matched a known issue, but it found only 46.[2] No model wins every column, or every kind of review: five different models lead our nine review types, and the last table names the winner of each.

What IonWarp runs, and why

  • Code Review, on every plan

    Runs DeepSeek V4.1 Flash. We chose it on reviews of our own repositories from 1 to 21 September 2026: per 100 reviews it filed as many P0 and P1 findings as DeepSeek V4 Pro (14.8 on 549 reviews, against 13.5 on 104) for about a quarter of the cost.

    Code ReviewOn Starter, Pro and Max

  • When a review is retried

    A Code Review run that fails gets one retry, which can move to Muse Spark 1.3, the best model on the code benchmark.

    Code ReviewOn Starter, Pro and Max

  • The specialist reviewers

    Security, docs, logs, performance, CI/CD, cost and SOC 2 are measured on 11 to 20 pull requests each, with provisional answer keys. Their leaders in the table are a guide; the models those reviewers run were picked on production reviews.

What our reviewers caught that all four apps missed

  1. Clickjacking protection switched off

    A Discourse change set X-Frame-Options to ALLOWALL and trusted the Referer header, which any client can fake.[3] DeepSeek V4.1 Flash flagged it.

    Security ReviewOn Starter, Pro and Max

  2. An error message for the wrong action

    In Cal.com, the endpoint that turns off two-factor login answered with an error about backup code login.[4] Gemini 3.8 Flash flagged it.

    Docs ReviewOn Pro and Max

The best model for code review, all five on the same 50 PRs

Each model ran as IonWarp's Code Review on the same 50 pull requests, and the IonWarp column says where our reviewers use it.[2] Costs here are the benchmark's: the quarter-of-the-cost comparison above comes from reviews of our own repositories. Factory ran 13 other models in April on 50 pull requests from the same five repositories, and GPT-5.2 led with an F1 of 60.5%.[5] Its prompts and grader are its own, so the two lists don't compare score for score.

CriterionIonWarpF1Found, of 158Matched noneCost per reviewMedian time
Muse Spark 1.3Retry for Code Review56.6%[2]79[2]42[2]$0.42[2]3m 18s[2]
DeepSeek V4 ProRetry for CI/CD Performance51.4%[2]64[2]27[2]$0.16[2]5m 59s[2]
DeepSeek V4.1 FlashDefault for Code Review49.2%[2]77[2]78[2]$0.10[2]6m 56s[2]
GLM 5.3 FlashDefault for Cost Review42.8%[2]59[2]59[2]$0.02[2]2m 15s[2]
GPT 5.6 Luna ProDefault for Analytics Review41.6%[2]46[2]17[2]$0.12[2]1m 47s[2]

The best model for each review, measured

ReviewBest modelF1PrecisionRecall$ per reviewMedian time
Code Review50 of 50 PRsMuse Spark 1.356.6%65.3%50.0%$0.423m 18s
Security Review13 of 13 PRsGLM 5.3 Flash66.7%83.3%55.6%$0.011m 38s
AI Architecture Review11 of 11 PRsDeepSeek V4.1 Flash47.1%36.4%66.7%$0.056m 14s
Log & Errors Review17 of 17 PRsGemini 3.8 Flash67.7%67.7%67.7%$0.101m 28s
Docs Review19 of 19 PRsGemini 3.8 Flash68.6%66.7%70.6%$0.0859 sec
API Performance Review18 of 18 PRsMuse Spark 1.356.0%58.3%53.8%$0.0642 sec
SOC 2 Review20 of 20 PRsGLM 5.3 Flash66.7%61.1%73.3%$0.0134 sec
CI/CD Performance18 of 18 PRsDeepSeek V4 Pro72.7%60.0%92.3%$0.031m 22s
Cost Review20 of 20 PRsDeepSeek V4.1 Flash57.1%47.6%71.4%$0.0710m 39s

The top F1 for each review on its own benchmark pull requests, read from the published results. Only the code review table is ranked; the others use provisional answer keys.

Measured on open-source pull requests with known issues. See the benchmark

Pricing

Simple pricing for your whole team.

One workspace price with seats included. Credits pool across your team. Unlimited repos on every plan.

Starter

$0 /mo

Try AI PR review.

  • 2 reviewers
    • Code Review
    • Security Review
  • 3 seats included
  • 15,000 credits to start, then 5,000/mo
  • About 70 reviews to start, then about 25 a month
  • Unlimited repos
Get Started

Max

$149 /mo

Scale AI PR review.

  • +9 reviewers
    • UX Review
    • API Performance
    • Analytics Review
    • SEO Review
    • Changelog
    • CI/CD Performance
    • Plan Review
    • Repeat-Failure Learnings
    • SOC 2 Review
  • 10 seats included
  • +75,000 credits/mo
  • About 360 reviews a month
  • +$29/mo per added seat
  • Unlimited repos
  • Priority support
Choose Max
Enterprise

Custom reviewers + credits · GitHub Enterprise · SSO/SAML + audit logs · Custom security review + SLA

Contact us
FAQ

Frequently asked questions

What is the best LLM for code review?

On IonWarp's benchmark of 50 pull requests and 158 known issues, Muse Spark 1.3 had the best F1 of the models we ran, 56.6%: it found 79 issues, with 42 findings that matched none. DeepSeek V4 Pro scored 51.4% and DeepSeek V4.1 Flash, the model Code Review runs, 49.2%. The Qodo app scored higher than every model, 58.5%, and found 98.

Is the best LLM for coding also the best for code review?

We did not test that, and a coding ranking cannot say. Rankings such as LiveCodeBench grade code a model writes; this benchmark grades whether a model finds known issues in a pull request someone else wrote. Even within review the scores pull apart: GPT 5.6 Luna Pro was the most precise model here and found the fewest issues.

Which Claude model is best for code review?

We have not benchmarked Claude models as reviewers: Claude Opus 4.5 is our benchmark's grader, the judge of whether each finding matches a known issue. Factory has, with its own prompts and grader, on 50 pull requests from the same five repositories: Claude Opus 4.6 scored an F1 of 59.8% and Sonnet 4.6 57.4% (Factory, Apr 2026). Those scores don't compare directly with ours.

Which model reviews code fastest?

GPT 5.6 Luna Pro, at a median of 107 seconds a review, against 198 for Muse Spark 1.3 and 359 for DeepSeek V4 Pro. It was also the most precise, and it found the fewest issues.

Can I choose the model IonWarp uses?

Yes. Every reviewer has a pinned model on each plan, and you can switch any reviewer's model in settings. On Enterprise you can route reviews through your own AI gateway and model keys.

Which model is best for each kind of code review?

It depends on the review, and five different models lead our nine. Muse Spark 1.3 leads code review (F1 56.6%) and API performance (56.0%). GLM 5.3 Flash leads security (66.7%) and SOC 2 (66.7%, a tie with DeepSeek V4.1 Flash that goes to the cheaper model). Gemini 3.8 Flash leads logs and errors (67.7%) and docs (68.6%), DeepSeek V4.1 Flash AI architecture (47.1%) and cost (57.1%), and DeepSeek V4 Pro CI/CD (72.7%). Only the code review set has an independent answer key: the other eight cover 11 to 20 pull requests each, with provisional keys we scoped ourselves.

Sources

  1. withmartian/code-review-benchmarkMartian on GitHub · read
  2. The code review benchmark: 50 pull requests, 158 known issues (release of 2026-10-06)IonWarp benchmark · read
  3. discourse #4 (embed URL handling), graded findingsIonWarp benchmark · read
  4. calcom/cal.com #10600, graded findingsIonWarp benchmark · read
  5. Which Model Reviews Code Best? (Apr 29, 2026)Factory · read