Starter
Try AI PR review.
- 2 reviewers
- Code Review
- Security Review
- 3 seats included
- 15,000 credits to start, then 5,000/mo
- About 70 reviews to start, then about 25 a month
- Unlimited repos
GLM 5.3 Flash was the cheapest model in every benchmark we ran it on. IonWarp runs it for Cost Review, and a failed Security Review or SOC 2 Review run retries on it. It reviewed the same public pull requests as DeepSeek, Muse Spark, GPT and Gemini models, and a model grader matched every finding to a known issue (how the benchmarks work).
What lands on your pull request · Code Review
billing/checkout.ts:42 · A timed-out response can charge the order twice- await payments.charge(order);+ await payments.charge(order, {+ idempotencyKey: order.id,+ });
Its best result is on security. On 13 pull requests with 18 known security issues, GLM 5.3 Flash scored an F1 of 66.7% for about a cent a review, ahead of Grok 4.6 (53.3%) and Gemini 3.8 Flash (51.6%), which cost 44 and 49 times as much.[1] It trails on general code review, at 42.8% on 50 pull requests against 49.2% for DeepSeek V4.1 Flash.[2]
10 of 18 known issues found, with 2 that matched none, for about a cent a review. Only the Qodo app scored higher, 73.3%.[1]
Security ReviewOn Starter, Pro and Max
GLM 5.3 Flash and DeepSeek V4.1 Flash both scored 66.7% on 20 pull requests with 15 known control gaps. GLM found 11 in a median 34 seconds for about a cent; DeepSeek found 13 in six minutes.[3]
SOC 2 ReviewOn Max
48.3% on 18 pull requests. In Grafana #97529, moving a lock let several goroutines build the same expensive index at once; GLM flagged it, and Gemini 3.8 Flash, GPT 5.6 Luna Pro and Muse Spark 1.3 did not.[4] The apps lead this set: Greptile scored 76.9%.[5]
API PerformanceOn Max
55.2% on 20 pull requests for about 1.4 cents, against 57.1% for DeepSeek V4.1 Flash at 7 cents.[6] In PostHog's Python SDK (#346), a cache-token subtraction meant for Anthropic ran for every provider and undercounted OpenAI input tokens. Of the three models we ran, only GLM flagged it.[7]
Cost ReviewOn Pro and Max
36.1% on 17 log and error pull requests, fourth of five models,[8] and 15.4% on the 11-pull-request AI architecture set.[9]
| Review | Model | F1 | Precision | Recall | $ per review | Median time | Rank |
|---|---|---|---|---|---|---|---|
| Code Review50 of 50 PRs | GLM 5.3 Flash | 42.8% | 50.0% | 37.3% | $0.02 | 2m 15s | 4 of 5 |
| Security Review13 of 13 PRs | GLM 5.3 Flash | 66.7% | 83.3% | 55.6% | $0.01 | 1m 38s | 1 of 7 |
| AI Architecture Review11 of 11 PRs | GLM 5.3 | 47.1% | 36.4% | 66.7% | $0.07 | 1m 29s | 2 of 8 |
| AI Architecture Review11 of 11 PRs | GLM 5.3 Flash | 15.4% | 14.3% | 16.7% | $0.01 | 1m 2s | 8 of 8 |
| Log & Errors Review17 of 17 PRs | GLM 5.3 Flash | 36.1% | 36.7% | 35.5% | $0.01 | 1m 14s | 4 of 5 |
| API Performance Review18 of 18 PRs | GLM 5.3 Flash | 48.3% | 43.8% | 53.8% | <$0.01 | 49 sec | 5 of 6 |
| SOC 2 Review20 of 20 PRs | GLM 5.3 Flash | 66.7% | 61.1% | 73.3% | $0.01 | 34 sec | 1 of 5 |
| CI/CD Performance18 of 18 PRs | GLM 5.3 Flash | 55.0% | 40.7% | 84.6% | <$0.01 | 50 sec | 3 of 5 |
| Cost Review20 of 20 PRs | GLM 5.3 Flash | 55.2% | 53.3% | 57.1% | $0.01 | 2m 23s | 2 of 3 |
Rank is among the models we ran on that review, by F1; a tie goes to the cheaper one. See the benchmark
One workspace price with seats included. Credits pool across your team. Unlimited repos on every plan.
Try AI PR review.
Get AI PR review right from day 1.
Scale AI PR review.
Custom reviewers + credits · GitHub Enterprise · SSO/SAML + audit logs · Custom security review + SLA
For some reviews. GLM 5.3 Flash was the best model we ran on security and tied for first on SOC 2, at about a cent a review. On general code review, logs and AI architecture, other models scored higher.
On our benchmarks GLM is cheaper and faster, and scores higher on security (66.7% to 62.5%). DeepSeek V4.1 Flash scores higher on code review (49.2% to 42.8%) and on logs (59.0% to 36.1%). IonWarp runs DeepSeek for most reviewers and GLM for Cost Review.
In model fees on our benchmarks, GLM 5.3 Flash cost from about a quarter of a cent a review on CI/CD to about 2 cents on general code review. IonWarp plans include the model cost: Pro is $49/mo for the workspace.
GLM 5.3 Flash on eight of our nine review types (all but docs). We also ran the larger GLM 5.3 on AI architecture, where it tied DeepSeek V4.1 Flash at 47.1%; GLM 5.3 Flash scored 15.4% there.