Rigor Reviewed

Rigor-Reviewed Manuscript

Tirzepatide on obstructive sleep apnea-related cardiometabolic risk: secondary outcomes of the SURMOUNT-OSA randomized trial.

Name: Αlpha¹ Rigor Record — Tirzepatide on obstructive sleep apnea-related cardiometabolic risk: secondary outcomes of the SURMOUNT-OSA randomized trial.
Item: Tirzepatide on obstructive sleep apnea-related cardiometabolic risk: secondary outcomes of the SURMOUNT-OSA randomized trial.
Rating: 39
Author: Αlpha¹

Malhotra A, Grunstein R, Azarbarzin A, Sands S, Somers VK, Aronne LJ, Jastreboff AM, Lou J, Chakladar S, Dunn JP, Bunck MC, Bednarik J

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 1★ (Critical), 3 critical, 0 high issues for “Tirzepatide on obstructive sleep apnea-related cardiometabolic risk: secondary outcomes of the SURMOUNT-OSA randomized trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic ×3−3★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped) ×7−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 36 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Problems surfaced6 types

Numerical inconsistencies3

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

Critical findings

• PERCENT: 70.6% does not match the reported count 84/120
• PERCENT: 65.8% does not match the reported count 75/115
• PERCENT: 68.2% does not match the reported count 159/235

This is a well-conducted secondary analysis of two phase 3 randomized trials, with strong reporting of design, ethics, biological variables, and data availability. The main weaknesses are minor reporting gaps: exact p-values are often given as thresholds, the randomization method and power analysis for secondary outcomes are not detailed, and a few copyedit issues exist.

Both reviewers classified the study as interventional, which is appropriate given the randomized controlled trial design. The evaluation covered the full text, with verification components for citations, statistics, reproducibility, and preregistration. Non-applicable sub-criteria (e.g., animal housing, cell lines) were excluded. The statistics verification could only recompute a subset of tests; most p-values were threshold-only and not machine-verifiable, so no claim of statistical correctness is made.

4 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks. 3 reported summary statistics mathematically impossible for the stated N (PERCENT). 7 printed percentages that do not match their own count.

1 integrity concern flagged (0 high).

Reporting

Eight Dimensions8 pass

The introduction cites prior work on OSA and cardiovascular risk, the limitations of PAP therapy, and the rationale for tirzepatide. It explicitly states the hypothesis and the need to assess cardiometabolic outcomes beyond the primary AHI endpoint. The limitations of prior research are acknowledged, such as the lack of consistent cardiovascular benefits from PAP and the need to understand the relative contributions of weight loss and OSA improvement.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior research on OSA, obesity, and tirzepatide, and logically links this to the study objectives and hypothesis.

Evidence

paraphrase[Introduction, paragraph 1-3]

“The results of the SURMOUNT-OSA program studies were recently published, demonstrating tirzepatide treatment to be superior to placebo in participants not using PAP therapy (study 1) as well as those using PAP therapy (study 2).”

direct quote[Introduction, paragraph 4]

“we sought to test the hypothesis that tirzepatide treatment in the SURMOUNT-OSA studies would yield improvement in cardiometabolic risk measures as compared to placebo.”