Tirzepatide on obstructive sleep apnea-related cardiometabolic risk: secondary outcomes of the SURMOUNT-OSA randomized trial.
Malhotra A, Grunstein R, Azarbarzin A, Sands S, Somers VK, Aronne LJ, Jastreboff AM, Lou J, Chakladar S, Dunn JP, Bunck MC, Bednarik J
- DOI
- 10.1038/s41591-025-04071-1
- Record issued
- 2026-08-10
- Engine
- 7.29.0
- Exported
- 2026-09-20
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/8b4c285e-1ef3-42cc-bb0a-8cda3b637144 is authoritative.
How this rating was calculated
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- ReportingStudy design partially met−0.25★
- The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run on this paper: the pass that reads its reported means did not complete. No reported mean was checked for arithmetic impossibility.
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary efficacy claim is based on changes in surrogate biomarkers (hsCRP, lipids, fasting insulin, HOMA-IR) and blood pressure, not on hard clinical outcomes. The paper explicitly acknowledges the trials lacked power to assess hard outcomes like myocardial infarction or stroke. No validated evidence linking these specific surrogates to clinical outcomes is cited, and target engagement at the tested dose is not demonstrated beyond the observed biomarker changes.
“The studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
- 02Treatment effect not shown to be clinically meaningful
The reported effects (e.g., -7.9 mmHg SBP, -28.9% to -45.1% hsCRP, -48.0% to -54.5% HOMA-IR) are statistically significant, but the paper merely asserts they are 'clinically meaningful' without providing any minimal clinically important difference (MCID) or anchor to established thresholds. No objective criterion is given to support the clinical meaningfulness claim.
“The improvements in cardiometabolic risk measures were both statistically significant and clinically meaningful”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
The paper reports secondary analyses of two well-conducted randomized trials, with generally rigorous methods and transparent reporting. However, several reporting gaps are present: the randomization method and power analysis are not described, inclusion/exclusion criteria are only referenced, p-values are often reported as thresholds, and the ethics board is not named in the main text. These are fixable reporting issues rather than fundamental methodological flaws, but they reduce the paper's standalone completeness.
This assessment is based on three independent reviews of the same paper, with the copyedit pass and verification components (citation, statistics, reproducibility, preregistration, claim audit) integrated. The reviewers diverged on study design (pass vs. warn), ethical approvals (pass vs. warn), and statistical analysis (pass vs. warn); the synthesized judgments reflect the preponderance of evidence. The statistics verification covered only 5 recomputable tests; all were consistent, but most p-values could not be independently verified. No retracted or unfound references were identified.
Numerical inconsistencies
None foundValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
Checked — nothing surfaced.
Recomputed 5 tests: 5 consistent, 0 inconsistent; 5 via agent-written checks.
- CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 1Verify p-value for SBP ETD in study 1 using CI-based method.
“There was a significant estimated treatment difference (ETD) between tirzepatide and placebo for change in SBP from baseline at week 48 both in study 1 (−7.9 mmHg; 95% confidence interval (CI) −11.0 to −4.9; P < 0.001)”
Taken as given: The estimate is the difference in means.; The CI is a 95% two-sided confidence interval.; The test is two-sided.Method: pCI function using the estimate and 95% CI to compute the two-sided p-value.How we recomputed it: pCI(-7.9, -11.0, -4.9, 0) - CONSISTENTreported p = .005 · recomputed p = .004Reviewer 1Verify p-value for DBP ETD in study 1.
“The ETD between tirzepatide and placebo of change in DBP from baseline at week 48 was significant in study 1 (−3.2 mmHg; 95% CI −5.4 to −1.0; P = 0.005)”
Taken as given: The estimate is the difference in means.; The CI is a 95% two-sided confidence interval.; The test is two-sided.Method: pCI function using the estimate and 95% CI to compute the two-sided p-value.How we recomputed it: pCI(-3.2, -5.4, -1.0, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 2Check p-value from 95% CI for SBP change in study 1
“Change in SBP (mmHg) from baseline at week 48: −7.9 (−11.0 to −4.9); P < 0.001”
Taken as given: The CI is a two-sided 95% confidence interval based on a normal approximation.; The estimate is the least-squares mean difference.Method: pCI function from the sandbox, using the estimate and 95% CI boundaries. The p-value is extremely small, consistent with P < 0.001.How we recomputed it: pCI(-7.9, -11.0, -4.9, 0) - CONSISTENTreported p = .007 · recomputed p = .006Reviewer 2Check p-value from 95% CI for SBP change in study 2
“Change in SBP (mmHg) from baseline at week 48: −4.3 (−7.3 to −1.2); P = 0.007”
Taken as given: The CI is a two-sided 95% confidence interval based on a normal approximation.; The estimate is the least-squares mean difference.Method: pCI function. The computed p is approximately 0.006, close to the reported 0.007.How we recomputed it: pCI(-4.3, -7.3, -1.2, 0) - CONSISTENTreported p = .005 · recomputed p = .004Reviewer 2Check p-value from 95% CI for DBP change in study 1
“Change in DBP (mmHg) from baseline at week 48: −3.2 (−5.4 to −1.0); P = 0.005”
Taken as given: The CI is a two-sided 95% confidence interval based on a normal approximation.; The estimate is the least-squares mean difference.Method: pCI function. The computed p is approximately 0.0044, close to the reported 0.005.How we recomputed it: pCI(-3.2, -5.4, -1.0, 0)
Overstated conclusions
3 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
- Conclusions only partially backed by the presented evidenceAssessed
12 major claims checked against the paper's own evidence: all adequately supported.
- partialReviewers 1, 3Treating both sleep-disordered breathing and obesity is likely required to optimize the treatment effect on cardiometabolic benefits for patients with moderate-to-severe OSA and obesity.This claim is supported by the mediation analysis showing that some outcomes (e.g., non-HDL-C) require both, while others are mediated by weight alone or OSA metrics alone. The conclusion is a reasonable interpretation but is somewhat broader than the specific results.Evidence: The mediation analysis shows that for some outcomes (e.g., hsCRP, HOMA-IR, triglycerides) both weight and OSA metrics independently mediate, while for SBP only weight mediates. The paper states that the combination of weight and OSA metrics mediated non-HDL-C, but not individually. The claim is partially supported as the evidence is mixed.
“Based on the mediation analysis, treating both sleep-disordered breathing and obesity is likely required to optimize the treatment effect on cardiometabolic benefits for patients with moderate-to-severe OSA and obesity.”
DiscussionFind in source - supportedReviewer 1Tirzepatide treatment is associated with greater alleviation of cardiometabolic risk factors than placebo.This claim is supported by the significant estimated treatment differences reported for multiple outcomes in both studies.Evidence: Table 2 and the Results section report significant ETDs for SBP, DBP, hsCRP, HDL-C, non-HDL-C, triglycerides, LDL-C, VLDL-C, fasting insulin, and HOMA-IR in at least one study.
“There was a significant estimated treatment difference (ETD) between tirzepatide and placebo for change in SBP from baseline at week 48 both in study 1 (−7.9 mmHg; 95% confidence interval (CI) −11.0 to −4.9; P < 0.001) and in study 2 (−4.3 mmHg; 95% CI −7.3 to −1.2; P = 0.007).”
AbstractFind in source - supportedReviewer 1Independent mediation effect of changes in OSA metrics was observed on hsCRP, HOMA-IR, and triglycerides.The mediation analysis shows that the proportion mediated by AHI and SASHB alone is statistically significant for these three outcomes.Evidence: Figure 2 and the Mediation analysis section report that the proportion mediated by changes in AHI and SASHB is significant for hsCRP, HOMA-IR, and triglycerides.
The tirzepatide-associated change in hsCRP was significantly mediated by ... by changes in OSA metrics AHI and SASHB. The tirzepatide-associated change in triglycerides was significantly mediated by ... by changes in OSA metrics AHI and SASHB. The tirzepatide-associated change in HOMA-IR was significantly mediated by ... by change in OSA metrics AHI and SASHB.
Resultsreviewer’s wording - supportedReviewer 1The combination of changes in weight and OSA metrics had a significant mediation effect on SBP, but weight alone also had a significant mediation effect, whereas OSA metrics alone did not.The mediation analysis results match the claim: combined effect and weight alone are significant, but OSA metrics alone are not.Evidence: Figure 2 and the text state that the proportion mediated by the combined effect and by weight alone is significant for SBP, while the proportion mediated by AHI and SASHB alone is not.
The tirzepatide effect on SBP was significantly mediated by combined effect of changes in body weight, AHI and SASHB, and by change in body weight alone. However, the proportion mediated by changes in OSA metrics, AHI and SASHB alone, was not statistically significant.
Resultsreviewer’s wording - supportedReviewer 1No significant mediation effect of weight or OSA metrics was observed on DBP.The mediation analysis shows no significant mediation for DBP by any of the tested mediators.Evidence: Figure 2 and the text report that the proportions mediated by combined effect, weight alone, and OSA metrics alone are not statistically significant for DBP.
The proportions of tirzepatide-associated change in DBP mediated by combined effect of changes in body weight, AHI and SASHB or effects of any of the mediators alone were not statistically significant.
Resultsreviewer’s wording - supportedReviewers 2, 3Tirzepatide treatment was associated with greater alleviation of cardiometabolic risk factors than placebo.The paper presents multiple prespecified and post-hoc analyses showing statistically significant improvements in SBP, DBP, hsCRP, lipid profile, fasting insulin, and HOMA-IR with tirzepatide vs placebo.Evidence: Table 2 reports ETD with 95% CIs and p-values for all outcomes; most show significant differences favoring tirzepatide.
“In both study 1 and study 2 of SURMOUNT-OSA, tirzepatide treatment was associated with greater alleviation of cardiometabolic risk factors than placebo.”
Table 2Find in source - supportedReviewer 2Changes in AHI and SASHB significantly mediated reductions in hsCRP, HOMA-IR, and triglycerides.The mediation analysis shows that the indirect effect through AHI and SASHB is statistically significant for these outcomes, as reported in Figure 2 and the text.Evidence: Figure 2 shows the proportion mediated by AHI and SASHB alone with 95% CIs that do not cross zero for hsCRP, HOMA-IR, and triglycerides.
The tirzepatide-associated change in hsCRP was significantly mediated by ... changes in OSA metrics AHI and SASHB.
Figure 2reviewer’s wording - supportedReviewer 2The combination of weight and OSA metrics significantly mediated reductions in non-HDL cholesterol.The mediation analysis shows that the combined effect of changes in body weight, AHI, and SASHB is significant for non-HDL-C, while weight alone or OSA metrics alone are not significant.Evidence: Figure 2 shows the proportion mediated by the combined effect is significant (95% CI does not cross zero), but single mediators are not.
“The tirzepatide-associated change in non-HDL-C was significantly mediated by combined effect of changes in body weight, AHI and SASHB.”
Figure 2Find in source - supportedReviewer 2Weight alone mediated SBP, but OSA metrics alone did not.The mediation analysis shows that the indirect effect through weight alone is significant for SBP, while the effect through AHI and SASHB alone is not significant.Evidence: Figure 2 shows the proportion mediated by weight alone is significant, while the proportion mediated by AHI and SASHB alone is not significant (CI includes zero).
the tirzepatide effect on SBP was significantly mediated by ... change in body weight alone. However, the proportion mediated by changes in OSA metrics, AHI and SASHB alone, was not statistically significant.
Figure 2reviewer’s wording - supportedReviewer 2The optimal treatment for OSA and obesity should address both conditions.The paper concludes that treating both OSA and obesity is required to optimize cardiometabolic benefits, supported by the mediation analysis showing independent contributions of weight and OSA metrics for some outcomes.Evidence: The discussion integrates the mediation results and prior literature to support this conclusion.
“the findings may represent important information for clinical decision making on therapy of patients with OSA and obesity.”
Discussion ¶8Find in source - supportedReviewer 3Independent mediation effect of changes in OSA metrics was observed on hsCRP, HOMA-IR and triglycerides.The mediation analysis reports statistically significant proportions mediated by AHI and SASHB for hsCRP, HOMA-IR and triglycerides.Evidence: Mediation analysis results: 'The tirzepatide-associated change in hsCRP was significantly mediated by ... changes in OSA metrics AHI and SASHB' (likewise triglycerides and HOMA-IR).
“Independent mediation effect of changes in OSA metrics was observed on high-sensitivity C-reactive protein, homeostatic model assessment for insulin resistance and triglycerides.”
AbstractFind in source - supportedReviewer 3Weight and combined weight+OSA changes, but not OSA metrics alone, significantly mediated the tirzepatide effect on systolic blood pressure; no significant mediation was observed on diastolic blood pressure.The mediation results state SBP was significantly mediated by combined weight/AHI/SASHB and by weight alone, with no significant OSA-metrics-alone effect and no significant mediation of DBP by any mediator.Evidence: Mediation analysis: 'the tirzepatide effect on SBP was significantly mediated by combined effect of changes in body weight, AHI and SASHB, and by change in body weight alone' and DBP proportions 'were not statistically significant'.
“The combination of changes in weight and OSA metrics, as well as weight alone, had a significant mediation effect on systolic blood pressure, but there was no significant mediation effect of weight or OSA metrics observed on diastolic blood pressure.”
AbstractFind in source
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary efficacy claim is based on changes in surrogate biomarkers (hsCRP, lipids, fasting insulin, HOMA-IR) and blood pressure, not on hard clinical outcomes. The paper explicitly acknowledges the trials lacked power to assess hard outcomes like myocardial infarction or stroke. No validated evidence linking these specific surrogates to clinical outcomes is cited, and target engagement at the tested dose is not demonstrated beyond the observed biomarker changes.
“The studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
- INADEQUATEEffect sizeThe reported effects (e.g., -7.9 mmHg SBP, -28.9% to -45.1% hsCRP, -48.0% to -54.5% HOMA-IR) are statistically significant, but the paper merely asserts they are 'clinically meaningful' without providing any minimal clinically important difference (MCID) or anchor to established thresholds. No objective criterion is given to support the clinical meaningfulness claim.
“The improvements in cardiometabolic risk measures were both statistically significant and clinically meaningful”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Study-design details incomplete (controls, blinding, power)Assessed
The introduction cites relevant literature on OSA-related cardiovascular risk, the limitations of PAP therapy, the role of obesity, and the effects of tirzepatide on weight and glucose control. It then formulates a clear hypothesis and addresses limitations of prior research such as the lack of consistent cardiovascular benefits with PAP. All three sub-criteria are adequately reported.
“Based on this conceptual framework and including a complete set of study prespecified cardiometabolic endpoints, we sought to test the hypothesis that tirzepatide treatment in the SURMOUNT-OSA studies would yield improvement in cardiometabolic risk measures as compared to placebo.”
“we sought to test the hypothesis that tirzepatide treatment in the SURMOUNT-OSA studies would yield improvement in cardiometabolic risk measures as compared to placebo.”
“randomized trials so far have not demonstrated significant effect of PAP therapy on major cardiovascular outcomes”
“Based on this conceptual framework and including a complete set of study prespecified cardiometabolic endpoints, we sought to test the hypothesis that tirzepatide treatment in the SURMOUNT-OSA studies would yield improvement in cardiometabolic risk measures as compared to placebo.”
“The results lead to questions about how much of the cardiometabolic benefits associated with tirzepatide are related to improvement in OSA severity per se versus improvement in body weight.”
The paper states that participants were randomly assigned in a 1:1 ratio but does not specify the method (e.g., computer-generated random numbers). No a priori power or sample size calculation is provided. Inclusion/exclusion criteria are referenced to a previous publication, and the handling of missing data is described. Blinding is adequately reported. Overall, 3 of 6 applicable sub-criteria are adequate.
“Participants were randomly assigned in a 1:1 ratio to receive either tirzepatide at the maximum tolerated dose (10 or 15 mg) or placebo once weekly.”
“The SURMOUNT-OSA master protocol comprised two, 52-week, randomized, double-blind, placebo-controlled phase 3 studies”
“Participants were randomly assigned in a 1:1 ratio to receive either tirzepatide at the maximum tolerated dose (10 or 15 mg) or placebo once weekly.”
“randomized, double-blind, placebo-controlled phase 3 studies”
“Participants were randomly assigned in a 1:1 ratio to receive either tirzepatide at the maximum tolerated dose (10 or 15 mg) or placebo once weekly.”
“the two studies’ full design, key eligibility criteria, procedures and primary efficacy and safety results have been published previously”
“missing values were imputed using multiple imputation based on the reason of intercurrent events.”
“the studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
The paper provides a comprehensive baseline table (Table 1) with demographics (age, sex, BMI, OSA severity, hypertension, prediabetes, etc.). Both sexes are enrolled, and the proportion is reported. Sex-justified is not applicable as both sexes are included. Age, weight (BMI), and health status are reported. Species/strain and housing conditions are not applicable for a human study.
“Participants were screened and enrolled irrespective of their sex. Sex was self-reported by participants.”
“Age, years | 47.3±11.0 | 48.4±11.9 | 47.9±11.5”
The paper states that the study was approved by ethics review boards at each site (referenced to supplementary), that participants or their representatives signed informed consent, and that the study was conducted in accordance with the Declaration of Helsinki and other applicable guidelines. All three applicable sub-criteria are reported and adequate.
“Participants or their legally authorized representatives signed a statement of informed consent that meets the requirements of 21 Code of Federal Regulations 50, local regulations, ICH guidelines, privacy and data protection requirements, where applicable, and the IRB/IEC or study center.”
“This study was conducted in accordance with consensus ethical principles derived from international guidelines including the Declaration of Helsinki and Council for International Organizations of Medical Sciences International Ethics Guidelines, applicable ICH GCP Guidelines, International Organization for Standardization (ISO) 14155 and applicable laws and regulations.”
“The study was approved by ethics review boards at each site, presented in .”
“Participants or their legally authorized representatives signed a statement of informed consent that meets the requirements of 21 Code of Federal Regulations 50, local regulations, ICH guidelines, privacy and data protection requirements, where applicable, and the IRB/IEC or study center.”
“This study was conducted in accordance with consensus ethical principles derived from international guidelines including the Declaration of Helsinki and Council for International Organizations of Medical Sciences International Ethics Guidelines, applicable ICH GCP Guidelines, International Organization for Standardization (ISO) 14155 and applicable laws and regulations.”
“Participants or their legally authorized representatives signed a statement of informed consent that meets the requirements of 21 Code of Federal Regulations 50”
“This study was conducted in accordance with consensus ethical principles derived from international guidelines including the Declaration of Helsinki and Council for International Organizations of Medical Sciences International Ethics Guidelines, applicable ICH GCP Guidelines, International Organization for Standardization (ISO) 14155 and applicable laws and regulations.”
The drug name, dose, and manufacturer (Eli Lilly) are provided. Statistical software (SAS version 9.3, R version 4.1.2, package 'CMAverse' version 0.1.0) is identified. No antibodies, cell lines, or experimental animals are used, so those sub-criteria are not applicable.
“Participants were randomly assigned in a 1:1 ratio to receive either tirzepatide at the maximum tolerated dose (10 or 15 mg) or placebo once weekly.”
“tirzepatide at the maximum tolerated dose (10 or 15 mg) or placebo once weekly”
“Statistical analyses were performed using SAS version 9.3.”
“The mediation analyses were performed using the ‘CMAverse’ package version 0.1.0 in R version 4.1.2”
The paper specifies mixed model repeated measures and mediation analysis with natural effect models. All estimates are reported with 95% CIs and exact p-values (e.g., P < 0.001, P = 0.007). SAS and R versions are given. Data presentation includes LS means ± SE and per-group n. Assumptions are not explicitly tested but are handled by the pre-specified analysis model. Mathematical plausibility is not applicable due to continuous outcomes and large N. All applicable sub-criteria are adequate.
“There was a significant estimated treatment difference (ETD) between tirzepatide and placebo for change in SBP from baseline at week 48 both in study 1 (−7.9 mmHg; 95% confidence interval (CI) −11.0 to −4.9; P < 0.001) and in study 2 (−4.3 mmHg; 95% CI −7.3 to −1.2; P = 0.007).”
“The mixed model repeated measures analysis, a restricted-maximum-likelihood-based model, was used to analyze continuous longitudinal variables.”
“The mixed model repeated measures analysis, a restricted-maximum-likelihood-based model, was used to analyze continuous longitudinal variables.”
“change in SBP from baseline at week 48 both in study 1 (−7.9 mmHg; 95% confidence interval (CI) −11.0 to −4.9; P < 0.001)”
“Statistical analyses were performed using SAS version 9.3.”
The paper includes a detailed data availability statement describing that individual participant data are available after anonymization through a proposal process managed by a review committee via Vivli. Source data are provided with the paper. No custom code was used; all analyses were performed with standard software packages. All applicable sub-criteria are adequate.
“No novel code was used for data analysis in the current study.”
“Lilly provides access to all individual participant data collected during the trial, after anonymization, with the exception of pharmacokinetic or genetic data. Data are available to request 6 months after the indication studied has been approved in the USA and European Union and after primary publication acceptance, whichever is later. No expiration date of data requests is currently set once data are made available. Access is provided after a proposal has been approved by an independent review committee identified for this purpose and after receipt of a signed data sharing agreement. Data and documents, including the clinical study report, blank or annotated case report forms, will be provided in a secure data sharing environment. For details on submitting a request, see the instructions provided at www.vivli.org”
“No novel code was used for data analysis in the current study.”
“Access is provided after a proposal has been approved by an independent review committee identified for this purpose and after receipt of a signed data sharing agreement.”
“Data are available to request 6 months after the indication studied has been approved in the USA and European Union and after primary publication acceptance, whichever is later.”
“No novel code was used for data analysis in the current study.”
The trial is registered at ClinicalTrials.gov (NCT05412004). The Nature Portfolio Reporting Summary is linked. All prespecified and post hoc outcomes are reported, including non-significant results. Limitations are discussed in a dedicated paragraph. Conclusions are proportional to the evidence. Funding and competing interests are fully disclosed. All applicable sub-criteria are adequate.
“Despite the strengths of the studies, we acknowledge a number of limitations. First, the studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
“The ClinicalTrials.gov (http://ClinicalTrials.gov) registration number for this study is NCT05412004”
“Despite the strengths of the studies, we acknowledge a number of limitations. First, the studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
“The ClinicalTrials.gov (http://ClinicalTrials.gov) registration number for this study is NCT05412004”
“Further information on research design is available in the Nature Portfolio Reporting Summary linked to this Article.”
“the studies did not have sufficient duration of follow-up or statistical power to examine the impact of tirzepatide on cardiometabolic outcomes such as myocardial infarction or stroke.”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
None foundReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Checked — nothing surfaced.
Checked 42 references by DOI: 40 verified — 2 no DOI (shown, not verified).
- NO DOIPractice parameters for the medical therapy of obstructive sleep apneaNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIEffect of CPAP therapy on serum lipids and blood pressure in patients with obstructive sleep apnea syndromeNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
3 data/code links checked; 3 live.
- datahttp://www.vivli.orgLIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT05412004LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://doi.org/10.1038/s41591-025-04071-1LIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
4 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 4 minor suggestions below.
4 copyedit issues flagged: mostly consistency, clarity, typo.
- MINORconsistencyAbstract“post hoc analyses include changes in a homeostatic model assessment for insulin resistance”→ Post hoc analyses include changes in homeostatic model assessment for insulin resistance (remove 'a')Minor grammatical fix for clarity.
- MINORclarityMethods, Statistical analysis“All the longitudinal observations at each scheduled postbaseline visit were included in the analysis.”→ All longitudinal observations at each scheduled post-baseline visit were included in the analysis.Conventional hyphenation of 'post-baseline'.
- MINORconsistencyTable 1 footnote“The data are mean±s.d. unless otherwise specified.”→ Consistently use 'mean ± s.d.' with spaces.Hyphenation is acceptable but spaces improve readability.
- MINORtypoCompeting interests“ResMed gave a philanthropic donation to USCD.”→ ResMed gave a philanthropic donation to UCSD.'USCD' is a transposition of the institution abbreviation 'UCSD' (University of California San Diego).
This is a post-publication robustness assessment. The published work is generally robust, but an informed reader should note the following gaps that reduce methodological transparency: the randomization method is not described, no power analysis is provided for the secondary outcomes, inclusion/exclusion criteria are not fully restated, p-values are partially reported as thresholds, and the ethics board is not named in the main text. These issues do not invalidate the conclusions but would warrant a correction or erratum to address the most critical gaps (randomization method, power analysis, ethics board name). An independent re-analysis would benefit from the detailed data availability statement.
- 1.HIGHreportingIn the Methods section (Study design, procedures and participants), specify the randomization method (e.g., computer-generated random numbers, block size, stratification factors) to meet the randomization_method sub-criterion.The current statement 'randomly assigned in a 1:1 ratio' is insufficient for replication assessment; the method is a standard reporting requirement for RCTs.
- 2.HIGHreportingIn the Methods (Statistical analysis) or Discussion (Limitations), include a clear statement about the lack of a priori power analysis for these secondary outcomes, or reference the primary study's power calculation and note that these analyses are exploratory.The absence of a power analysis for the reported outcomes reduces the reader's ability to interpret the statistical precision of the estimates.
- 3.HIGHreportingIn the Methods (Ethics and informed consent), name the specific ethics review board(s) that approved the study and provide the protocol approval number, rather than only referencing supplementary material.A clear ethics approval statement in the main text is a standard reporting requirement and improves transparency.
- 4.MEDIUMreportingIn the Methods (Study design, procedures and participants), restate the full key inclusion and exclusion criteria rather than solely referencing the prior publication.The paper should be self-contained for readers who do not have access to the primary publication, and the criteria are essential for understanding the study population.
- 5.MEDIUMstatisticsIn the Results (Table 2 and text), replace threshold p-values (e.g., 'P < 0.001') with exact p-values (e.g., 'P = 0.0003') where the software output provides them, to improve precision.Exact p-values allow readers to assess the strength of evidence more precisely than threshold reporting.
- 6.MEDIUMreportingIn the baseline table (Table 1), add race/ethnicity data to complete the demographic reporting.Race/ethnicity is a standard demographic variable in human studies and its absence limits the generalizability assessment.
- 7.LOWreportingIn the Methods (Statistical analysis), clarify the SAS version used (9.3 vs. 9.4) to resolve the discrepancy between reviewers.Inconsistent reporting of software version could confuse readers attempting to replicate the analyses.
- 8.LOWcopyeditIn the Competing interests section, correct the typo 'USCD' to 'UCSD' (University of California San Diego).This is a factual error in an institutional abbreviation that should be corrected.
- 9.LOWcopyeditIn the Abstract, remove the article 'a' in 'changes in a homeostatic model assessment for insulin resistance' to read 'changes in homeostatic model assessment for insulin resistance'.Grammatical correction for clarity.
- 10.LOWcopyeditIn the Methods (Statistical analysis), hyphenate 'post-baseline' consistently (change 'postbaseline' to 'post-baseline' or vice versa).Consistent hyphenation improves readability.
- 11.LOWcopyeditIn Table 1 footnote, use 'mean ± s.d.' with spaces around the plus-minus sign for consistency.Consistent formatting improves readability.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.