Rigor Reviewed

Rigor-Reviewed Manuscript

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Name: Αlpha¹ Rigor Record — Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.
Item: Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.
Rating: 100
Author: Αlpha¹

Zhou C, Dong X, Chen G, Wang Z, Wu X, Yao Y, Zhang Y, Cheng Y, Pan H, Zhang X, Cui J, Wang L, Chen X, Li X, Wang Z, Wang Q, He J, Wang M, Yan I, Qian L, Xu M, Huang X, Sun C, Cai J, Wu Q, Ballinger M, Kaul M, Srivastava MK

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2★ (Weak), 0 critical, 3 high issues for “Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
CitationsCitations & links (capped) ×9−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Problems surfaced5 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 3 randomized controlled trial with rigorous design, clear reporting of ethics, biological variables, and statistical methods. The primary endpoint was negative, but the paper transparently reports this and discusses limitations. Minor reporting issues include an incorrect trial registration number in the abstract and a few clarity/consistency issues.

Both reviewers agreed on study type (interventional) and all dimension statuses. The only divergence was on scientific premise's limitations addressed, which was resolved by weighing the explicit discussion in the Discussion section. The statistics verification covered only 3 tests; the rest are unverified. The citation check flagged 9 references not found in registries, which are addressed in action items.

6 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 3 tests: 3 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 2 via agent-written checks.

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions8 pass

The introduction cites the IMpower150 trial and its results, and explains the rationale for IMpower151 based on regional differences in patient characteristics and clinical practice. The study objectives and hypothesis follow logically from the cited evidence. Limitations of prior research are addressed by noting differences in patient populations and treatment backbones.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

“The phase 3 IMpower150 study (NCT02366143) met both of its primary endpoints, demonstrating significant progression-free survival (PFS) and overall survival (OS) improvement with atezolizumab versus placebo combined with bevacizumab plus carboplatin and paclitaxel (ABCPac versus BCPac) in patients with metastatic nonsquamous (nsq) NSCLC without EGFR or ALK genomic alterations.”

paraphrase[Main, paragraph 2]

“To address regional differences in patients’ genomic composition and clinical practice, the phase 3 IMpower151 study (NCT04194203) was conducted in China to evaluate the efficacy and safety of atezolizumab plus bevacizumab, carboplatin and pemetrexed or paclitaxel (ABCPem/Pac) versus placebo plus bevacizumab, carboplatin and pemetrexed or paclitaxel (BCPem/Pac) as a first-line treatment of metastatic nsqNSCLC regardless of sensitizing EGFR/ALK genomic alterations.”

paraphrase[Discussion, paragraph 2]

“IMpower151 was conducted in China and all enrolled patients were Asian, whereas IMpower150 took place in 26 countries globally and 14% and 12% of patients in the ABCPac (n = 400) and BCPac (n = 400) arms, respectively, were Asian.”

PASSReviewer 2· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

paraphrase[Main, paragraph 2]

absence[Main, paragraph 1-2]

Limitations of prior research are not explicitly discussed as such.

The trial is described as randomized, double-blind, and placebo-controlled. Randomization method (stratified block method with block size of four) and unit (patient) are stated. Blinding of patients, site personnel, and sponsor is described. A power analysis is provided with assumptions. Inclusion/exclusion criteria are detailed. Outlier handling is addressed through pre-specified analysis populations and missing data handling. Controls are the placebo arm. Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with clear randomization, blinding, power analysis, and inclusion/exclusion criteria.

Evidence

direct quote[Methods, Procedures and interventions]

“Enrolled patients were randomized 1:1 to the ABCPem/Pac or BCPem/Pac arms using a stratified block method (block size of four).”