Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Name: Kaimen Rigor review — Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.
Item: Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.
Rating: 100
Author: Alpha1

Zhou C, Dong X, Chen G, Wang Z, Wu X, Yao Y, Zhang Y, Cheng Y, Pan H, Zhang X, Cui J, Wang L, Chen X, Li X, Wang Z, Wang Q, He J, Wang M, Yan I, Qian L, Xu M, Huang X, Sun C, Cai J, Wu Q, Ballinger M, Kaul M, Srivastava MK

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2★ (Weak), 0 critical, 3 high issues for “Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Read full text (PMC)

DOI

10.1038/s41591-025-03658-y

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/f687ab6a-f127-4374-ba47-85f58889c554" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/f687ab6a-f127-4374-ba47-85f58889c554/badge" alt="Kaimen Rigor review — 2★ (Weak), 0 critical, 3 high issues for “Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

f6c4ad16b71a10f03707a34142b9b65753fba23b13db45746da07e382064b467

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Paper source

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
CitationsCitations & links (capped) ×9−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is investigator-assessed progression-free survival (INV-PFS), a surrogate for overall survival. The trial did not demonstrate a statistically significant improvement in PFS (HR 0.84, P=0.184), and the paper does not provide evidence of target engagement at the tested dose or a validated link between PFS and clinical benefit in this context. The efficacy claim is based on a surrogate without meeting the criteria for adequacy.
“The primary endpoint was investigator-assessed progression-free survival (INV-PFS); ... Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect size is a hazard ratio of 0.84 for PFS, which is not statistically significant and is below the minimal clinically important difference typically considered for PFS in NSCLC. The paper does not anchor the effect to a clinically meaningful threshold, and the OS HR is 0.93 with no significant benefit. The effect size is not presented as clinically material.
“Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit7 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 3 randomized controlled trial with rigorous design, clear reporting of ethics, biological variables, and statistical methods. The primary endpoint was negative, but the paper transparently reports this and discusses limitations. Minor reporting issues include an incorrect trial registration number in the abstract and a few clarity/consistency issues.

Both reviewers agreed on study type (interventional) and all dimension statuses. The only divergence was on scientific premise's limitations addressed, which was resolved by weighing the explicit discussion in the Discussion section. The statistics verification covered only 3 tests; the rest are unverified. The citation check flagged 9 references not found in registries, which are addressed in action items.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 2 via agent-written checks.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

None found

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Checked — nothing surfaced.

Eight Dimensions8 pass

The introduction cites the IMpower150 trial and its results, and explains the rationale for IMpower151 based on regional differences in patient characteristics and clinical practice. The study objectives and hypothesis follow logically from the cited evidence. Limitations of prior research are addressed by noting differences in patient populations and treatment backbones.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

“The phase 3 IMpower150 study (NCT02366143) met both of its primary endpoints, demonstrating significant progression-free survival (PFS) and overall survival (OS) improvement with atezolizumab versus placebo combined with bevacizumab plus carboplatin and paclitaxel (ABCPac versus BCPac) in patients with metastatic nonsquamous (nsq) NSCLC without EGFR or ALK genomic alterations.”

paraphrase[Main, paragraph 2]

“To address regional differences in patients’ genomic composition and clinical practice, the phase 3 IMpower151 study (NCT04194203) was conducted in China to evaluate the efficacy and safety of atezolizumab plus bevacizumab, carboplatin and pemetrexed or paclitaxel (ABCPem/Pac) versus placebo plus bevacizumab, carboplatin and pemetrexed or paclitaxel (BCPem/Pac) as a first-line treatment of metastatic nsqNSCLC regardless of sensitizing EGFR/ALK genomic alterations.”

paraphrase[Discussion, paragraph 2]

“IMpower151 was conducted in China and all enrolled patients were Asian, whereas IMpower150 took place in 26 countries globally and 14% and 12% of patients in the ABCPac (n = 400) and BCPac (n = 400) arms, respectively, were Asian.”

PASSReviewer 2· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

paraphrase[Main, paragraph 2]

absence[Main, paragraph 1-2]

Limitations of prior research are not explicitly discussed as such.

The trial is described as randomized, double-blind, and placebo-controlled. Randomization method (stratified block method with block size of four) and unit (patient) are stated. Blinding of patients, site personnel, and sponsor is described. A power analysis is provided with assumptions. Inclusion/exclusion criteria are detailed. Outlier handling is addressed through pre-specified analysis populations and missing data handling. Controls are the placebo arm. Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with clear randomization, blinding, power analysis, and inclusion/exclusion criteria.

Evidence

“Enrolled patients were randomized 1:1 to the ABCPem/Pac or BCPem/Pac arms using a stratified block method (block size of four).”

MethodsFind in source

“Study site personnel and patients were blinded to treatment assignment during the study. The sponsor and its agents were also blinded to treatment assignment, except for individuals who required access to fulfill their job roles during a clinical trial.”

MethodsFind in source

paraphrase[Methods, Statistical analyses]

“IMpower151 was planned to randomize approximately 306 patients, assuming a 1:1 randomization ratio, one-sided significance level of 0.025, a dropout rate of 5% per 12 months for PFS, 90% power to detect an HR of 0.65 (corresponding to an improvement in median PFS from 6.8 to 10.5 months in the ITT population) and exponentially distributed event times.”

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, with a pre-specified sample size calculation, stratification, and clear inclusion/exclusion criteria.

Evidence

“Enrolled patients were randomized 1:1 to the ABCPem/Pac or BCPem/Pac arms using a stratified block method (block size of four).”

MethodsFind in source

paraphrase[Methods, Statistical analyses]

Sex is reported for both arms. Age is reported as median and range. Demographics include tobacco use, ECOG PS, PD-L1 expression, EGFR mutation status, and metastasis sites. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human clinical trial, including sex, age, and demographics.

Evidence

paraphrase[Table 1]

“Sex, n (%): Female 62 (40.8) | 62 (40.5); Male 90 (59.2) | 91 (59.5)”

paraphrase[Table 1]

“Median age (range), yr: 61 (30–76) | 61 (31–75)”

“Of the patients, 59% were male, 51% never smoked and 81% had an Eastern Cooperative Oncology Group performance status (ECOG PS) of 1.”

ResultsFind in source

PASSReviewer 2· 90% conf

Sex, age, and key demographics are reported; sex is not justified as single-sex because both sexes are enrolled.

Evidence

paraphrase[Table 1]

“Sex, n (%) | Female | 62 (40.8) | 62 (40.5) | | Male | 90 (59.2) | 91 (59.5)”

“Median age (range), yr | 61 (30–76) | 61 (31–75)”

Table 1Find in source

paraphrase[Table 1]

“ECOG PS, n (%) | 0 | 27 (17.8) | 31 (20.3) | | 1 | 125 (82.2) | 122 (79.7)”

The study states approval from independent review boards or ethics committees at each site and regulatory authorities. Written informed consent was obtained from all patients. Compliance with ICH-GCP and Declaration of Helsinki is stated. The trial is registered (NCT04194203).

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals and consent are adequately reported.

Evidence

paraphrase[Methods, Study design and patient population]

“Approval of the protocols was obtained from independent review boards or ethics committees at each study site, and from regulatory authorities per local requirements (Supplementary Table).”

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design and patient population]

“IMpower151 (ClinicalTrials.gov, NCT04194203) was conducted according to the International Conference on Harmonisation E6 guideline for Good Clinical Practice and the principles of the Declaration of Helsinki.”

PASSReviewer 2· 95% conf

Ethics approval and informed consent are clearly reported, with a named ethics body and compliance with the Declaration of Helsinki.

Evidence

paraphrase[Methods, Study design and patient population]

“Approval of the protocols was obtained from independent review boards or ethics committees at each study site, and from regulatory authorities per local requirements.”

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design and patient population]

“IMpower151 was conducted according to the International Conference on Harmonisation E6 guideline for Good Clinical Practice and the principles of the Declaration of Helsinki.”

The investigational products (atezolizumab, bevacizumab, carboplatin, paclitaxel, pemetrexed) are named with doses and regimens. The PD-L1 assay (SP263) is identified. Statistical software (SAS v.9.4) and RNA sequencing tools are identified. Antibodies, cell lines, and mycoplasma testing are not applicable as this is a clinical trial without wet-lab assays.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources, including investigational products and software, are adequately identified.

Evidence

paraphrase[Methods, Procedures and interventions]

“Patients received 21-day cycles of atezolizumab or placebo (1,200 mg) plus bevacizumab (15 mg per kg), carboplatin (area under the concentration curve 6 mg per ml per min) and paclitaxel (175 mg per m2) or pemetrexed (500 mg per m2) intravenously for four cycles.”

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

paraphrase[Methods, RNA sequencing]

“RNA sequencing was performed using the TruSeq RNA Access Library Prep Kit (Illumina, Inc. (cat. no. RS-301-2001 and RS-301-2002)).”

PASSReviewer 2· 90% conf

The investigational products (atezolizumab, bevacizumab, chemotherapy) are identified with doses and regimens; software tools are identified.

Evidence

paraphrase[Methods, Procedures and interventions]

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

“All RNA sequencing analyses were conducted in R (v.4.0.3).”

MethodsFind in source

Statistical tests are named (stratified Cox regression, Kaplan-Meier, Brookmeyer-Crowley, Clopper-Pearson, Mantel-Haenszel). Assumptions are handled by design (stratified analysis, sensitivity analysis). Exact p-values are reported for primary endpoint (P=0.184). Effect sizes with CIs are reported throughout. Software is identified. Data presentation includes Kaplan-Meier curves, forest plots, and per-group n. Mathematical plausibility checks were not performed due to large N and continuous outcomes.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical analysis is rigorous with named tests, effect sizes with CIs, and appropriate handling of missing data.

Evidence

“HRs were estimated using a stratified Cox regression model, using the same stratification factors that were used during randomization.”

Statistical analysisFind in source

“Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”

AbstractFind in source

paraphrase[Results, Primary and secondary efficacy outcomes]

“Median investigator-assessed PFS (INV-PFS; primary outcome) was 9.5 months with ABCPem/Pac and 7.1 months with BCPem/Pac (stratified hazard ratio (HR): 0.84; 95% confidence interval (CI): 0.65, 1.09; P = 0.184).”

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described; p-values are exact; effect sizes with CIs are reported; software is identified.

Evidence

paraphrase[Results, Primary and secondary efficacy outcomes]

“Median OS was 20.7 months in the ABCPem/Pac arm and 18.7 months in the BCPem/Pac arm (stratified HR: 0.93; 95% CI: 0.67, 1.28).”

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

The data availability statement provides a concrete route for accessing individual-patient data via Vivli and RNA sequencing data via EGA. Repository deposit and accession numbers are not applicable for patient-level data, but the statement is adequate. Code sharing is not applicable as no bespoke code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is adequately described with a concrete access route via Vivli and EGA.

Evidence

paraphrase[Data availability]

“Individual-patient-level RNA sequencing data are made available to qualified researchers at the European Genome-phenome Archive platform.”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability statement is concrete, naming Vivli and EGA platforms; code sharing is not applicable as no custom code is mentioned.

Evidence

paraphrase[Data availability]

“For eligible studies, qualified researchers can request access to individual-patient-level clinical data through a data request platform. At the time of writing, this request platform is Vivli (https://vivli.org/ourmember/roche/). Individual-patient-level RNA sequencing data are made available to qualified researchers at the European Genome-phenome Archive platform.”

The trial is registered (NCT04194203). A reporting summary is mentioned. All pre-specified outcomes are reported, including negative results. Limitations are explicitly discussed. Conclusions are proportional to the evidence, acknowledging the negative primary endpoint. Funding and competing interests are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Reporting is transparent with trial registration, limitations discussed, and proportional conclusions.

Evidence

“Trial registration number: ClinicalTrials.gov, NCT02366143 (https://clinicaltrials.gov/ct2/show/NCT02366143)”

AbstractFind in source

“Limitations of this study include the small sample size, lack of statistical power to detect the desired effect size in subgroups by baseline characteristics (including EGFR mutation and sex) and the small sample sizes in the exploratory biomarker subgroup analyses.”

Discussion ¶10Find in source

“The IMpower151 study was sponsored by F. Hoffmann-La Roche, Ltd. The funder had a role in study design, data collection, data analysis, data interpretation and writing of the report.”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

The manuscript is transparent: trial registration, reporting guideline, limitations, and funding/COI are all reported.

Evidence

“Trial registration number: ClinicalTrials.gov, NCT02366143”

AbstractFind in source

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“The IMpower151 study was sponsored by F. Hoffmann-La Roche, Ltd. ... C.Z. received honoraria as a speaker/consultant from ...”

Registered (2 IDs: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 32 references by DOI: 21 verified — 9 DOI unresolved, 2 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published paper is robust in its methodology and reporting. An informed reader should weigh the minor reporting inconsistencies (e.g., wrong trial registration number in abstract, ambiguous subgroup denominator) and the unresolved references, which may warrant a correction or clarification. The negative primary endpoint is handled appropriately.

1.
HIGHreporting
Correct the trial registration number in the Abstract from NCT02366143 to NCT04194203.
The abstract lists the IMpower150 registration number, which is an internal contradiction that could mislead readers and is a factual error.
2.
HIGHreporting
Clarify in the Results section that the 162 patients with prior TKI treatment refer to the EGFR-mutant subgroup, not the entire ITT population.
The current wording is ambiguous and could be misinterpreted as applying to all 305 patients, which is an internal contradiction.
3.
HIGHreporting
Verify and correct the 9 references flagged as not found in registries (e.g., JAMA Oncol 2021;10.1001/jamaoncol.2021.4246, TLCR 2021;10.21037/tlcr-21-497, JCO 2024;10.1200/jco.24.01089, JAMA 2024;10.1001/jama.2024.10679, Nat Rev Clin Oncol 2019;10.1038/s41571-018-0141-8, Cancer Immunol Immunother 2008;10.1007/s00262-008-0451-4, Oncoimmunology 2015;10.1080/2162402x.2014.989764, Nat Commun 2018;10.1038/s41467-018-04355-6, Am J Respir Crit Care Med 2014;10.1164/rccm.201406-1135oc).
References that cannot be located in any registry may be fabricated or contain errors; they must be verified or corrected to maintain scientific integrity.
4.
MEDIUMcopyedit
Fix the spelling error 'occured' to 'occurred' in Methods, Study endpoints and assessments.
Spelling errors detract from professionalism and should be corrected.
5.
MEDIUMcopyedit
Clarify the Table 1 footnote to explicitly state that 'EGFR mutations' includes ALK rearrangements, to avoid confusion.
The current footnote may be ambiguous and could mislead readers about the mutation types included.
6.
MEDIUMcopyedit
Clarify in the Results that '49% events' refers to the percentage of patients with OS events.
The phrase is ambiguous and could be misinterpreted.
7.
MEDIUMreporting
Add a reference to the follow-up treatment table in the Discussion when stating that subsequent anticancer therapy may have affected OS results.
Supporting the statement with data strengthens the argument and improves transparency.
8.
LOWreporting
In the Discussion, explicitly acknowledge limitations of prior research (e.g., IMpower150) and how IMpower151 addresses them.
This would strengthen the scientific premise and address a reviewer's concern.
9.
LOWreporting
State whether the trial was registered before enrollment began, not just provide the registration number.
Prospective registration is a key transparency indicator and is currently not explicitly stated.
10.
LOWdata code
Provide accession numbers for the RNA sequencing data in the Data Availability section once available.
Specific accession numbers enhance data accessibility and reproducibility.
11.
LOWreporting
Specify the exact statistical test used for subgroup analyses (e.g., unstratified Cox regression) in the Methods.
Clarifying the methods avoids ambiguity and improves reproducibility.
12.
LOWreporting
Report confidence intervals for ORR and DOR in the Results to be consistent with other endpoints.
Consistent reporting of effect sizes with CIs improves interpretability.

Full text (67,236 chars)Analyzed: Aug 15, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.

Read full text (PMC)

DOI

10.1038/s41591-025-03658-y

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/f687ab6a-f127-4374-ba47-85f58889c554" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/f687ab6a-f127-4374-ba47-85f58889c554/badge" alt="Kaimen Rigor review — 2★ (Weak), 0 critical, 3 high issues for “Atezolizumab plus bevacizumab and chemotherapy in metastatic nonsquamous NSCLC: the randomized double-blind phase 3 IMpower151 trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

f6c4ad16b71a10f03707a34142b9b65753fba23b13db45746da07e382064b467

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
CitationsCitations & links (capped) ×9−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is investigator-assessed progression-free survival (INV-PFS), a surrogate for overall survival. The trial did not demonstrate a statistically significant improvement in PFS (HR 0.84, P=0.184), and the paper does not provide evidence of target engagement at the tested dose or a validated link between PFS and clinical benefit in this context. The efficacy claim is based on a surrogate without meeting the criteria for adequacy.
“The primary endpoint was investigator-assessed progression-free survival (INV-PFS); ... Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect size is a hazard ratio of 0.84 for PFS, which is not statistically significant and is below the minimal clinically important difference typically considered for PFS in NSCLC. The paper does not anchor the effect to a clinically meaningful threshold, and the OS HR is 0.93 with no significant benefit. The effect size is not presented as clinically material.
“Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit7 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 2 via agent-written checks.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

None found

Checked — nothing surfaced.

Eight Dimensions8 pass

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

paraphrase[Main, paragraph 2]

paraphrase[Discussion, paragraph 2]

PASSReviewer 2· 90% conf

The study clearly establishes its scientific premise by citing prior work (IMpower150) and providing a logical rationale for conducting the trial in China.

Evidence

paraphrase[Main, paragraph 1]

paraphrase[Main, paragraph 2]

absence[Main, paragraph 1-2]

Limitations of prior research are not explicitly discussed as such.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with clear randomization, blinding, power analysis, and inclusion/exclusion criteria.

Evidence

“Enrolled patients were randomized 1:1 to the ABCPem/Pac or BCPem/Pac arms using a stratified block method (block size of four).”

MethodsFind in source

paraphrase[Methods, Statistical analyses]

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, with a pre-specified sample size calculation, stratification, and clear inclusion/exclusion criteria.

Evidence

“Enrolled patients were randomized 1:1 to the ABCPem/Pac or BCPem/Pac arms using a stratified block method (block size of four).”

MethodsFind in source

paraphrase[Methods, Statistical analyses]

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human clinical trial, including sex, age, and demographics.

Evidence

paraphrase[Table 1]

“Sex, n (%): Female 62 (40.8) | 62 (40.5); Male 90 (59.2) | 91 (59.5)”

paraphrase[Table 1]

“Median age (range), yr: 61 (30–76) | 61 (31–75)”

“Of the patients, 59% were male, 51% never smoked and 81% had an Eastern Cooperative Oncology Group performance status (ECOG PS) of 1.”

ResultsFind in source

PASSReviewer 2· 90% conf

Sex, age, and key demographics are reported; sex is not justified as single-sex because both sexes are enrolled.

Evidence

paraphrase[Table 1]

“Sex, n (%) | Female | 62 (40.8) | 62 (40.5) | | Male | 90 (59.2) | 91 (59.5)”

“Median age (range), yr | 61 (30–76) | 61 (31–75)”

Table 1Find in source

paraphrase[Table 1]

“ECOG PS, n (%) | 0 | 27 (17.8) | 31 (20.3) | | 1 | 125 (82.2) | 122 (79.7)”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals and consent are adequately reported.

Evidence

paraphrase[Methods, Study design and patient population]

“Approval of the protocols was obtained from independent review boards or ethics committees at each study site, and from regulatory authorities per local requirements (Supplementary Table).”

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design and patient population]

PASSReviewer 2· 95% conf

Ethics approval and informed consent are clearly reported, with a named ethics body and compliance with the Declaration of Helsinki.

Evidence

paraphrase[Methods, Study design and patient population]

“Approval of the protocols was obtained from independent review boards or ethics committees at each study site, and from regulatory authorities per local requirements.”

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design and patient population]

“IMpower151 was conducted according to the International Conference on Harmonisation E6 guideline for Good Clinical Practice and the principles of the Declaration of Helsinki.”

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources, including investigational products and software, are adequately identified.

Evidence

paraphrase[Methods, Procedures and interventions]

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

paraphrase[Methods, RNA sequencing]

“RNA sequencing was performed using the TruSeq RNA Access Library Prep Kit (Illumina, Inc. (cat. no. RS-301-2001 and RS-301-2002)).”

PASSReviewer 2· 90% conf

The investigational products (atezolizumab, bevacizumab, chemotherapy) are identified with doses and regimens; software tools are identified.

Evidence

paraphrase[Methods, Procedures and interventions]

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

“All RNA sequencing analyses were conducted in R (v.4.0.3).”

MethodsFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical analysis is rigorous with named tests, effect sizes with CIs, and appropriate handling of missing data.

Evidence

“HRs were estimated using a stratified Cox regression model, using the same stratification factors that were used during randomization.”

Statistical analysisFind in source

“Median INV-PFS for ABCPem/Pac versus BCPem/Pac was 9.5 versus 7.1 months (stratified hazard ratio: 0.84; 95% confidence interval: 0.65, 1.09; P = 0.184).”

AbstractFind in source

paraphrase[Results, Primary and secondary efficacy outcomes]

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described; p-values are exact; effect sizes with CIs are reported; software is identified.

Evidence

paraphrase[Results, Primary and secondary efficacy outcomes]

“Median OS was 20.7 months in the ABCPem/Pac arm and 18.7 months in the BCPem/Pac arm (stratified HR: 0.93; 95% CI: 0.67, 1.28).”

“Statistical analyses were conducted using SAS (v.9.4).”

Statistical analysisFind in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is adequately described with a concrete access route via Vivli and EGA.

Evidence

paraphrase[Data availability]

“Individual-patient-level RNA sequencing data are made available to qualified researchers at the European Genome-phenome Archive platform.”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability statement is concrete, naming Vivli and EGA platforms; code sharing is not applicable as no custom code is mentioned.

Evidence

paraphrase[Data availability]

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Reporting is transparent with trial registration, limitations discussed, and proportional conclusions.

Evidence

“Trial registration number: ClinicalTrials.gov, NCT02366143 (https://clinicaltrials.gov/ct2/show/NCT02366143)”

AbstractFind in source

Discussion ¶10Find in source

“The IMpower151 study was sponsored by F. Hoffmann-La Roche, Ltd. The funder had a role in study design, data collection, data analysis, data interpretation and writing of the report.”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

The manuscript is transparent: trial registration, reporting guideline, limitations, and funding/COI are all reported.

Evidence

“Trial registration number: ClinicalTrials.gov, NCT02366143”

AbstractFind in source

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“The IMpower151 study was sponsored by F. Hoffmann-La Roche, Ltd. ... C.Z. received honoraria as a speaker/consultant from ...”

Registered (2 IDs: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 32 references by DOI: 21 verified — 9 DOI unresolved, 2 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHreporting
Correct the trial registration number in the Abstract from NCT02366143 to NCT04194203.
The abstract lists the IMpower150 registration number, which is an internal contradiction that could mislead readers and is a factual error.
2.
HIGHreporting
Clarify in the Results section that the 162 patients with prior TKI treatment refer to the EGFR-mutant subgroup, not the entire ITT population.
The current wording is ambiguous and could be misinterpreted as applying to all 305 patients, which is an internal contradiction.
3.
HIGHreporting
Verify and correct the 9 references flagged as not found in registries (e.g., JAMA Oncol 2021;10.1001/jamaoncol.2021.4246, TLCR 2021;10.21037/tlcr-21-497, JCO 2024;10.1200/jco.24.01089, JAMA 2024;10.1001/jama.2024.10679, Nat Rev Clin Oncol 2019;10.1038/s41571-018-0141-8, Cancer Immunol Immunother 2008;10.1007/s00262-008-0451-4, Oncoimmunology 2015;10.1080/2162402x.2014.989764, Nat Commun 2018;10.1038/s41467-018-04355-6, Am J Respir Crit Care Med 2014;10.1164/rccm.201406-1135oc).
References that cannot be located in any registry may be fabricated or contain errors; they must be verified or corrected to maintain scientific integrity.
4.
MEDIUMcopyedit
Fix the spelling error 'occured' to 'occurred' in Methods, Study endpoints and assessments.
Spelling errors detract from professionalism and should be corrected.
5.
MEDIUMcopyedit
Clarify the Table 1 footnote to explicitly state that 'EGFR mutations' includes ALK rearrangements, to avoid confusion.
The current footnote may be ambiguous and could mislead readers about the mutation types included.
6.
MEDIUMcopyedit
Clarify in the Results that '49% events' refers to the percentage of patients with OS events.
The phrase is ambiguous and could be misinterpreted.
7.
MEDIUMreporting
Add a reference to the follow-up treatment table in the Discussion when stating that subsequent anticancer therapy may have affected OS results.
Supporting the statement with data strengthens the argument and improves transparency.
8.
LOWreporting
In the Discussion, explicitly acknowledge limitations of prior research (e.g., IMpower150) and how IMpower151 addresses them.
This would strengthen the scientific premise and address a reviewer's concern.
9.
LOWreporting
State whether the trial was registered before enrollment began, not just provide the registration number.
Prospective registration is a key transparency indicator and is currently not explicitly stated.
10.
LOWdata code
Provide accession numbers for the RNA sequencing data in the Data Availability section once available.
Specific accession numbers enhance data accessibility and reproducibility.
11.
LOWreporting
Specify the exact statistical test used for subgroup analyses (e.g., unstratified Cox regression) in the Methods.
Clarifying the methods avoids ambiguity and improves reproducibility.
12.
LOWreporting
Report confidence intervals for ORR and DOR in the Results to be consistent with other endpoints.
Consistent reporting of effect sizes with CIs improves interpretability.

Full text (67,236 chars)Analyzed: Aug 15, 2026