Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.

Name: Kaimen Rigor review — Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.
Item: Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.
Rating: 100
Author: Alpha1

Wick W, Lanz LM, Wick A, Harting I, Dettmer S, Suwala AK, Ketter R, Tabatabai G, Seliger C, Glas M, Burger MC, Timmer M, Ringel FA, Mildenberger I, Schulz-Schaeffer WJ, Winkler F, König L, Herold-Mende C, Eisenmenger A, Pfister SM, Renovanz M, Bendszus M, Sahm F, Platten M, Kessler T

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.5★ (Weak), 0 critical, 4 high issues for “Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.

Read full text (PMC)

DOI

10.1038/s41591-025-03928-9

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/84e4adbc-72b8-49d1-9d41-4fc447a59c86" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/84e4adbc-72b8-49d1-9d41-4fc447a59c86/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 4 high issues for “Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

fd2aaf82587f2d1d9da3a264fc974de2cafaaf84cb823a956f2f7d562e789096

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.

Paper source

Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

CitationsCitations & links (capped) ×6−1★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 3 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy endpoint is PFS-6, a surrogate for overall survival. The paper does not provide evidence that PFS-6 is a validated surrogate for OS in glioblastoma, nor does it demonstrate target engagement for temsirolimus at the tested dose (e.g., PK/PD or pathway inhibition). The claim of efficacy rests on this surrogate without a validated link to clinical benefit.
“The temsirolimus subtrial (n = 46) demonstrated a PFS-6 of 39.1% and median OS of 15.4 months in patients with activated mammalian target of rapamycin (mTOR) signaling compared to a PFS-6 at 18.5% in the SOC group (n = 54), meeting the primary endpoint.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect is a PFS-6 improvement from 18.5% to 39.1% (absolute increase of 20.6 percentage points) and median OS improvement from 12.1 to 15.4 months (3.3 months). While statistically significant, the clinical meaningfulness is not anchored to a minimal clinically important difference or a validated threshold. The OS benefit is modest and not clearly established as clinically material.
“The temsirolimus subtrial (n = 46) demonstrated a PFS-6 of 39.1% and median OS of 15.4 months in patients with activated mammalian target of rapamycin (mTOR) signaling compared to a PFS-6 at 18.5% in the SOC group (n = 54), meeting the primary endpoint.”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and transparently reported phase 1/2a umbrella trial in glioblastoma. The paper demonstrates strong scientific premise, rigorous design, thorough ethical documentation, and adequate data availability. Minor reporting gaps include lack of explicit reporting guideline adherence and some copyedit issues, but no major rigor concerns.

Both reviewers independently scored all eight dimensions and agreed on all statuses. The study type is interventional (clinical trial). Verification components checked citations (6 not found in registry), statistics (2 tests consistent), reproducibility (links live), preregistration (ClinicalTrials.gov and EudraCT), and integrity (minor internal contradiction). The statistics coverage is partial; only a subset of tests were machine-verified.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.

Overstated conclusions

2 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

6 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

None found

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Checked — nothing surfaced.

Eight Dimensions8 pass

The introduction cites multiple prior trials and molecular studies, acknowledges the failure of unselected targeted approaches, and provides a logical rationale for molecularly matched treatment. It also addresses limitations of prior research, such as the need for accurate MGMT testing and the importance of biomarker validation.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise by citing prior research on glioblastoma molecular subtypes, targeted therapies, and the rationale for an umbrella trial design.

Evidence

“Trials aiming at replacing TMZ with targeted agents in not molecularly selected patient populations have failed to demonstrate relevant benefit to date”

Main, paragraph 1Find in source

“Thus, in principle, treatment with targeted compounds based on molecular markers could be integrated into first-line treatment.”

Main, paragraph 2Find in source

“accurate determination of MGMT promoter methylation status is crucial to avoid withholding TMZ in patients that might benefit from this drug”

Main, paragraph 2Find in source

PASSReviewer 2· 90% conf

The paper establishes a strong scientific premise by citing prior research on glioblastoma treatments, molecular markers, and the rationale for targeted therapies.

Evidence

“Trials aiming at replacing TMZ with targeted agents in not molecularly selected patient populations have failed to demonstrate relevant benefit to date”

Main, paragraph 1Find in source

“Thus, in principle, treatment with targeted compounds based on molecular markers could be integrated into first-line treatment.”

Main, paragraph 2Find in source

“accurate determination of MGMT promoter methylation status is crucial to avoid withholding TMZ in patients that might benefit from this drug”

Main, paragraph 2Find in source

Randomization was used for patients without matching alterations, with the method (randomizer.at) stated. The unit of randomization is the patient. Blinding is not applicable as the trial is open-label, which is stated. A sample size estimation is provided for phase 2a (maximum 40 patients per subtrial). Inclusion/exclusion criteria are extensively detailed. Outlier handling is addressed through the definition of analysis populations (FAS, EES) and handling of missing data. Controls are the SOC arm (TMZ). Independent replication is not applicable for a single trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The study design is rigorous for a phase 1/2a umbrella trial, with clear randomization for non-matched patients, predefined inclusion/exclusion criteria, and a prespecified primary endpoint.

Evidence

“Patients without matching alterations were randomized via randomizer.at to subtrials lacking strong biomarkers”

Results ¶1Find in source

“In the phase 2a parts, a maximum of 40 patients were to be accrued for evaluation in each subtrial”

MethodsFind in source

paraphrase[Main, paragraph 2]

“We here report results from the open-label eight-subtrial prospective N2M2 trial”

PASSReviewer 2· 85% conf

The study design is rigorous for a phase 1/2a umbrella trial, with clear randomization for non-matched arms, predefined inclusion/exclusion criteria, and a pre-specified primary endpoint.

Evidence

“Patients without matching alterations were randomized via randomizer.at to subtrials lacking strong biomarkers”

Results ¶1Find in source

“In the phase 2a parts, a maximum of 40 patients were to be accrued for evaluation in each subtrial”

MethodsFind in source

“Open biopsy or resection. The craniotomy or intracranial biopsy site must be adequately healed. Written informed consent.”

MethodsFind in source

Sex is reported for all patients (145 male, 83 female). Age is reported as mean and categorical. Demographics include ethnicity and Karnofsky performance status. Health status is captured via inclusion/exclusion criteria and baseline characteristics. Species/strain and housing are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human clinical trial, including sex, age, BMI, and demographics.

Evidence

paraphrase[Table 1]

“Sex, n (%) | Male 145 (63.6) | Female 83 (36.4)”

paraphrase[Table 1]

“Age continuous (years), mean (s.d.) 58.5 (9.26)”

paraphrase[Table 1]

“Ethnic group, n (%) | Caucasian/white 225 (98.7)”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial, including sex, age, BMI, and demographics.

Evidence

paraphrase[Table 1]

“Male 145 (63.6) | Female 83 (36.4)”

paraphrase[Table 1]

“Age continuous (years), mean (s.d.) 58.5 (9.26)”

paraphrase[Table 1]

“Ethnic group, n (%) | Caucasian/white 225 (98.7)”

The study protocol was approved by the lead ethics committee (AFmu-207/2017) and all regional ethics committees, as well as the competent federal authority. Informed consent was obtained in a two-step process. Compliance with Good Clinical Practice, Declaration of Helsinki, and local regulations is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are thoroughly documented, including named ethics committees, informed consent process, and regulatory compliance.

Evidence

“The study protocol has been approved by the lead ethics committee (AFmu-207/2017) in Heidelberg and all regional ethics committees”

MethodsFind in source

paraphrase[Methods, Ethical and legal aspects]

“Patients were enrolled in a two-step consent process. Oral and written explanation of the molecular testing... was provided after surgery, and any trial-specific measures were only started after written informed consent.”

“The trial was conducted in accordance with the standards of Good Clinical Practice, the Declaration of Helsinki and local legal and regulatory requirements.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals are thoroughly documented, including named ethics committees, informed consent process, and regulatory compliance.

Evidence

“The study protocol has been approved by the lead ethics committee (AFmu-207/2017) in Heidelberg and all regional ethics committees”

MethodsFind in source

“Patients were enrolled in a two-step consent process. Oral and written explanation of the molecular testing, including interpretation and conduct of the MTB, was provided after surgery, and any trial-specific measures were only started after written informed consent.”

MethodsFind in source

“The trial was conducted in accordance with the standards of Good Clinical Practice, the Declaration of Helsinki and local legal and regulatory requirements.”

MethodsFind in source

The investigational drugs (alectinib, idasanutlin, palbociclib, vismodegib, temsirolimus, atezolizumab, asunercept) are named with manufacturers (Hoffmann-La Roche, Apogenix AG, Pfizer Pharma GmbH) and dosing regimens are described. Software tools are identified with versions (e.g., SAS 9.4, minfi 1.26.2). Antibodies, cell lines, and mycoplasma testing are not applicable as this is a clinical trial without wet-lab assays.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Key resources, including investigational drugs, are adequately identified with manufacturers and dosing regimens.

Evidence

“Study drugs were provided free of charge by Hoffmann-La Roche, Apogenix AG and Pfizer Pharma GmbH.”

AcknowledgementsFind in source

“Atezolizumab was administered intravenously at 1,200 mg every 3 weeks in conjunction with radiotherapy”

ResultsFind in source

“Data analysis was done on exports from this system using SAS version 9.4.”

MethodsFind in source

PASSReviewer 2· 85% conf

Key resources are well identified, including investigational drugs, software, and data repositories.

Evidence

“Study drugs were provided free of charge by Hoffmann-La Roche, Apogenix AG and Pfizer Pharma GmbH.”

AcknowledgementsFind in source

“Data analysis was done on exports from this system using SAS version 9.4.”

MethodsFind in source

“Custom scripts based on the R packages ‘minfi’ (version 1.26.2) and ‘conumee’ (version 1.14.0) were implemented for CNV profiling and visualization.”

MethodsFind in source

The primary endpoint PFS-6 is analyzed with a one-sample one-sided binomial test, and p-values are reported exactly (e.g., P = 0.0109). Effect sizes are reported with 95% CIs. Software is identified. Data presentation includes Kaplan-Meier curves and per-group n. Assumptions are handled by design (e.g., binomial test). Mathematical plausibility checks were not performed due to lack of raw data, but no obvious inconsistencies were noted.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Statistical methods are appropriate and well-described, with exact p-values and confidence intervals reported for primary endpoints.

Evidence

paraphrase[Methods, Phase 2a]

“The primary efficacy endpoint, PFS-6, according to RANO criteria, is analyzed as a binary endpoint with a one-sample one-sided binomial test of the null hypothesis (H0—P = 0.231).”

paraphrase[Results, Treatment]

“The temsirolimus subtrial ... showed a PFS-6 of 39.1% (18/46; P = 0.0109, 95% CI = 25.1–54.6%)”

paraphrase[Results, Treatment]

“a median PFS of 5.8 months (95% CI = 3.1–7.7) and a median OS of 15.4 months (95% CI = 11.8–18.0)”

PASSReviewer 2· 80% conf

Statistical methods are appropriate and well-described, with exact p-values and confidence intervals reported for key endpoints.

Evidence

“The temsirolimus subtrial with patients demonstrating phospho-mTOR activation showed a PFS-6 of 39.1% (18/46; P = 0.0109, 95% CI = 25.1–54.6%)”

ResultsFind in source

“The primary efficacy endpoint, PFS-6, according to RANO criteria, is analyzed as a binary endpoint with a one-sample one-sided binomial test of the null hypothesis ( H 0 — P = 0.231).”

Statistical analysisFind in source

“a median PFS of 5.4 months (95% confidence interval (CI) = 2.8–5.8)”

ResultsFind in source

The data availability statement names a concrete repository (EGA) with accession number EGAS00001008033. Patient outcomes and raw molecular data are available upon request with a stated timeframe (within 4 weeks). Code sharing is not applicable as no custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersADEQUATE

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is well-documented with a clear statement, deposition of sequencing data in EGA, and a procedure for requesting patient outcomes.

Evidence

paraphrase[Data availability]

“Sequence and methylation data have been deposited at the European Genome-phenome Archive (EGA) ... under accession EGAS00001008033”

“Patient outcomes and raw molecular data are available upon request to the corresponding author (W.W.) within 4 weeks from request”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability is well addressed with a concrete repository deposit and a managed access procedure for patient data.

Evidence

“Sequence and methylation data have been deposited at the European Genome-phenome Archive (EGA), which is hosted by the European Bioinformatics Institute and the Centre for Genomic Regulation under accession EGAS00001008033”

Data availabilityFind in source

“Patient outcomes and raw molecular data are available upon request to the corresponding author (W.W.) within 4 weeks from request, as long as they are in line with the ethics approvals.”

Data availabilityFind in source

The trial is registered at ClinicalTrials.gov (NCT03158389). Methods are detailed enough for replication. Limitations are explicitly discussed, including the mix of matched and randomized subtrials and the potential for bias. Conclusions are proportional, noting the need for controlled confirmation. Funding and competing interests are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Reporting is transparent, with trial registration, detailed methods, discussion of limitations, and proportional conclusions.

Evidence

“ClinicalTrials.gov registration: NCT03158389”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“Limitations of N2M2 include the selection of drugs, which could have been more extensive”

paraphrase[Acknowledgements and Competing interests]

“The clinical phase was supported by funding of the German Cancer Aid (DKH, 70111980) ... W.W. declares consulting fees from Enterome, GSK and Servier.”

PASSReviewer 2· 90% conf

Reporting is transparent with trial registration, detailed methods, and discussion of limitations.

Evidence

“ClinicalTrials.gov registration: NCT03158389 (https://clinicaltrials.gov/study/NCT03158389)”

AbstractFind in source

“Limitations of N 2 M 2 include the selection of drugs, which could have been more extensive, such as BRAF and NTRK inhibitors”

Discussion ¶4Find in source

“The clinical phase was supported by funding of the German Cancer Aid (DKH, 70111980) and by structural support via the German Ministry of Education and Research (BMBF)”

AcknowledgementsFind in source

Registered (2 IDs: ClinicalTrials.gov, EudraCT). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 35 references by DOI: 29 verified — 6 DOI unresolved.

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and well-reported. An informed reader should weigh the minor reporting gaps (explicit reporting guideline, allocation concealment details, missing data handling) and the unresolved references flagged by the citation check. No erratum is warranted for the minor internal contradiction in SOC group size, but the authors should verify the flagged references to rule out fabrication.

1.
HIGHreporting
Verify the six references flagged as 'not found in registry' (e.g., encorafenib/binimetinib, cMyc/ERK, APG101, everolimus EXIST-1, temsirolimus mantle cell, ALK amplification) and correct or replace any that are erroneous or fabricated.
Unresolved references are a fabrication signal and must be checked against the original sources.
2.
HIGHreporting
Explicitly state adherence to a reporting guideline (e.g., CONSORT) in the Methods or Reporting Summary.
Both reviewers noted the absence of an explicit reporting guideline statement, which is a transparency gap.
3.
HIGHrigor
Provide a more detailed description of the randomization procedure for non-matched patients, including allocation concealment.
Both reviewers suggested this to strengthen the design description.
4.
HIGHstatistics
Clarify the handling of missing data for the primary endpoint in the statistical analysis section.
Both reviewers noted this is only briefly mentioned and needs more detail.
5.
MEDIUMreporting
Add a statement on whether any analyses were adjusted for multiple comparisons, given the multiple subtrials.
Reviewer 1 suggested this to address potential multiplicity issues.
6.
MEDIUMreporting
Specify the version of the RANO criteria used and any central review procedures in more detail.
Reviewer 1 suggested this to improve reproducibility.
7.
MEDIUMdata code
Consider depositing the statistical analysis code in a public repository to enhance reproducibility.
Both reviewers suggested this to improve reproducibility.
8.
MEDIUMreporting
In the Discussion, explicitly address the potential for bias due to the open-label design and the lack of blinding in the assessment of PFS-6.
Reviewer 2 suggested this to acknowledge a design limitation.
9.
MEDIUMreporting
Add a note on the generalizability of the results given the predominantly Caucasian population.
Reviewer 1 suggested this to address external validity.
10.
LOWcopyedit
Fix the typo 'glioblasstoma' in the Abstract.
Copyedit issue flagged by the scribe.
11.
LOWcopyedit
Fix the extra parenthesis in the sentence reporting the temsirolimus PFS-6 result.
Copyedit issue flagged by the scribe.
12.
LOWcopyedit
Revise the awkward sentence in Discussion paragraph 4 about palbociclib blood-brain barrier penetration for clarity.
Copyedit issue flagged by the scribe.
13.
LOWcopyedit
Replace 'randomized via randomizer.at' with a more formal description of the randomization tool.
Copyedit issue flagged by the scribe.
14.
LOWreporting
Reconcile the SOC group size discrepancy (54 in abstract vs 53 in Table 3) and clarify the footnote.
Integrity check flagged a minor internal contradiction that should be clarified.

Full text (83,688 chars · analyzed ~90%, head + tail)Analyzed: Aug 15, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.

Read full text (PMC)

DOI

10.1038/s41591-025-03928-9

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/84e4adbc-72b8-49d1-9d41-4fc447a59c86" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/84e4adbc-72b8-49d1-9d41-4fc447a59c86/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 4 high issues for “Molecularly matched targeted therapies plus radiotherapy in glioblastoma: the phase 1/2a N(2)M(2) umbrella trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

fd2aaf82587f2d1d9da3a264fc974de2cafaaf84cb823a956f2f7d562e789096

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

CitationsCitations & links (capped) ×6−1★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 3 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy endpoint is PFS-6, a surrogate for overall survival. The paper does not provide evidence that PFS-6 is a validated surrogate for OS in glioblastoma, nor does it demonstrate target engagement for temsirolimus at the tested dose (e.g., PK/PD or pathway inhibition). The claim of efficacy rests on this surrogate without a validated link to clinical benefit.
“The temsirolimus subtrial (n = 46) demonstrated a PFS-6 of 39.1% and median OS of 15.4 months in patients with activated mammalian target of rapamycin (mTOR) signaling compared to a PFS-6 at 18.5% in the SOC group (n = 54), meeting the primary endpoint.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect is a PFS-6 improvement from 18.5% to 39.1% (absolute increase of 20.6 percentage points) and median OS improvement from 12.1 to 15.4 months (3.3 months). While statistically significant, the clinical meaningfulness is not anchored to a minimal clinically important difference or a validated threshold. The OS benefit is modest and not clearly established as clinically material.
“The temsirolimus subtrial (n = 46) demonstrated a PFS-6 of 39.1% and median OS of 15.4 months in patients with activated mammalian target of rapamycin (mTOR) signaling compared to a PFS-6 at 18.5% in the SOC group (n = 54), meeting the primary endpoint.”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit5 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.

Overstated conclusions

2 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

6 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

None found

Checked — nothing surfaced.

Eight Dimensions8 pass

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise by citing prior research on glioblastoma molecular subtypes, targeted therapies, and the rationale for an umbrella trial design.

Evidence

“Trials aiming at replacing TMZ with targeted agents in not molecularly selected patient populations have failed to demonstrate relevant benefit to date”

Main, paragraph 1Find in source

“Thus, in principle, treatment with targeted compounds based on molecular markers could be integrated into first-line treatment.”

Main, paragraph 2Find in source

“accurate determination of MGMT promoter methylation status is crucial to avoid withholding TMZ in patients that might benefit from this drug”

Main, paragraph 2Find in source

PASSReviewer 2· 90% conf

The paper establishes a strong scientific premise by citing prior research on glioblastoma treatments, molecular markers, and the rationale for targeted therapies.

Evidence

“Trials aiming at replacing TMZ with targeted agents in not molecularly selected patient populations have failed to demonstrate relevant benefit to date”

Main, paragraph 1Find in source

“Thus, in principle, treatment with targeted compounds based on molecular markers could be integrated into first-line treatment.”

Main, paragraph 2Find in source

“accurate determination of MGMT promoter methylation status is crucial to avoid withholding TMZ in patients that might benefit from this drug”

Main, paragraph 2Find in source

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The study design is rigorous for a phase 1/2a umbrella trial, with clear randomization for non-matched patients, predefined inclusion/exclusion criteria, and a prespecified primary endpoint.

Evidence

“Patients without matching alterations were randomized via randomizer.at to subtrials lacking strong biomarkers”

Results ¶1Find in source

“In the phase 2a parts, a maximum of 40 patients were to be accrued for evaluation in each subtrial”

MethodsFind in source

paraphrase[Main, paragraph 2]

“We here report results from the open-label eight-subtrial prospective N2M2 trial”

PASSReviewer 2· 85% conf

The study design is rigorous for a phase 1/2a umbrella trial, with clear randomization for non-matched arms, predefined inclusion/exclusion criteria, and a pre-specified primary endpoint.

Evidence

“Patients without matching alterations were randomized via randomizer.at to subtrials lacking strong biomarkers”

Results ¶1Find in source

“In the phase 2a parts, a maximum of 40 patients were to be accrued for evaluation in each subtrial”

MethodsFind in source

“Open biopsy or resection. The craniotomy or intracranial biopsy site must be adequately healed. Written informed consent.”

MethodsFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human clinical trial, including sex, age, BMI, and demographics.

Evidence

paraphrase[Table 1]

“Sex, n (%) | Male 145 (63.6) | Female 83 (36.4)”

paraphrase[Table 1]

“Age continuous (years), mean (s.d.) 58.5 (9.26)”

paraphrase[Table 1]

“Ethnic group, n (%) | Caucasian/white 225 (98.7)”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial, including sex, age, BMI, and demographics.

Evidence

paraphrase[Table 1]

“Male 145 (63.6) | Female 83 (36.4)”

paraphrase[Table 1]

“Age continuous (years), mean (s.d.) 58.5 (9.26)”

paraphrase[Table 1]

“Ethnic group, n (%) | Caucasian/white 225 (98.7)”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are thoroughly documented, including named ethics committees, informed consent process, and regulatory compliance.

Evidence

“The study protocol has been approved by the lead ethics committee (AFmu-207/2017) in Heidelberg and all regional ethics committees”

MethodsFind in source

paraphrase[Methods, Ethical and legal aspects]

“The trial was conducted in accordance with the standards of Good Clinical Practice, the Declaration of Helsinki and local legal and regulatory requirements.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals are thoroughly documented, including named ethics committees, informed consent process, and regulatory compliance.

Evidence

“The study protocol has been approved by the lead ethics committee (AFmu-207/2017) in Heidelberg and all regional ethics committees”

MethodsFind in source

“The trial was conducted in accordance with the standards of Good Clinical Practice, the Declaration of Helsinki and local legal and regulatory requirements.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Key resources, including investigational drugs, are adequately identified with manufacturers and dosing regimens.

Evidence

“Study drugs were provided free of charge by Hoffmann-La Roche, Apogenix AG and Pfizer Pharma GmbH.”

AcknowledgementsFind in source

“Atezolizumab was administered intravenously at 1,200 mg every 3 weeks in conjunction with radiotherapy”

ResultsFind in source

“Data analysis was done on exports from this system using SAS version 9.4.”

MethodsFind in source

PASSReviewer 2· 85% conf

Key resources are well identified, including investigational drugs, software, and data repositories.

Evidence

“Study drugs were provided free of charge by Hoffmann-La Roche, Apogenix AG and Pfizer Pharma GmbH.”

AcknowledgementsFind in source

“Data analysis was done on exports from this system using SAS version 9.4.”

MethodsFind in source

“Custom scripts based on the R packages ‘minfi’ (version 1.26.2) and ‘conumee’ (version 1.14.0) were implemented for CNV profiling and visualization.”

MethodsFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Statistical methods are appropriate and well-described, with exact p-values and confidence intervals reported for primary endpoints.

Evidence

paraphrase[Methods, Phase 2a]

“The primary efficacy endpoint, PFS-6, according to RANO criteria, is analyzed as a binary endpoint with a one-sample one-sided binomial test of the null hypothesis (H0—P = 0.231).”

paraphrase[Results, Treatment]

“The temsirolimus subtrial ... showed a PFS-6 of 39.1% (18/46; P = 0.0109, 95% CI = 25.1–54.6%)”

paraphrase[Results, Treatment]

“a median PFS of 5.8 months (95% CI = 3.1–7.7) and a median OS of 15.4 months (95% CI = 11.8–18.0)”

PASSReviewer 2· 80% conf

Statistical methods are appropriate and well-described, with exact p-values and confidence intervals reported for key endpoints.

Evidence

“The temsirolimus subtrial with patients demonstrating phospho-mTOR activation showed a PFS-6 of 39.1% (18/46; P = 0.0109, 95% CI = 25.1–54.6%)”

ResultsFind in source

“The primary efficacy endpoint, PFS-6, according to RANO criteria, is analyzed as a binary endpoint with a one-sample one-sided binomial test of the null hypothesis ( H 0 — P = 0.231).”

Statistical analysisFind in source

“a median PFS of 5.4 months (95% confidence interval (CI) = 2.8–5.8)”

ResultsFind in source

Sub-criteria

code sharingN/A

accession numbersADEQUATE

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is well-documented with a clear statement, deposition of sequencing data in EGA, and a procedure for requesting patient outcomes.

Evidence

paraphrase[Data availability]

“Sequence and methylation data have been deposited at the European Genome-phenome Archive (EGA) ... under accession EGAS00001008033”

“Patient outcomes and raw molecular data are available upon request to the corresponding author (W.W.) within 4 weeks from request”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability is well addressed with a concrete repository deposit and a managed access procedure for patient data.

Evidence

Data availabilityFind in source

“Patient outcomes and raw molecular data are available upon request to the corresponding author (W.W.) within 4 weeks from request, as long as they are in line with the ethics approvals.”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Reporting is transparent, with trial registration, detailed methods, discussion of limitations, and proportional conclusions.

Evidence

“ClinicalTrials.gov registration: NCT03158389”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“Limitations of N2M2 include the selection of drugs, which could have been more extensive”

paraphrase[Acknowledgements and Competing interests]

“The clinical phase was supported by funding of the German Cancer Aid (DKH, 70111980) ... W.W. declares consulting fees from Enterome, GSK and Servier.”

PASSReviewer 2· 90% conf

Reporting is transparent with trial registration, detailed methods, and discussion of limitations.

Evidence

“ClinicalTrials.gov registration: NCT03158389 (https://clinicaltrials.gov/study/NCT03158389)”

AbstractFind in source

“Limitations of N 2 M 2 include the selection of drugs, which could have been more extensive, such as BRAF and NTRK inhibitors”

Discussion ¶4Find in source

“The clinical phase was supported by funding of the German Cancer Aid (DKH, 70111980) and by structural support via the German Ministry of Education and Research (BMBF)”

AcknowledgementsFind in source

Registered (2 IDs: ClinicalTrials.gov, EudraCT). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 35 references by DOI: 29 verified — 6 DOI unresolved.

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHreporting
Verify the six references flagged as 'not found in registry' (e.g., encorafenib/binimetinib, cMyc/ERK, APG101, everolimus EXIST-1, temsirolimus mantle cell, ALK amplification) and correct or replace any that are erroneous or fabricated.
Unresolved references are a fabrication signal and must be checked against the original sources.
2.
HIGHreporting
Explicitly state adherence to a reporting guideline (e.g., CONSORT) in the Methods or Reporting Summary.
Both reviewers noted the absence of an explicit reporting guideline statement, which is a transparency gap.
3.
HIGHrigor
Provide a more detailed description of the randomization procedure for non-matched patients, including allocation concealment.
Both reviewers suggested this to strengthen the design description.
4.
HIGHstatistics
Clarify the handling of missing data for the primary endpoint in the statistical analysis section.
Both reviewers noted this is only briefly mentioned and needs more detail.
5.
MEDIUMreporting
Add a statement on whether any analyses were adjusted for multiple comparisons, given the multiple subtrials.
Reviewer 1 suggested this to address potential multiplicity issues.
6.
MEDIUMreporting
Specify the version of the RANO criteria used and any central review procedures in more detail.
Reviewer 1 suggested this to improve reproducibility.
7.
MEDIUMdata code
Consider depositing the statistical analysis code in a public repository to enhance reproducibility.
Both reviewers suggested this to improve reproducibility.
8.
MEDIUMreporting
In the Discussion, explicitly address the potential for bias due to the open-label design and the lack of blinding in the assessment of PFS-6.
Reviewer 2 suggested this to acknowledge a design limitation.
9.
MEDIUMreporting
Add a note on the generalizability of the results given the predominantly Caucasian population.
Reviewer 1 suggested this to address external validity.
10.
LOWcopyedit
Fix the typo 'glioblasstoma' in the Abstract.
Copyedit issue flagged by the scribe.
11.
LOWcopyedit
Fix the extra parenthesis in the sentence reporting the temsirolimus PFS-6 result.
Copyedit issue flagged by the scribe.
12.
LOWcopyedit
Revise the awkward sentence in Discussion paragraph 4 about palbociclib blood-brain barrier penetration for clarity.
Copyedit issue flagged by the scribe.
13.
LOWcopyedit
Replace 'randomized via randomizer.at' with a more formal description of the randomization tool.
Copyedit issue flagged by the scribe.
14.
LOWreporting
Reconcile the SOC group size discrepancy (54 in abstract vs 53 in Table 3) and clarify the footnote.
Integrity check flagged a minor internal contradiction that should be clarified.

Full text (83,688 chars · analyzed ~90%, head + tail)Analyzed: Aug 15, 2026