Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.

Name: Kaimen Rigor review — Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.
Item: Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.
Rating: 59
Author: Alpha1

Long GV, Carlino MS, Au-Yeung G, Spillane AJ, Shannon KF, Gyorki DE, Hsiao E, Kapoor R, Thompson JR, Batula I, Howle J, Ch'ng S, Gonzalez M, Saw RPM, Pennington TE, Lo SN, Scolyer RA, Menzies AM

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2★ (Weak), 0 critical, 5 high issues for “Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.

Long GV, Carlino MS, Au-Yeung G, Spillane AJ, Shannon KF, Gyorki DE, Hsiao E, Kapoor R, Thompson JR, Batula I, Howle J, Ch'ng S, Gonzalez M, Saw RPM, Pennington TE, Lo SN, Scolyer RA, Menzies AM

Read full text (PMC)

DOI

10.1038/s41591-024-03077-5

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/e4581a52-a41b-4970-a10a-fb0315137aec" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/e4581a52-a41b-4970-a10a-fb0315137aec/badge" alt="Kaimen Rigor review — 2★ (Weak), 0 critical, 5 high issues for “Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

9a2540416a766760346fad0041a0797d56113726dec029975e9e463afbae45f7

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.

Long GV, Carlino MS, Au-Yeung G, Spillane AJ, Shannon KF, Gyorki DE, Hsiao E, Kapoor R, Thompson JR, Batula I, Howle J, Ch'ng S, Gonzalez M, Saw RPM, Pennington TE, Lo SN, Scolyer RA, Menzies AM

Paper source

Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped) ×18−0.25★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on pathological response rate, a surrogate endpoint. Although the paper discusses the correlation between pathological response and survival, it does not provide validated evidence linking pathological response to long-term clinical outcomes in this specific context, nor does it demonstrate target engagement at the tested dose. The paper itself notes that pathological response is a surrogate and that longer follow-up is needed.
“Pathological response is currently the best surrogate marker for survival following neoadjuvant therapy”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is the pathological response rate, which is a surrogate. The effect sizes (e.g., 55%, 50%, 80%) are not anchored to a minimal clinically important difference or to a clear clinical benefit. The paper acknowledges that the trial was not powered for comparisons and that longer follow-up is needed, so the clinical meaningfulness of the effect sizes is not established.
“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”
Find in source
03Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
36% does not match the reported count 7/20
“sensitivity (36%)”
Efficacy: responseFind in source
04Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
92% does not match the reported count 18/20
“specificity (92%)”
Efficacy: responseFind in source
05Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
22% does not match the reported count 4/20
“sensitivity (22%)”
Efficacy: responseFind in source
06Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
92% does not match the reported count 18/20
“specificity (92%)”
Efficacy: responseFind in source

15 further findings of this severity or below — every one is in the sections below, filed under its error type.

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a well-conducted randomized phase 2 trial with strong scientific premise, rigorous design, and transparent reporting. The main weaknesses are a vague data availability statement, lack of explicit reporting guideline adherence, and a concerning rate of statistical inconsistencies flagged by automated verification.

Both reviewers agreed on study type (interventional) and on all dimension statuses except statistical analysis, where the deterministic verification provided additional evidence that led to a downgrade from pass to warn. The statistics verification covered only a subset of tests (those with test statistics + df or effect estimates + CI); threshold-only p-values and exact tests were not machine-verifiable. The copyedit pass flagged minor internal inconsistencies in Table 3 and a typo in the funding acknowledgement.

Numerical inconsistencies

2 findings · worst medium

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks. 18 printed percentages that do not match their own count.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions overstated beyond the evidenceAssessed

3 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites multiple studies (Keynote-022, COMBI-i, IMspire150, SECOMBIT, DREAMseq, SWOG S1801) and discusses the mechanisms by which targeted therapy may enhance immunotherapy. It also acknowledges limitations of prior work, such as the lack of benefit of neoadjuvant targeted therapy alone and the need for better combinations. The hypothesis follows logically from the cited evidence.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise by citing prior work on BRAF/MEK inhibitors and immune checkpoint inhibitors, and provides a logical rationale for combining them in the neoadjuvant setting.

Evidence

paraphrase[Introduction, paragraph 1-3]

“Three trials (Keynote-022, COMBI-i and IMspire150) have tested the use of BRAF-targeted therapy with or without concurrent anti-PD-1 in advanced BRAF-mutant melanoma.”

paraphrase[Introduction, paragraph 2]

“Treatment with BRAF/MEK inhibitors has been shown to induce a favorable tumor immune microenvironment in melanoma.”

paraphrase[Introduction, paragraph 4]

“Interestingly, the 2-year recurrence-free survival (RFS) rate was only 79% in patients achieving a pCR to targeted therapy, compared with 96% for patients achieving any pathological response to an ICI regimen.”

PASSReviewer 2· 90% conf

Evidence

paraphrase[Introduction, paragraph 2]

“Three trials (Keynote-022, COMBI-i and IMspire150) have tested the use of BRAF-targeted therapy with or without concurrent anti-PD-1 in advanced BRAF-mutant melanoma.”

“Immune changes early during targeted therapy suggest the mechanisms of each drug class could work synergistically.”

Introduction ¶1Find in source

“However, the most effective way to combine these treatments is unknown.”

Introduction ¶2Find in source

Randomization method is described (web-based, permuted blocks, stratified by BRAF mutation subtype). Blinding is not applicable as it is an open-label trial, but this is stated. Power analysis is provided for the single-arm design. Inclusion/exclusion criteria are detailed. Outlier handling is not explicitly described, but the analysis population (ITT) is defined. Controls are not applicable as this is a non-comparative trial with three active arms. Independent replication is not applicable for a single trial.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, stratification, and pre-specified endpoints, though it is open-label and not powered for inter-arm comparisons.

Evidence

paraphrase[Methods, Patients and study design]

“Patients were randomized in a 1:1:1 ratio via a web-based system in permuted blocks (block sizes 6 and 9) and stratified by BRAF V600E versus non-BRAF V600E mutation.”

paraphrase[Methods, Statistical methods]

“The sample size of 20 patients per arm (n=60) was calculated to determine whether the pathological response rate was ≤5% or ≥20%.”

paraphrase[Methods, Patients and study design]

“NeoTrio was a randomized, multi-arm, open-label, parallel phase II study.”

PASSReviewer 2· 90% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

paraphrase[Methods, Treatment]

“Patients were randomized in a 1:1:1 ratio via a web-based system in permuted blocks (block sizes 6 and 9) and stratified by BRAF V600E versus non-BRAF V600E.”

paraphrase[Methods, Statistical methods]

“The sample size of 20 patients per arm (n=60) was calculated to determine whether the pathological response rate was ≤5% or ≥20%.”

paraphrase[Methods, Patients and study design]

“NeoTrio was a randomized, multi-arm, open-label, parallel phase II study.”

Sex is reported (42% female). Age is reported (median 53). Demographics include ECOG status and BRAF mutation subtype. Species/strain and housing are not applicable for a human trial. Sex justification is not applicable as both sexes are enrolled.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including sex, age, and disease characteristics.

Evidence

paraphrase[Table 1]

“Age in years, median (IQR) | 56 (51, 64) | 50 (38, 63) | 53 (42, 61) | 53 (42, 63) | Sex, n (%) | Female | 8 (40) | 8 (40) | 9 (45) | 25 (42)”

paraphrase[Table 1]

“ECOG status, n (%) | 0 | 20 (100) | 19 (95) | 20 (100) | 59 (98) | 1 | 0 | 1 (5) | 0 | 1 (2)”

PASSReviewer 2· 90% conf

Biological variables are well reported: sex, age, health status, and demographics are provided; species/strain and housing are not applicable for a human trial.

Evidence

paraphrase[Results, Baseline characteristics]

“25 (42%) patients were females.”

paraphrase[Results, Baseline characteristics]

“At baseline, the median age was 53 (interquartile range (IQR) = 42–63).”

paraphrase[Results, Baseline characteristics]

“49 (82%) patients had V600E, 9 (15%) had V600K and 2 (3%) had V600R.”

The study states it was performed in accordance with the Declaration of Helsinki and Good Clinical Practice, and that the protocol was approved by the human research ethics committee at each participating institution. Written informed consent was obtained. Regulatory compliance is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Ethical approvals and consent are adequately reported.

Evidence

“The study was performed in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines. Patients provided written informed consent. The study protocol was approved by the human research ethics committee at each participating institution.”

MethodsFind in source

PASSReviewer 2· 90% conf

Ethical approvals are adequately reported: named ethics committee approval, informed consent, and regulatory compliance are stated.

Evidence

“The study protocol was approved by the human research ethics committee at each participating institution.”

MethodsFind in source

“Patients provided written informed consent.”

MethodsFind in source

“The study was performed in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines.”

MethodsFind in source

The investigational products (pembrolizumab, dabrafenib, trametinib) are named with manufacturers and dosing regimens. Statistical software (SAS 9.4, R 4.1.3) is identified. Antibodies, cell lines, and mycoplasma testing are not applicable as this is a clinical trial without wet-lab assays.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources, including investigational drugs and software, are adequately identified.

Evidence

“Study drugs were supplied by Merck Sharp & Dohme (pembrolizumab) and Novartis (dabrafenib and trametinib).”

AcknowledgementsFind in source

“All statistical analyses were performed using SAS (version 9.4) and R (version 4.1.3).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Key resources are adequately identified: investigational drugs are named with manufacturer, and statistical software is identified.

Evidence

“Study drugs were supplied by Merck Sharp & Dohme (pembrolizumab) and Novartis (dabrafenib and trametinib).”

AcknowledgementsFind in source

“All statistical analyses were performed using SAS (version 9.4) and R (version 4.1.3).”

Statistical analysisFind in source

Statistical tests are named (Clopper-Pearson exact CIs, Kaplan-Meier, mixed linear modeling). Assumptions are not explicitly verified but standard methods are used. Exact p-values are reported for HRQOL (e.g., P < 0.05, P < 0.001). Effect sizes with CIs are reported for response rates and HRQOL changes. Software is identified. Data presentation includes per-group n and CIs. Mathematical plausibility checks were performed and no issues found.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityPASS

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with exact p-values reported for HRQOL analyses and effect sizes with CIs for response rates.

Evidence

“The primary and secondary response outcomes were summarized using frequency and proportion by arm along with the two-sided 95% Clopper–Pearson exact CIs.”

Statistical analysisFind in source

“Global Health Score (GHS) mean change: −10.83 (95% CI, −19.63 to −2.01), P < 0.05”

ResultsFind in source

“A pathological response was achieved in 55% (11/20; 95% CI, 36–83) of patients in the pembrolizumab arm”

ResultsFind in source

PASSReviewer 2· 90% conf

Statistical analysis is rigorous: tests are named, effect sizes with CIs are reported, software is identified, and data presentation is appropriate for a clinical trial.

Evidence

“The primary and secondary response outcomes were summarized using frequency and proportion by arm along with the two-sided 95% Clopper–Pearson exact CIs.”

Statistical analysisFind in source

paraphrase[Results, Efficacy: response]

“A pathological response was achieved in 55% (11/20; 95% CI, 36–83) of patients in the pembrolizumab arm.”

“Global Health Score (GHS) mean change: −10.83 (95% CI, −19.63 to −2.01), P < 0.05”

ResultsFind in source

The data availability statement says 'De-identified data are available on reasonable request and after signing of a data transfer agreement with Melanoma Institute Australia.' This is a managed access route but lacks specific conditions or a timeframe. No repository deposit or accession numbers are provided, which is acceptable for patient-level data. Code sharing is not applicable as no custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

Data availability statement is present but vague, lacking a concrete mechanism or timeframe.

Evidence

“De-identified data are available on reasonable request and after signing of a data transfer agreement with Melanoma Institute Australia.”

Data availabilityFind in source

WARNReviewer 2· 80% conf

Data availability statement is present but vague, lacking a concrete mechanism or platform; code sharing is not applicable.

Evidence

“De-identified data are available on reasonable request and after signing of a data transfer agreement with Melanoma Institute Australia.”

Data availabilityFind in source

The trial is registered (NCT02858921). Methods are detailed enough for replication. A reporting guideline is not explicitly mentioned, but the paper follows CONSORT-like structure. All pre-specified outcomes are reported, including negative results. Limitations are discussed. Conclusions are proportional to the evidence. Funding and COI are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Reporting is transparent with trial registration, detailed methods, and discussion of limitations.

Evidence

“ClinicalTrials.gov registration: NCT02858921”

AbstractFind in source

“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“Funding support was provided by Melanoma Institute Australia and Merck Sharp & Dohme.”

PASSReviewer 2· 90% conf

Reporting is transparent: methods are complete, trial is registered, limitations are discussed, conclusions are proportional, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT02858921”

AbstractFind in source

“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“Funding support was provided by Melanoma Institute Australia and Merck Sharp & Dohme.”

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 48 references by DOI: 46 verified — 2 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is generally robust, but readers should weigh the high rate of statistical inconsistencies flagged by automated verification and the internal inconsistencies in Table 3. An erratum or independent re-analysis may be warranted to confirm the reported response rates and HRQOL findings.

1.
HIGHstatistics
Investigate the 18 of 19 recomputable tests that were flagged as inconsistent by the automated verification; re-check the reported test statistics, degrees of freedom, and effect estimates against the raw data, and correct any errors or clarify the discrepancies in a correction or erratum.
A high rate of recomputation inconsistencies is a validity threat that could undermine confidence in the reported results.
2.
HIGHcopyedit
Correct the internal inconsistency in Table 3: the PR row for the pembrolizumab arm shows 3 (25) but 3/20 is 15%, not 25%; verify the denominator and correct the percentage.
An arithmetic error in a key efficacy table is a concrete reporting error that readers will notice.
3.
HIGHcopyedit
Resolve the discrepancy between the text stating 'including five CMR in the concurrent arm' and Table 3 showing 3 CMR (15%) for the concurrent arm; correct the text or the table to be consistent.
Internal contradictions between text and tables undermine the paper's credibility.
4.
HIGHreporting
Explicitly state adherence to CONSORT reporting guidelines in the Methods or a separate Reporting Summary section.
The paper follows CONSORT-like structure but does not explicitly cite the guideline, which is a reporting transparency gap.
5.
HIGHdata code
Improve the data availability statement by specifying a data access committee or platform (e.g., Vivli), the conditions for access, and a timeframe for response.
The current statement is vague and lacks a concrete mechanism, which limits reproducibility.
6.
MEDIUMcopyedit
Fix the typo 'NMHRC' to 'NHMRC' in the funding acknowledgement.
A misspelled funding body name is a minor but easily correctable error.
7.
MEDIUMstatistics
Report exact p-values for all secondary endpoints, not just HRQOL, where applicable.
Threshold-only p-values (e.g., 'P < 0.05') are imprecise and hinder verification.
8.
MEDIUMstatistics
Add a statement on how outliers were handled in the statistical analysis, even if none were excluded.
Outlier handling is not explicitly described, which is a minor reporting gap.
9.
MEDIUMstatistics
Clarify the assumptions of the statistical models used, particularly for the mixed linear modeling of HRQOL data.
Assumption verification is not explicitly reported, which is a minor gap.
10.
LOWreporting
Add a note on the open-label design rationale in the Methods to strengthen blinding justification.
The open-label design is stated but not justified, which is a minor transparency issue.
11.
LOWdata code
Include a statement on the absence of custom code or provide code if used for analyses.
Clarifying code availability is a nice-to-have for reproducibility.

Full text (52,122 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.

Long GV, Carlino MS, Au-Yeung G, Spillane AJ, Shannon KF, Gyorki DE, Hsiao E, Kapoor R, Thompson JR, Batula I, Howle J, Ch'ng S, Gonzalez M, Saw RPM, Pennington TE, Lo SN, Scolyer RA, Menzies AM

Read full text (PMC)

DOI

10.1038/s41591-024-03077-5

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/e4581a52-a41b-4970-a10a-fb0315137aec" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/e4581a52-a41b-4970-a10a-fb0315137aec/badge" alt="Kaimen Rigor review — 2★ (Weak), 0 critical, 5 high issues for “Neoadjuvant pembrolizumab, dabrafenib and trametinib in BRAF(V600)-mutant resectable melanoma: the randomized phase 2 NeoTrio trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

9a2540416a766760346fad0041a0797d56113726dec029975e9e463afbae45f7

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped) ×18−0.25★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on pathological response rate, a surrogate endpoint. Although the paper discusses the correlation between pathological response and survival, it does not provide validated evidence linking pathological response to long-term clinical outcomes in this specific context, nor does it demonstrate target engagement at the tested dose. The paper itself notes that pathological response is a surrogate and that longer follow-up is needed.
“Pathological response is currently the best surrogate marker for survival following neoadjuvant therapy”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is the pathological response rate, which is a surrogate. The effect sizes (e.g., 55%, 50%, 80%) are not anchored to a minimal clinically important difference or to a clear clinical benefit. The paper acknowledges that the trial was not powered for comparisons and that longer follow-up is needed, so the clinical meaningfulness of the effect sizes is not established.
“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”
Find in source
03Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
36% does not match the reported count 7/20
“sensitivity (36%)”
Efficacy: responseFind in source
04Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
92% does not match the reported count 18/20
“specificity (92%)”
Efficacy: responseFind in source
05Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
22% does not match the reported count 4/20
“sensitivity (22%)”
Efficacy: responseFind in source
06Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
92% does not match the reported count 18/20
“specificity (92%)”
Efficacy: responseFind in source

15 further findings of this severity or below — every one is in the sections below, filed under its error type.

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

Numerical inconsistencies

2 findings · worst medium

Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks. 18 printed percentages that do not match their own count.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions overstated beyond the evidenceAssessed

3 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Evidence

paraphrase[Introduction, paragraph 1-3]

“Three trials (Keynote-022, COMBI-i and IMspire150) have tested the use of BRAF-targeted therapy with or without concurrent anti-PD-1 in advanced BRAF-mutant melanoma.”

paraphrase[Introduction, paragraph 2]

“Treatment with BRAF/MEK inhibitors has been shown to induce a favorable tumor immune microenvironment in melanoma.”

paraphrase[Introduction, paragraph 4]

PASSReviewer 2· 90% conf

Evidence

paraphrase[Introduction, paragraph 2]

“Three trials (Keynote-022, COMBI-i and IMspire150) have tested the use of BRAF-targeted therapy with or without concurrent anti-PD-1 in advanced BRAF-mutant melanoma.”

“Immune changes early during targeted therapy suggest the mechanisms of each drug class could work synergistically.”

Introduction ¶1Find in source

“However, the most effective way to combine these treatments is unknown.”

Introduction ¶2Find in source

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, stratification, and pre-specified endpoints, though it is open-label and not powered for inter-arm comparisons.

Evidence

paraphrase[Methods, Patients and study design]

“Patients were randomized in a 1:1:1 ratio via a web-based system in permuted blocks (block sizes 6 and 9) and stratified by BRAF V600E versus non-BRAF V600E mutation.”

paraphrase[Methods, Statistical methods]

“The sample size of 20 patients per arm (n=60) was calculated to determine whether the pathological response rate was ≤5% or ≥20%.”

paraphrase[Methods, Patients and study design]

“NeoTrio was a randomized, multi-arm, open-label, parallel phase II study.”

PASSReviewer 2· 90% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

paraphrase[Methods, Treatment]

“Patients were randomized in a 1:1:1 ratio via a web-based system in permuted blocks (block sizes 6 and 9) and stratified by BRAF V600E versus non-BRAF V600E.”

paraphrase[Methods, Statistical methods]

“The sample size of 20 patients per arm (n=60) was calculated to determine whether the pathological response rate was ≤5% or ≥20%.”

paraphrase[Methods, Patients and study design]

“NeoTrio was a randomized, multi-arm, open-label, parallel phase II study.”

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including sex, age, and disease characteristics.

Evidence

paraphrase[Table 1]

“Age in years, median (IQR) | 56 (51, 64) | 50 (38, 63) | 53 (42, 61) | 53 (42, 63) | Sex, n (%) | Female | 8 (40) | 8 (40) | 9 (45) | 25 (42)”

paraphrase[Table 1]

“ECOG status, n (%) | 0 | 20 (100) | 19 (95) | 20 (100) | 59 (98) | 1 | 0 | 1 (5) | 0 | 1 (2)”

PASSReviewer 2· 90% conf

Biological variables are well reported: sex, age, health status, and demographics are provided; species/strain and housing are not applicable for a human trial.

Evidence

paraphrase[Results, Baseline characteristics]

“25 (42%) patients were females.”

paraphrase[Results, Baseline characteristics]

“At baseline, the median age was 53 (interquartile range (IQR) = 42–63).”

paraphrase[Results, Baseline characteristics]

“49 (82%) patients had V600E, 9 (15%) had V600K and 2 (3%) had V600R.”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Ethical approvals and consent are adequately reported.

Evidence

MethodsFind in source

PASSReviewer 2· 90% conf

Ethical approvals are adequately reported: named ethics committee approval, informed consent, and regulatory compliance are stated.

Evidence

“The study protocol was approved by the human research ethics committee at each participating institution.”

MethodsFind in source

“Patients provided written informed consent.”

MethodsFind in source

“The study was performed in accordance with the Declaration of Helsinki and Good Clinical Practice guidelines.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources, including investigational drugs and software, are adequately identified.

Evidence

“Study drugs were supplied by Merck Sharp & Dohme (pembrolizumab) and Novartis (dabrafenib and trametinib).”

AcknowledgementsFind in source

“All statistical analyses were performed using SAS (version 9.4) and R (version 4.1.3).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Key resources are adequately identified: investigational drugs are named with manufacturer, and statistical software is identified.

Evidence

“Study drugs were supplied by Merck Sharp & Dohme (pembrolizumab) and Novartis (dabrafenib and trametinib).”

AcknowledgementsFind in source

“All statistical analyses were performed using SAS (version 9.4) and R (version 4.1.3).”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityPASS

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with exact p-values reported for HRQOL analyses and effect sizes with CIs for response rates.

Evidence

“The primary and secondary response outcomes were summarized using frequency and proportion by arm along with the two-sided 95% Clopper–Pearson exact CIs.”

Statistical analysisFind in source

“Global Health Score (GHS) mean change: −10.83 (95% CI, −19.63 to −2.01), P < 0.05”

ResultsFind in source

“A pathological response was achieved in 55% (11/20; 95% CI, 36–83) of patients in the pembrolizumab arm”

ResultsFind in source

PASSReviewer 2· 90% conf

Statistical analysis is rigorous: tests are named, effect sizes with CIs are reported, software is identified, and data presentation is appropriate for a clinical trial.

Evidence

“The primary and secondary response outcomes were summarized using frequency and proportion by arm along with the two-sided 95% Clopper–Pearson exact CIs.”

Statistical analysisFind in source

paraphrase[Results, Efficacy: response]

“A pathological response was achieved in 55% (11/20; 95% CI, 36–83) of patients in the pembrolizumab arm.”

“Global Health Score (GHS) mean change: −10.83 (95% CI, −19.63 to −2.01), P < 0.05”

ResultsFind in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

Data availability statement is present but vague, lacking a concrete mechanism or timeframe.

Evidence

“De-identified data are available on reasonable request and after signing of a data transfer agreement with Melanoma Institute Australia.”

Data availabilityFind in source

WARNReviewer 2· 80% conf

Data availability statement is present but vague, lacking a concrete mechanism or platform; code sharing is not applicable.

Evidence

“De-identified data are available on reasonable request and after signing of a data transfer agreement with Melanoma Institute Australia.”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Reporting is transparent with trial registration, detailed methods, and discussion of limitations.

Evidence

“ClinicalTrials.gov registration: NCT02858921”

AbstractFind in source

“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“Funding support was provided by Melanoma Institute Australia and Merck Sharp & Dohme.”

PASSReviewer 2· 90% conf

Reporting is transparent: methods are complete, trial is registered, limitations are discussed, conclusions are proportional, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT02858921”

AbstractFind in source

“The NeoTrio trial was not powered to make statistical comparisons between the three arms, which limits the interpretation of the findings.”

DiscussionFind in source

paraphrase[Acknowledgements and Competing interests]

“Funding support was provided by Melanoma Institute Australia and Merck Sharp & Dohme.”

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 48 references by DOI: 46 verified — 2 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHstatistics
Investigate the 18 of 19 recomputable tests that were flagged as inconsistent by the automated verification; re-check the reported test statistics, degrees of freedom, and effect estimates against the raw data, and correct any errors or clarify the discrepancies in a correction or erratum.
A high rate of recomputation inconsistencies is a validity threat that could undermine confidence in the reported results.
2.
HIGHcopyedit
Correct the internal inconsistency in Table 3: the PR row for the pembrolizumab arm shows 3 (25) but 3/20 is 15%, not 25%; verify the denominator and correct the percentage.
An arithmetic error in a key efficacy table is a concrete reporting error that readers will notice.
3.
HIGHcopyedit
Resolve the discrepancy between the text stating 'including five CMR in the concurrent arm' and Table 3 showing 3 CMR (15%) for the concurrent arm; correct the text or the table to be consistent.
Internal contradictions between text and tables undermine the paper's credibility.
4.
HIGHreporting
Explicitly state adherence to CONSORT reporting guidelines in the Methods or a separate Reporting Summary section.
The paper follows CONSORT-like structure but does not explicitly cite the guideline, which is a reporting transparency gap.
5.
HIGHdata code
Improve the data availability statement by specifying a data access committee or platform (e.g., Vivli), the conditions for access, and a timeframe for response.
The current statement is vague and lacks a concrete mechanism, which limits reproducibility.
6.
MEDIUMcopyedit
Fix the typo 'NMHRC' to 'NHMRC' in the funding acknowledgement.
A misspelled funding body name is a minor but easily correctable error.
7.
MEDIUMstatistics
Report exact p-values for all secondary endpoints, not just HRQOL, where applicable.
Threshold-only p-values (e.g., 'P < 0.05') are imprecise and hinder verification.
8.
MEDIUMstatistics
Add a statement on how outliers were handled in the statistical analysis, even if none were excluded.
Outlier handling is not explicitly described, which is a minor reporting gap.
9.
MEDIUMstatistics
Clarify the assumptions of the statistical models used, particularly for the mixed linear modeling of HRQOL data.
Assumption verification is not explicitly reported, which is a minor gap.
10.
LOWreporting
Add a note on the open-label design rationale in the Methods to strengthen blinding justification.
The open-label design is stated but not justified, which is a minor transparency issue.
11.
LOWdata code
Include a statement on the absence of custom code or provide code if used for analyses.
Clarifying code availability is a nice-to-have for reproducibility.

Full text (52,122 chars)Analyzed: Aug 16, 2026