Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.

Name: Kaimen Rigor review — Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.
Item: Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.
Rating: 39
Author: Alpha1

van As N, Griffin C, Tree A, Patel J, Ostler P, van der Voet H, Loblaw A, Chu W, Ford D, Tolan S, Jain S, Camilleri P, Kancherla K, Frew J, Chan A, Naismith O, Armstrong J, Staffurth J, Martin A, Dayes I, Wells P, Price D, Williamson E, Pugh J, Manning G, Brown S, Burnett S, Hall E

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 1★ (Critical), 1 critical, 3 high issues for “Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.

Read full text (PMC)

DOI

10.1056/NEJMoa2403365

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/b57ecb64-8fd8-4d54-847a-c3f4fee2a9c5" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/b57ecb64-8fd8-4d54-847a-c3f4fee2a9c5/badge" alt="Kaimen Rigor review — 1★ (Critical), 1 critical, 3 high issues for “Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

417c319af02c28edd225f17afd82ff4fd3bbf55fbdfd4acc1116ac6185478450

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.

Paper source

Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic−1★
IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: moderateReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No data or code availability links were detected to verify.

Biggest issues1 demonstrable

01Significance claim does not survive recomputationdemonstrable
criticalOverreachrecomputedFull detail
Check p-value for non-inferiority from HR and 90% CI.
“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”
Find in source
02Reported statistic does not recompute
highArithmeticrecomputedFull detail
Recomputed HR 1.59 (95% CI 1.18–2.12), reported p<0.001
“HR 1.59 (95%CI 1.18, 2.12), p<0.001”
Find in source
03Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is biochemical/clinical failure, which is a surrogate for clinically meaningful outcomes like metastasis or survival. The paper does not provide evidence linking biochemical failure to patient-important outcomes in this context, nor does it demonstrate target engagement for the surrogate at the tested dose.
“The primary endpoint was freedom from biochemical/clinical failure with a critical hazard ratio for non-inferiority of 1.45.”
Find in source
04Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect is a small absolute difference of 1.43% in biochemical failure-free rates at 5 years, with confidence intervals crossing zero. No minimal clinically important difference is provided, and the effect is not anchored to clinical meaningfulness.
“The estimated absolute difference in the proportion of participants event free in the SBRT group compared with that in the CRT group at 5 years was: 1.43% (90% CI: -0.60, 2.78).”
Find in source

Findings by category

201ArithmeticNumerical inconsistencies 402OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found · partly checked 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase III randomized controlled trial with rigorous design, clear ethical approvals, and thorough reporting of biological variables and key resources. The main weaknesses are the lack of a specific data availability statement and the absence of a reporting guideline statement. A critical statistical verification finding shows that the reported non-inferiority p-value (0.004) is inconsistent with the recomputed value (0.145), which could affect the interpretation of the primary endpoint.

Both reviewers agreed on study type (interventional) and on all dimensions except statistical analysis, where the deterministic verification component overrode their pass. The statistics verification covered only 8 tests with test statistics or CIs; other p-values (e.g., threshold-only) were not machine-verified. The citation check found no retracted or unresolved references. The integrity check flagged only minor terminology inconsistencies.

Numerical inconsistencies

2 findings · worst high

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Reported statistics do not recomputeRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 8 tests: 6 consistent, 2 inconsistent (1 change significance at p<.05); 1 recomputed directly from the reported test statistics, 7 via agent-written checks.

Overstated conclusions

4 findings · worst critical

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Significance claim flips when recomputedRecomputed
Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior studies on hypofractionation and SBRT, and the rationale for testing non-inferiority is clearly linked to the potential benefits of SBRT. The limitations of prior research are implicitly addressed by the trial design, though not explicitly discussed in the introduction.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraph 2]

“Previous studies have confirmed non-inferiority for moderately hypofractionated radiotherapy compared with conventionally fractionated radiotherapy, and moderate hypofractionation has been established as a standard-of-care option.”

“Stereotactic body radiotherapy (SBRT) builds on these developments to allow ultra-hypofractionated radiotherapy to be delivered with precision.”

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed in the introduction.

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraph 2]

“Stereotactic body radiotherapy (SBRT) builds on these developments to allow ultra-hypofractionated radiotherapy to be delivered with precision.”

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

Randomization method and unit are clearly described (central computer-generated permuted blocks, stratified). Blinding is not applicable as it is an open-label trial, but this is stated. Power analysis is detailed with sample size calculation. Inclusion/exclusion criteria are pre-specified. Outlier handling is addressed through ITT and per-protocol analyses. Controls are inherent in the comparator arm. Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

“Randomization was performed centrally by the Institute of Cancer Research Clinical Trials and Statistics Unit (ICR-CTSU) using computer generated random permuted blocks (size 4 and 6), stratified by NCCN risk group (low vs intermediate) and randomizing center.”

MethodsFind in source

“Treatment was not masked.”

MethodsFind in source

“A non-inferiority margin of 6% at 5 years (critical hazard ratio (HR) 1.45; selected based on expert clinical opinion), 80% power, 5% one-sided significance and a 10% loss to follow-up allowance gave a sample size of 858 patients.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Treatment was not masked.”

MethodsFind in source

Statistical analysisFind in source

Sex is reported (all male), age and health status are reported, and demographics are detailed in Table 1. Sex justification is not applicable as the study is in prostate cancer (male-only). Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including age, PSA, and risk group.

Evidence

“Median age was 69.8 years (IQR 65.4, 74.0), median PSA ng/mL was 8.0 (IQR 5.9, 11.0)”

Results ¶2Find in source

paraphrase[Table 1]

“Ethnic origin | Black | 26 | (5.9) | 35 | (8.1) | 61 | (7.0)”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial, including age, PSA, and risk group.

Evidence

“Median age was 69.8 years (IQR 65.4, 74.0), median PSA ng/mL was 8.0 (IQR 5.9, 11.0)”

Results ¶2Find in source

paraphrase[Table 1]

“Ethnic origin | Black | 26 | (5.9) | 35 | (8.1) | 61 | (7.0)”

The trial was approved by the London Chelsea Research Ethics Committee with a protocol number, and written informed consent was obtained. Regulatory compliance with Good Clinical Practice is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are clearly documented with a named ethics committee and informed consent.

Evidence

“PACE is an investigator-initiated trial approved by the London Chelsea Research Ethics Committee (11/LO/1915) in the UK and the relevant institutional review boards in Ireland and Canada.”

MethodsFind in source

“Participants were recruited by their clinical teams and provided written, informed consent before enrolment.”

MethodsFind in source

“The trial was conducted in accordance with the principles of Good Clinical Practice.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals and consent are clearly documented.

Evidence

“PACE is an investigator-initiated trial approved by the London Chelsea Research Ethics Committee (11/LO/1915) in the UK and the relevant institutional review boards in Ireland and Canada.”

MethodsFind in source

“Participants were recruited by their clinical teams and provided written, informed consent before enrolment.”

MethodsFind in source

“The trial was conducted in accordance with the principles of Good Clinical Practice.”

MethodsFind in source

The radiotherapy regimens are described in detail (dose, fractions, delivery). Software used for analysis is identified (Stata version 17.0). No antibodies, cell lines, or other biological reagents are used, so those are not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The investigational product (radiotherapy regimens) is adequately identified, and software is identified.

Evidence

“36.25Gy in five fractions over 1-2 weeks (daily or alternate days) was delivered to 95% of the planning target volume”

MethodsFind in source

“Analyses are based on a data snapshot taken on 11th September 2023 and were conducted using Stata version 17.0.”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

The investigational product (radiotherapy regimens) is adequately described, and statistical software is identified.

Evidence

“36.25Gy in five fractions over 1-2 weeks (daily or alternate days) was delivered to 95% of the planning target volume”

MethodsFind in source

“Analyses are based on a data snapshot taken on 11th September 2023 and were conducted using Stata version 17.0.”

Statistical analysisFind in source

All statistical tests are named, assumptions are verified (proportional hazards assessed), exact p-values are reported, effect sizes with confidence intervals are provided, software is identified, and data presentation is appropriate for a clinical trial. Mathematical plausibility is not applicable for large-N continuous outcomes.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with confidence intervals.

Evidence

“Kaplan Meier methods were used to estimate event rates. Estimates of treatment effect were made using unadjusted and adjusted (NCCN risk group) Cox regression models.”

Statistical analysisFind in source

“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”

Results ¶3Find in source

“The estimated absolute difference in the proportion of participants event free in the SBRT group compared with that in the CRT group at 5 years was: 1.43% (90% CI: -0.60, 2.78).”

Results ¶3Find in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with confidence intervals.

Evidence

“Kaplan Meier methods were used to estimate event rates. Estimates of treatment effect were made using unadjusted and adjusted (NCCN risk group) Cox regression models.”

Statistical analysisFind in source

“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”

Results ¶3Find in source

“Five-year biochemical failure event-free rates (95% CI) were 94.6% (91.9, 96.4) for CRT and 95.8% (93.3, 97.4) for SBRT.”

Results ¶3Find in source

The paper mentions the protocol is available online and at NEJM.org, but does not provide a clear data availability statement for the trial data. No repository deposit or accession numbers are provided. Code sharing is not applicable as no custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“The protocol is available online () and at NEJM.org (https://www.nejm.org/)”

MethodsFind in source

absence[Entire paper]

No repository deposit is mentioned.

WARNReviewer 2· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“The protocol is available online () and at NEJM.org (https://www.nejm.org/)”

MethodsFind in source

absence[Paper]

No data repository deposit is mentioned.

The trial is registered (NCT01584258). Methods are detailed enough for replication. Limitations are discussed in the Discussion. Conclusions are proportional to the evidence. Funding and COI are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are complete, limitations are discussed, and conclusions are proportional.

Evidence

“ClinicalTrials.gov registration: NCT01584258”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“A limitation is that recommendations for five-fraction SBRT are restricted to men with similar risk features as those in the trial.”

“The Sponsor (The Royal Marsden NHS Foundation Trust) received funding from Accuray Incorporated for study management, international study coordination and analysis.”

FundingFind in source

PASSReviewer 2· 90% conf

The trial is registered, methods are complete, limitations are discussed, and conclusions are proportional.

Evidence

“ClinicalTrials.gov registration: NCT01584258”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“A limitation is that recommendations for five-fraction SBRT are restricted to men with similar risk features as those in the trial.”

“The Sponsor (The Royal Marsden NHS Foundation Trust) received funding from Accuray Incorporated for study management, international study coordination and analysis.”

FundingFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found · partly checked

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.

Checked 14 references by DOI: 10 verified — 4 no DOI (shown, not verified).

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is largely robust, but the non-inferiority p-value inconsistency is a substantive concern that warrants a correction or independent re-analysis. An informed reader should weigh this when interpreting the primary endpoint. The lack of a data availability statement is a reporting gap that could be addressed in a correction or data-sharing addendum.

1.
CRITICALstatistics
Resolve the statistics inconsistency that flips a significance claim: Recomputed 8 tests: 6 consistent, 2 inconsistent (1 change significance at p<.05); 1 recomputed directly from the reported test statistics, 7 via agent-written checks.
Demonstrable critical failure — blocks the verdict from passing.
2.
HIGHstatistics
Re-analyze and correct the non-inferiority p-value for the primary endpoint (HR 0.73, 90% CI 0.48–1.12) in the Results section; the reported p=0.004 is inconsistent with the recomputed p=0.145.
The non-inferiority conclusion hinges on this p-value; an incorrect p-value could mislead readers about the primary outcome.
3.
HIGHstatistics
Verify and correct the p-value for the HR 1.59 (95% CI 1.18–2.12) reported as p<0.001; the recomputed p is 0.0019.
Although the difference is small, accurate p-values are essential for transparency and reproducibility.
4.
HIGHdata code
Add a specific data availability statement in the Methods or a dedicated section, stating where de-identified patient-level data can be accessed (e.g., via a data access committee or a repository) and under what conditions.
The current statement only mentions protocol availability, which is inadequate for a data-driven clinical trial.
5.
MEDIUMreporting
Mention adherence to a reporting guideline such as CONSORT in the Methods or a checklist submission statement.
Reporting guidelines improve transparency and are expected for randomized trials.
6.
MEDIUMdata code
Consider depositing the statistical analysis code (e.g., Stata do-files) in a public repository like Zenodo or GitHub with a DOI.
Sharing code enhances reproducibility and allows independent verification of the statistical results.
7.
MEDIUMcopyedit
Fix the typo 'apriori' to 'a priori' in the Methods, Statistical analysis section.
Correct spelling is expected in a published manuscript.
8.
MEDIUMcopyedit
Standardize p-value formatting throughout the manuscript (e.g., add spaces around '<' and '=').
Consistent formatting improves readability and professionalism.
9.
LOWcopyedit
Clarify the sentence in the Discussion, paragraph 2 about biochemical failure-free rates for clarity.
The sentence is grammatically correct but could be clearer to readers.
10.
LOWreporting
In the Discussion, explicitly address how limitations of prior research (e.g., lack of long-term toxicity data) are mitigated by this trial's design.
This would strengthen the scientific premise and address a sub-criterion that was reported but inadequate.

Full text (31,099 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.

Read full text (PMC)

DOI

10.1056/NEJMoa2403365

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/b57ecb64-8fd8-4d54-847a-c3f4fee2a9c5" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/b57ecb64-8fd8-4d54-847a-c3f4fee2a9c5/badge" alt="Kaimen Rigor review — 1★ (Critical), 1 critical, 3 high issues for “Phase 3 Trial of Stereotactic Body Radiotherapy in Localized Prostate Cancer.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

417c319af02c28edd225f17afd82ff4fd3bbf55fbdfd4acc1116ac6185478450

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic−1★
IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: moderateReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No data or code availability links were detected to verify.

Biggest issues1 demonstrable

01Significance claim does not survive recomputationdemonstrable
criticalOverreachrecomputedFull detail
Check p-value for non-inferiority from HR and 90% CI.
“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”
Find in source
02Reported statistic does not recompute
highArithmeticrecomputedFull detail
Recomputed HR 1.59 (95% CI 1.18–2.12), reported p<0.001
“HR 1.59 (95%CI 1.18, 2.12), p<0.001”
Find in source
03Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is biochemical/clinical failure, which is a surrogate for clinically meaningful outcomes like metastasis or survival. The paper does not provide evidence linking biochemical failure to patient-important outcomes in this context, nor does it demonstrate target engagement for the surrogate at the tested dose.
“The primary endpoint was freedom from biochemical/clinical failure with a critical hazard ratio for non-inferiority of 1.45.”
Find in source
04Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect is a small absolute difference of 1.43% in biochemical failure-free rates at 5 years, with confidence intervals crossing zero. No minimal clinically important difference is provided, and the effect is not anchored to clinical meaningfulness.
“The estimated absolute difference in the proportion of participants event free in the SBRT group compared with that in the CRT group at 5 years was: 1.43% (90% CI: -0.60, 2.78).”
Find in source

Findings by category

201ArithmeticNumerical inconsistencies 402OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found · partly checked 06Copyedit6 minor suggestions

Numerical inconsistencies

2 findings · worst high

Reported statistics do not recomputeRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 8 tests: 6 consistent, 2 inconsistent (1 change significance at p<.05); 1 recomputed directly from the reported test statistics, 7 via agent-written checks.

Overstated conclusions

4 findings · worst critical

Significance claim flips when recomputedRecomputed
Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraph 2]

“Stereotactic body radiotherapy (SBRT) builds on these developments to allow ultra-hypofractionated radiotherapy to be delivered with precision.”

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed in the introduction.

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraph 2]

“Stereotactic body radiotherapy (SBRT) builds on these developments to allow ultra-hypofractionated radiotherapy to be delivered with precision.”

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Treatment was not masked.”

MethodsFind in source

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with clear randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Treatment was not masked.”

MethodsFind in source

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including age, PSA, and risk group.

Evidence

“Median age was 69.8 years (IQR 65.4, 74.0), median PSA ng/mL was 8.0 (IQR 5.9, 11.0)”

Results ¶2Find in source

paraphrase[Table 1]

“Ethnic origin | Black | 26 | (5.9) | 35 | (8.1) | 61 | (7.0)”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial, including age, PSA, and risk group.

Evidence

“Median age was 69.8 years (IQR 65.4, 74.0), median PSA ng/mL was 8.0 (IQR 5.9, 11.0)”

Results ¶2Find in source

paraphrase[Table 1]

“Ethnic origin | Black | 26 | (5.9) | 35 | (8.1) | 61 | (7.0)”

The trial was approved by the London Chelsea Research Ethics Committee with a protocol number, and written informed consent was obtained. Regulatory compliance with Good Clinical Practice is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are clearly documented with a named ethics committee and informed consent.

Evidence

“PACE is an investigator-initiated trial approved by the London Chelsea Research Ethics Committee (11/LO/1915) in the UK and the relevant institutional review boards in Ireland and Canada.”

MethodsFind in source

“Participants were recruited by their clinical teams and provided written, informed consent before enrolment.”

MethodsFind in source

“The trial was conducted in accordance with the principles of Good Clinical Practice.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals and consent are clearly documented.

Evidence

“PACE is an investigator-initiated trial approved by the London Chelsea Research Ethics Committee (11/LO/1915) in the UK and the relevant institutional review boards in Ireland and Canada.”

MethodsFind in source

“Participants were recruited by their clinical teams and provided written, informed consent before enrolment.”

MethodsFind in source

“The trial was conducted in accordance with the principles of Good Clinical Practice.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The investigational product (radiotherapy regimens) is adequately identified, and software is identified.

Evidence

“36.25Gy in five fractions over 1-2 weeks (daily or alternate days) was delivered to 95% of the planning target volume”

MethodsFind in source

“Analyses are based on a data snapshot taken on 11th September 2023 and were conducted using Stata version 17.0.”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

The investigational product (radiotherapy regimens) is adequately described, and statistical software is identified.

Evidence

“36.25Gy in five fractions over 1-2 weeks (daily or alternate days) was delivered to 95% of the planning target volume”

MethodsFind in source

“Analyses are based on a data snapshot taken on 11th September 2023 and were conducted using Stata version 17.0.”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with confidence intervals.

Evidence

“Kaplan Meier methods were used to estimate event rates. Estimates of treatment effect were made using unadjusted and adjusted (NCCN risk group) Cox regression models.”

Statistical analysisFind in source

“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”

Results ¶3Find in source

“The estimated absolute difference in the proportion of participants event free in the SBRT group compared with that in the CRT group at 5 years was: 1.43% (90% CI: -0.60, 2.78).”

Results ¶3Find in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with confidence intervals.

Evidence

“Kaplan Meier methods were used to estimate event rates. Estimates of treatment effect were made using unadjusted and adjusted (NCCN risk group) Cox regression models.”

Statistical analysisFind in source

“SBRT was non-inferior to CRT with an unadjusted HR 0.73 (90%CI 0.48, 1.12), p-value for non-inferiority=0.004”

Results ¶3Find in source

“Five-year biochemical failure event-free rates (95% CI) were 94.6% (91.9, 96.4) for CRT and 95.8% (93.3, 97.4) for SBRT.”

Results ¶3Find in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“The protocol is available online () and at NEJM.org (https://www.nejm.org/)”

MethodsFind in source

absence[Entire paper]

No repository deposit is mentioned.

WARNReviewer 2· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“The protocol is available online () and at NEJM.org (https://www.nejm.org/)”

MethodsFind in source

absence[Paper]

No data repository deposit is mentioned.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are complete, limitations are discussed, and conclusions are proportional.

Evidence

“ClinicalTrials.gov registration: NCT01584258”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“A limitation is that recommendations for five-fraction SBRT are restricted to men with similar risk features as those in the trial.”

“The Sponsor (The Royal Marsden NHS Foundation Trust) received funding from Accuray Incorporated for study management, international study coordination and analysis.”

FundingFind in source

PASSReviewer 2· 90% conf

The trial is registered, methods are complete, limitations are discussed, and conclusions are proportional.

Evidence

“ClinicalTrials.gov registration: NCT01584258”

AbstractFind in source

paraphrase[Discussion, paragraph 4]

“A limitation is that recommendations for five-fraction SBRT are restricted to men with similar risk features as those in the trial.”

“The Sponsor (The Royal Marsden NHS Foundation Trust) received funding from Accuray Incorporated for study management, international study coordination and analysis.”

FundingFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found · partly checked

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.

Checked 14 references by DOI: 10 verified — 4 no DOI (shown, not verified).

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
CRITICALstatistics
Resolve the statistics inconsistency that flips a significance claim: Recomputed 8 tests: 6 consistent, 2 inconsistent (1 change significance at p<.05); 1 recomputed directly from the reported test statistics, 7 via agent-written checks.
Demonstrable critical failure — blocks the verdict from passing.
2.
HIGHstatistics
Re-analyze and correct the non-inferiority p-value for the primary endpoint (HR 0.73, 90% CI 0.48–1.12) in the Results section; the reported p=0.004 is inconsistent with the recomputed p=0.145.
The non-inferiority conclusion hinges on this p-value; an incorrect p-value could mislead readers about the primary outcome.
3.
HIGHstatistics
Verify and correct the p-value for the HR 1.59 (95% CI 1.18–2.12) reported as p<0.001; the recomputed p is 0.0019.
Although the difference is small, accurate p-values are essential for transparency and reproducibility.
4.
HIGHdata code
Add a specific data availability statement in the Methods or a dedicated section, stating where de-identified patient-level data can be accessed (e.g., via a data access committee or a repository) and under what conditions.
The current statement only mentions protocol availability, which is inadequate for a data-driven clinical trial.
5.
MEDIUMreporting
Mention adherence to a reporting guideline such as CONSORT in the Methods or a checklist submission statement.
Reporting guidelines improve transparency and are expected for randomized trials.
6.
MEDIUMdata code
Consider depositing the statistical analysis code (e.g., Stata do-files) in a public repository like Zenodo or GitHub with a DOI.
Sharing code enhances reproducibility and allows independent verification of the statistical results.
7.
MEDIUMcopyedit
Fix the typo 'apriori' to 'a priori' in the Methods, Statistical analysis section.
Correct spelling is expected in a published manuscript.
8.
MEDIUMcopyedit
Standardize p-value formatting throughout the manuscript (e.g., add spaces around '<' and '=').
Consistent formatting improves readability and professionalism.
9.
LOWcopyedit
Clarify the sentence in the Discussion, paragraph 2 about biochemical failure-free rates for clarity.
The sentence is grammatically correct but could be clearer to readers.
10.
LOWreporting
In the Discussion, explicitly address how limitations of prior research (e.g., lack of long-term toxicity data) are mitigated by this trial's design.
This would strengthen the scientific premise and address a sub-criterion that was reported but inadequate.

Full text (31,099 chars)Analyzed: Aug 16, 2026