Rigor Reviewed

Rigor-Reviewed Manuscript

Trial of N-Acetyl-l-Leucine in Niemann-Pick Disease Type C.

Name: Αlpha¹ Rigor Record — Trial of N-Acetyl-l-Leucine in Niemann-Pick Disease Type C.
Item: Trial of N-Acetyl-l-Leucine in Niemann-Pick Disease Type C.
Rating: 96
Author: Αlpha¹

Bremova-Ertl T, Ramaswami U, Brands M, Foltan T, Gautschi M, Gissen P, Gowing F, Hahn A, Jones S, Kay R, Kolnikova M, Arash-Kaps L, Marquardt T, Mengel E, Park JH, Reichmannová S, Schneider SA, Sivananthan S, Walterfang M, Wibawa P, Strupp M, Martakis K

Paper source

Read full text

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.25★ (Weak), 0 critical, 2 high issues for “Trial of N-Acetyl-l-Leucine in Niemann-Pick Disease Type C.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 16, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

CitationsUnresolved reference ×4−1★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 16 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.
No data or code availability links were detected to verify.

Problems surfaced5 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions2

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported phase 3 randomized controlled trial. The main methodological strengths include rigorous randomization, blinding, pre-specified analysis, and comprehensive reporting of demographics and ethics. The primary weakness is the vague data sharing statement, which lacks details on how to access the data.

Both reviewers classified the study as interventional, which is adopted. The evaluation covers all eight dimensions; several sub-criteria were marked not applicable due to the human clinical trial context (e.g., no animal housing, no cell lines). The statistics verification checked only 1 test and found it consistent; this does not confirm overall statistical correctness.

3 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks.

1 integrity concern flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites prior research on NALL's mechanism and animal models, and a phase 2b trial, providing a strong foundation. The rationale linking NALL's effects to the study objectives is clear. Limitations of prior work are implicitly addressed by the phase 3 design, though not explicitly discussed.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraph 2]

“In an Npc1 −/− mouse model of Niemann–Pick disease type C, treatment with NALL delayed the onset of functional decline ... and prolonged survival.”

paraphrase[Introduction, paragraph 3]

“A multinational, assessor-blinded, phase 2b clinical trial involving children and adults with Niemann–Pick disease type C showed that treatment with NALL resulted in reductions in symptoms and improvements in functioning and quality of life after 6 weeks of treatment.”

absence[Introduction]

Limitations of prior work are not explicitly discussed.

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale linking the mechanism of NALL to the study objectives.

Evidence

paraphrase[Introduction, paragraph 3]

“In an Npc1 −/− mouse model of Niemann–Pick disease type C, treatment with NALL delayed the onset of functional decline ... and prolonged survival.”

paraphrase[Introduction, paragraph 4]

paraphrase[Introduction, paragraph 2]

“The agent enters enzyme-controlled pathways that correct metabolic dysfunction and improves adenosine triphosphate (ATP) energy production.”

Randomization was performed by a CRO using computerized interactive response technology, with 1:1 allocation. Blinding was double-blind with patients, families, investigators, and sponsor representatives unaware of assignments. A sample size calculation was provided. Inclusion/exclusion criteria were pre-specified. Missing data handling was described. The trial is a crossover design with appropriate analysis.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with proper randomization, blinding, and pre-specified analysis.

Evidence

direct quote[Methods, Trial Procedures]

“Randomization was performed by Medpace, a clinical research organization, with the use of computerized interactive response technology.”