A Randomized Trial of Shunting for Idiopathic Normal-Pressure Hydrocephalus

Name: Verified Rigor Record — A Randomized Trial of Shunting for Idiopathic Normal-Pressure Hydrocephalus
Item: A Randomized Trial of Shunting for Idiopathic Normal-Pressure Hydrocephalus
Rating: 88
Author: Αlpha¹

Luciano MG, Williams MA, Hamilton MG, et al. (PENS Trial Investigators)

Paper source

Open DOI

Αlpha¹ Rigor Review

Rigor Review Verified

Critical

High-priority

Action items to resolve · Critical / High

Confidence: moderateEngine: 7.5.0Source: full text

This Alpha1 Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-designed RCT with robust methods for its primary research question, but it has several important reporting gaps: no data/code availability statement (critical for reproducibility), incompletely described informed consent and regulatory compliance, missing software identifications, and an inadequately specified randomization method. Minor copyedit issues (missing figure/table references, formatting inconsistencies) are present but do not undermine the scientific conclusions.

Evaluation is based on full-text review by three independent AI reviewers plus a copyedit pass and verification components (statistics recomputation, citation check, reproducibility check, preregistration check, integrity scan, claim audit). The statistics recomputation covered only 15 of many reported tests (those with test statistic + df or effect + CI); unrecomputed results are not endorsed. The citation check flagged 3 references not found in any registry. The paper was already published; this is a post-publication robustness assessment.

10 major claims checked against the paper's own evidence: all adequately supported.

partialDiscussion, paragraph 2; Table 4
Shunt surgery may have a broad beneficial clinical impact on the health of elderly patients with iNPH, including reduced falls.
Gait velocity improvement and a lower fall rate (46% Placebo vs 24.5% Open, P=0.03) support this claim. However, the overall clinical impact is inferred from these surrogate measures; the trial does not directly measure disability or quality of life as primary endpoints.
Evidence: Falls: Placebo 46.0% vs Open 24.5% (P=0.03); mRS improved more in Open (change -0.5 vs 0.0).
“The combined effect of improved gait velocity and a lower rate of falls in the Open Shunt group suggests that shunt surgery may have a broad beneficial clinical impact on the health of elderly patients with iNPH.”
partialDiscussion, paragraph 5
Complication rates in this study are similar to those in previous iNPH clinical trials and lower than those found in national surveys.
The paper cites prior studies and national surveys to support this claim, but does not provide a quantitative comparison within this manuscript. The rates reported appear consistent with literature, but the claim is not directly tested.
Evidence: The text states: 'While complications... the rates are similar to those in previous iNPH clinical trials and lower than those found in national surveys.'
“While complications in the first 3 months of iNPH treatment occurred in this study, the rates are similar to those in previous iNPH clinical trials and lower than those found in national surveys.”
supportedAbstract, Results
Shunting for iNPH resulted in significant improvements in gait velocity.
The primary outcome (gait velocity) showed a statistically significant and clinically meaningful improvement (0.21 m/s, P<0.001).
Evidence: Table 3, Figure 1, Results text
“shunting for iNPH resulted in significant improvements in gait velocity and a measure of gait and balance, but not measures of cognition or incontinence within 3 months.”
supportedAbstract, Results
Shunting improved gait and balance as measured by the Tinetti scale.
The Tinetti scale showed a significant treatment difference (3.1 points, P=0.003) which remained significant after Bonferroni-Holm adjustment.
Evidence: Table 3, Results
“shunting for iNPH resulted in significant improvements in gait velocity and a measure of gait and balance”
supportedAbstract, Results
Shunting did not improve cognition or urinary incontinence within 3 months.
The MoCA and OABQsf did not reach statistical significance. The paper accurately reports these null findings.
Evidence: Table 3, Results section
“but not measures of cognition or incontinence within 3 months.”
supportedConclusion
The PENS Trial provides evidence that shunt surgery is effective for improving gait velocity at 3 months in patients with iNPH selected according to International iNPH Guidelines.
The primary outcome supports this claim. The conclusion is appropriately limited to the selected population.
Evidence: Results, Discussion
“The PENS Trial provides evidence that shunt surgery is effective for improving gait velocity at 3 months in patients with idiopathic normal pressure hydrocephalus selected for shunt surgery in accordance with the International iNPH Guidelines.”
supportedConclusion
The results of this study support the potential benefits of evaluating patients who have symptoms, neurological findings, and brain imaging consistent with iNPH and treating with shunt surgery when indicated.
The claim is broad but consistent with the study's findings and the patient selection criteria; it does not overreach.
Evidence: Discussion, Conclusion
“The results of this study support the potential benefits of evaluating patients who have symptoms, neurological findings, and brain imaging consistent with iNPH and treating with shunt surgery when indicated.”
supportedAbstract, Results, Table 3
Shunt surgery is effective for improving gait velocity in patients with iNPH selected based on response to temporary CSF drainage.
The primary outcome shows a statistically and clinically significant improvement in gait velocity (0.21 m/s, P<0.001) in the Open Shunt group compared to Placebo.
Evidence: Primary outcome: gait velocity change 0.23 ± 0.23 m/s (Open) vs 0.03 ± 0.23 m/s (Placebo); treatment difference 0.21 m/s (95% CI 0.12 to 0.31, P<0.001).
“Gait velocity increased for Open Shunt (0.23 ± 0.23 m/s; n=49) and was unchanged for Placebo (0.03 ± 0.23 m/s; n=49); treatment difference=0.21 m/s (95% confidence interval 0.12 to 0.31; P<0.001).”
supportedAbstract, Results, Table 3
Shunt surgery results in significant improvements in a measure of gait and balance (Tinetti).
The secondary outcome Tinetti scale shows a significant difference (2.9 vs 0.5, P=0.003) that survived multiplicity adjustment.
Evidence: Tinetti change: Open 2.9 ± 3.8 vs Placebo 0.5 ± 5.3; treatment difference 3.1 (95% CI 1.0 to 5.1, P=0.003).
“A significant difference favoring Open Shunt was seen for the Tinetti (2.9 vs 0.5; P=0.003), but not the MoCA (1.3 vs 0.3) or OABQsf (−3.3 vs −1.5).”
supportedAbstract, Results, Table 3
Shunt surgery does not significantly improve cognition or incontinence within 3 months.
The MoCA and OABQsf secondary outcomes were not statistically significant after multiplicity adjustment, as reported.
Evidence: MoCA: Open 1.3 ± 2.1 vs Placebo 0.3 ± 2.9 (NS); OABQsf: Open -3.3 ± 6.4 vs Placebo -1.5 ± 6.3 (NS).
“but not the MoCA (1.3 vs 0.3) or OABQsf (−3.3 vs −1.5).”

Recomputed 10 tests: 10 consistent, 0 inconsistent, 10 via agent-written checks.

1 integrity concern flagged (0 high).

Rigor

Eight Dimensions5 pass · 3 warn

10 major claims2 partial8 supported

14 copyedit issues flagged: mostly consistency, other, clarity.

Checked 43 references: 40 verified — 3 unresolved.

Reproducibility

3 data/code links checked; 2 live.

datahttp://ClinicalTrials.govLIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT05081128LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttp://NEJM.orgUNVERIFIEDHTTP 403
Liveness indeterminate — content not checked.

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Alpha¹ Rigor Action ItemsFinal pass before journal submission

As a published paper, this work is substantively robust for its primary findings (shunt surgery improves gait velocity at 3 months), but an informed reader should weigh the absence of data availability as a limitation for independent verification, and note the incomplete ethics reporting (consent process, regulatory compliance) and the missing randomization details. A correction or erratum addressing these reporting gaps would strengthen the paper's transparency; the missing data availability is the most consequential issue for reproducibility.

1.
HIGHdata code
Add a data availability statement specifying where de-identified individual participant data can be accessed (e.g., via a managed-access repository like Vivli or ClinicalTrials.gov results database, or by request to the corresponding author with a data-sharing agreement).
The absence of any data availability statement is a major reproducibility gap for a publicly funded clinical trial.
2.
HIGHdata code
Deposit the de-identified participant-level dataset and analysis code (including custom image-segmentation code) in a public repository with a persistent DOI or accession number, and cite it in the data availability statement.
Without data and code sharing, independent verification and reuse of the findings are severely limited.
3.
HIGHethics
Describe the informed consent process (e.g., written informed consent was obtained from all participants) in the Methods section under 'Participants'.
A clinical trial must describe how consent was obtained; merely stating count of consenting participants is insufficient.
4.
HIGHethics
Add a regulatory compliance statement to the Methods, e.g., 'This study was conducted in accordance with the Declaration of Helsinki and ICH Good Clinical Practice guidelines.'
International standards for clinical trial reporting require a compliance statement.
5.
HIGHother
Verify or correct the following three references that were not found in any registry: 'BDI-II, Beck Depression Inventory: Manual', 'A multiple testing procedure for clinical trials', and 'The combination of probabilities arising from data in discrete distributions'—replace with correct citations if needed.
References that cannot be located in registries are potential fabrication signals and must be validated.
6.
HIGHreporting
Specify the randomization method (e.g., computer-generated random numbers with varying block sizes, stratification factors) in the Methods section under 'Randomization and Blinding'.
Adequate randomization requires description of the algorithm and allocation concealment; '1:1 ratio' alone is insufficient.
7.
HIGHreporting
Report the statistical software used (e.g., SAS version 9.4, R version 4.x) in the Statistical Analysis section.
Identification of analysis software is standard for reproducibility.
8.
HIGHreporting
Provide version numbers or RRIDs for the image segmentation software (spatially localized atlas network tiles, deep-learning brain extraction tool) in the Methods under 'Outcome Measures and Methods'.
Without software versions, the image analysis cannot be precisely replicated.
9.
MEDIUMreporting
Reference the CONSORT 2010 checklist in the Methods or as supplementary material, and include a completed CONSORT flow diagram.
CONSORT is the standard reporting guideline for RCTs and its use improves completeness.
10.
MEDIUMcopyedit
Fix the missing table and figure references throughout the Results: complete sentences like 'Additional details are in the ________' and '() shows the distribution' by inserting the correct supplement/figure/table labels.
Incomplete references impede reader comprehension and suggest hasty editing.
11.
MEDIUMcopyedit
Standardize p-value spacing (use 'P < 0.001' and 'P = 0.003' consistently) and use consistent minus signs (hyphen vs. en-dash) throughout.
Consistent formatting improves professional appearance and readability.
12.
MEDIUMcopyedit
Fix the extraneous hyphen in the Introduction: change '- Untreated, iNPH is associated with...' to 'Untreated, iNPH is associated with...'.
Grammatical error disrupts reading flow.
13.
LOWreporting
Report participant body weight (mean ± SD) in Table 1 to complete the standard demographic variables.
Weight is a standard demographic variable; its omission is a minor gap for a clinical trial.
14.
LOWcopyedit
In Table 3 footnote, clarify that the deceased participant not included in the table is from the Placebo group (to match the text stating 'One death occurred in the Placebo group').
Consistency between table footnote and main text prevents minor confusion.
15.
LOWother
Discuss the substantial imbalance in baseline comorbidities (92.0% Placebo vs. 67.3% Open Shunt for 'Any comorbidities') as a potential chance imbalance and its possible influence on outcomes.
A reader should be aware of this imbalance despite randomization; it may affect interpretation of secondary outcomes.

Full text (43,387 chars)Analyzed: Jul 5, 2026

Αlpha¹ assesses methodological rigor, not the importance of the findings. See how we calibrate →