A Randomized Trial of Shunting for Idiopathic Normal-Pressure Hydrocephalus.
Luciano MG, Williams MA, Hamilton MG, Katzen HL, Dasher NA, Moghekar A, Hua J, Malm J, Eklund A, Alpert Abel N, Raslan AM, Elder BD, Savage JJ, Barrow DL, Shahlaie K, Jensen H, Zwimpfer TJ, Wollett J, Hanley DF, Holubkov R, PENS Trial Investigators and the Adult Hydrocephalus Clinical Research Network
- DOI
- 10.1056/NEJMoa2503109
- Record issued
- 2026-08-15
- Engine
- 7.39.0
- Exported
- 2026-09-22
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/705a6391-ec2e-4160-9ac5-a9c17d2e7467 is authoritative.
How this rating was calculated
- IntegrityIntegrity concern ×3−1.5★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ReportingData & code availability partially met−0.25★
- The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 10 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary efficacy claim is based on gait velocity, a performance-based surrogate measure, not a hard clinical outcome. Although the paper cites a threshold for 'substantial meaningful change' in gait velocity, it does not provide validated evidence linking gait velocity improvement to long-term clinical outcomes such as reduced disability or mortality in iNPH. Target engagement is inferred from ventricular volume reduction, but the link between this surrogate and clinical benefit is not established.
“The primary outcome was gait velocity change 3 months after surgery.”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-designed and rigorously reported randomized, double-blind, placebo-controlled trial. The main methodological strengths are the pre-specified sample size, concealed randomization, double-blinding, and detailed statistical analysis with exact p-values and confidence intervals. The primary weakness is the absence of a data availability statement, which is a notable reporting gap for a clinical trial.
Both reviewers independently scored all eight dimensions and agreed on every status, so no divergence needed reconciliation. The statistics verification component recomputed 6 reported tests consistently, but this covers only a subset of tests; the analysis is not fully verified. The citation check found no retracted or unresolved references.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 6 tests: 6 consistent, 0 inconsistent; 6 via agent-written checks.
- CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Primary outcome gait velocity treatment difference p-value from CI
“treatment difference of 0.21 m/s (P<0.001; 95% confidence interval 0.12 to 0.31)”
Taken as given: The CI is a 95% confidence interval for the treatment difference.; The estimate is the treatment difference (0.21).; The CI is symmetric on the linear scale (not log).Method: Two-sided p-value derived from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(0.21, 0.12, 0.31, 0) - CONSISTENTreported p = .003 · recomputed p = .003Reviewer 1Tinetti secondary outcome p-value from CI
“Tinetti | 18.8 ± 6.1 | 20.3 ± 5.1 | 0.5 ± 5.3 | 2.9 ± 3.8 | 3.1 (1.0, 5.1) | 0.003”
Taken as given: The CI is a 95% confidence interval for the treatment difference.; The estimate is the treatment difference (3.1).; The CI is symmetric on the linear scale.Method: Two-sided p-value derived from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(3.1, 1.0, 5.1, 0) - CONSISTENTreported p = .030 · recomputed p = .028Reviewer 1Falls comparison p-value using Fisher's exact test with mid-p correction
“Participants reporting falls (n) | 23 (46.0%) | 12 (24.5%) | 0.03”
Taken as given: The numbers 23 and 12 are the event counts in Placebo and Open Shunt groups.; The group totals are 50 and 49, respectively.; The test used is Fisher's exact test with mid-p correction as stated in the paper.Method: Fisher's exact test with mid-p correction for a 2x2 table.How we recomputed it: pFisher2x2(23, 27, 12, 37, 1) - CONSISTENTreported p = .040 · recomputed p = .036Reviewer 1Subdural hematoma comparison p-value using Fisher's exact test with mid-p correction
“Participants with subdural hematoma/hemorrhage (n) | 1 (2.0%) | 6 (12.2%) | 0.04”
Taken as given: The numbers 1 and 6 are the event counts in Placebo and Open Shunt groups.; The group totals are 50 and 49, respectively.; The test used is Fisher's exact test with mid-p correction.Method: Fisher's exact test with mid-p correction for a 2x2 table.How we recomputed it: pFisher2x2(1, 49, 6, 43, 1) - CONSISTENTreported p = .002 · recomputed p = .002Reviewer 1Positional headaches comparison p-value using Fisher's exact test with mid-p correction
“Positional Headaches | 14 (28.0%) | 29 (59.2%) | 0.002”
Taken as given: The numbers 14 and 29 are the event counts in Placebo and Open Shunt groups.; The group totals are 50 and 49, respectively.; The test used is Fisher's exact test with mid-p correction.Method: Fisher's exact test with mid-p correction for a 2x2 table.How we recomputed it: pFisher2x2(14, 36, 29, 20, 1) - CONSISTENTreported p = .003 · recomputed p = .003Reviewer 2Secondary outcome for Tinetti treatment difference p-value
“Tinetti | 0.5 ± 5.3 | 2.9 ± 3.8 | 3.1 (1.0, 5.1) | 0.003”
Method: Recomputed from the reported effect estimate and its 95% confidence interval using a normal approximation.How we recomputed it: pCI(3.1, 1.0, 5.1, 0)
- lowinternal contradictionThe abstract reports 99 participants randomized, but the results section states 99 were randomized (49 to Open Shunt and 50 to Placebo). The abstract also reports n=49 for both groups in the primary outcome, which is consistent with the imputed analysis population. However, the text states '99 participants were randomized and received the assigned intervention', which is consistent.
99 participants were randomized and received the assigned intervention. Gait velocity increased for Open Shunt (0.23 ± 0.23 m/s; n=49) and was unchanged for Placebo (0.03 ± 0.23 m/s; n=49).
Abstractreviewer’s wording - lowinternal contradictionThe abstract states '99 participants were randomized and received the assigned intervention' but later reports 3 withdrawals and 1 death in the Placebo group before the primary endpoint, implying only 95 completed the primary endpoint. The analysis uses imputation for missing data, so the discrepancy is explained.
99 participants were randomized and received the assigned intervention. ... In the Placebo group, 3 participants withdrew from the study and one died before the primary endpoint.
Abstractreviewer’s wording - lowinternal contradictionTable 3 lists N=49 for both groups in the outcome analysis, but the text says 3 withdrew and 1 died in Placebo, leaving 46. The table uses imputed data, so the N=49 is the imputed analysis population, not the observed completers. This is explained in the footnote.
Table 3: Placebo (N = 49) | Open Shunt (N = 49) ... One randomized participant was deceased at the 3-month timepoint and is not included in this table.
Table 3reviewer’s wording
Overstated conclusions
2 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Conclusions only partially backed by the presented evidenceAssessed
9 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewer 1Shunt surgery may have a broad beneficial clinical impact on the health of elderly patients with iNPH.The claim is supported by improvements in gait and some tertiary outcomes, but the study did not show significant improvements in cognition or incontinence, and long-term outcomes are not yet available.Evidence: Improvements in gait velocity, Tinetti, and several tertiary outcomes (SDMT, NIH-Flanker, EQ-VAS, mRS) were observed, but MoCA and OABQsf were not significant.
“The combined effect of improved gait velocity and a lower rate of falls in the Open Shunt group suggests that shunt surgery may have a broad beneficial clinical impact on the health of elderly patients with iNPH.”
DiscussionFind in source - supportedReviewer 1Shunting for iNPH results in significant improvement in gait velocity at 3 months.The primary outcome showed a significant treatment difference of 0.21 m/s (P<0.001) favoring Open Shunt, with a 95% CI excluding zero.Evidence: Primary outcome: gait velocity change 0.23 vs 0.03 m/s, treatment difference 0.21 (95% CI 0.12-0.31), P<0.001.
“Gait velocity increased for Open Shunt (0.23 ± 0.23 m/s; n=49) and was unchanged for Placebo (0.03 ± 0.23 m/s; n=49); treatment difference=0.21 m/s (95% confidence interval 0.12 to 0.31; P<0.001).”
AbstractFind in source - supportedReviewer 1Shunting improves a measure of gait and balance (Tinetti).The Tinetti score showed a significant treatment difference of 3.1 (95% CI 1.0-5.1, P=0.003), which remained significant after multiplicity adjustment.Evidence: Secondary outcome: Tinetti change 2.9 vs 0.5, treatment difference 3.1 (95% CI 1.0-5.1), P=0.003.
“A significant treatment difference favoring Open Shunt vs Placebo was seen for the Tinetti (2.9 vs 0.5, P = 0.003)”
ResultsFind in source - supportedReviewer 1Shunting does not improve cognition or incontinence within 3 months.The MoCA and OABQsf differences were not statistically significant, as reported.Evidence: Secondary outcomes: MoCA difference 1.2 (95% CI 0.1-2.2, NS), OABQsf difference -1.9 (95% CI -4.0-0.1, NS).
“but not the MoCA (1.3 vs 0.3) or OABQsf (−3.3 vs −1.5)”
ResultsFind in source - supportedReviewer 1Shunting reduces lateral ventricular volume.The imaging outcome showed a significant reduction in lateral ventricle volume for Open Shunt compared to Placebo.Evidence: Imaging: lateral ventricle volume change -27.4 vs -4.4, difference -21.0 mL (95% CI -33.9 to -8.1).
“The lateral ventricular volume appeared to decrease more for Open Shunt than Placebo (−27.4 vs −4.4), for a difference of −21.0 mL (95% confidence interval −33.9 to −8.1)”
ResultsFind in source - supportedReviewer 2Shunting for iNPH resulted in significant improvements in gait velocity at 3 months.The primary outcome, gait velocity, showed a statistically significant and clinically meaningful improvement in the Open Shunt group compared to Placebo.Evidence: The primary outcome analysis showed a treatment difference of 0.21 m/s (95% CI 0.12 to 0.31; P<0.001).
For patients responsive to temporary CSF drainage, shunting for iNPH resulted in significant improvements in gait velocity and a measure of gait and balance.
Conclusionreviewer’s wording - supportedReviewer 2Shunting for iNPH resulted in significant improvements in a measure of gait and balance.The secondary outcome, Tinetti Scale, showed a significant improvement favoring Open Shunt.Evidence: The Tinetti outcome showed a treatment difference of 3.1 (95% CI 1.0 to 5.1; P=0.003).
shunting for iNPH resulted in significant improvements in gait velocity and a measure of gait and balance.
Conclusionreviewer’s wording - supportedReviewer 2Shunting for iNPH did not result in significant improvements in cognition or incontinence within 3 months.The secondary outcomes for cognition (MoCA) and incontinence (OABQsf) did not show statistically significant differences.Evidence: The MoCA and OABQsf outcomes were not significant (P=NS).
“but not measures of cognition or incontinence within 3 months.”
ConclusionFind in source - supportedReviewer 2The number needed to treat (NNT) for shunt surgery is 1.79.The NNT is calculated from the proportion of patients achieving a meaningful gait velocity improvement, which is reported.Evidence: The paper reports that 80% of Open Shunt and 24% of Placebo patients achieved a gait velocity change of ≥0.1 m/s, which is used to calculate the NNT.
“For this degree of improvement, the number needed to treat (NNT) for shunt surgery is 1.79.”
DiscussionFind in source
Premise concern: surrogate not validated for clinical benefit.
- INADEQUATESurrogate endpointThe primary efficacy claim is based on gait velocity, a performance-based surrogate measure, not a hard clinical outcome. Although the paper cites a threshold for 'substantial meaningful change' in gait velocity, it does not provide validated evidence linking gait velocity improvement to long-term clinical outcomes such as reduced disability or mortality in iNPH. Target engagement is inferred from ventricular volume reduction, but the link between this surrogate and clinical benefit is not established.
“The primary outcome was gait velocity change 3 months after surgery.”
- ADEQUATEEffect sizeThe treatment difference in gait velocity was 0.21 m/s, which exceeds the cited 'substantial meaningful change' threshold of 0.10 m/s and the 'large' minimal clinically important difference of 0.22 m/s in Parkinsonism. The effect is statistically significant and anchored to clinically meaningful benchmarks.
“treatment difference=0.21 m/s (95% confidence interval 0.12 to 0.31; P<0.001)”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
The introduction cites the 2005 International iNPH Guidelines, the Japanese Guidelines, and three small-sample randomized placebo-controlled trials, and acknowledges the skepticism and the call for a moratorium on shunt surgery. It also cites a 2024 Cochrane review noting the need for more studies. The rationale for the trial is clearly linked to the lack of adequately powered randomized trials, and the study is designed to address this gap. The limitations of prior work are addressed by the design of a larger, adequately powered, double-blind, placebo-controlled trial.
“Three small-sample randomized placebo-controlled trials suggested that shunt surgery was effective, but a 2024 Cochrane review noted, “there is a need for similar studies to increase the certainty of the findings presented”.”
“the clinical effectiveness of shunt surgery for iNPH has been subject to skepticism to the point of a call for a moratorium on shunt surgery because of variability of study results, questionable durability of benefit, the risks of surgery, and the potential for a strong placebo effect.”
“This is an international, multi-center, prospective, double-blind, randomized, placebo-controlled trial.”
“Three small-sample randomized placebo-controlled trials suggested that shunt surgery was effective, but a 2024 Cochrane review noted, “there is a need for similar studies to increase the certainty of the findings presented”.”
“The effectiveness of shunting is questioned due to the absence of adequately powered, randomized trials.”
Randomization was 1:1, concealed from participants and personnel except those responsible for shunt adjustments. Blinding was double-blind. A sample size of 100 was specified with >90% power to detect a 0.2 m/s difference. Inclusion/exclusion criteria were pre-specified. The analysis population (ITT with multiple imputation) and per-protocol sensitivity analyses were defined. Controls are inherent in the placebo group. Independent replication is not applicable for a single pivotal trial.
“Randomization occurred immediately before surgery in a 1:1 ratio. Treatment assignments were concealed from study participants and personnel, except for investigators responsible for shunt adjustments, and were disclosed only for patient safety reasons.”
“A sample size of 100 participants was specified, providing >90% power to detect a between group gait velocity difference of 0.2 m/s (SD=0.29 m/s), accounting for interim analyses and attrition.”
“Following the International iNPH Guidelines, patients selected for VP shunt surgery based on their gait velocity response to temporary CSF drainage were eligible. At baseline, patients who could not walk 10 meters or who required assistance from a person to walk were excluded, as were those with gait velocity ≥1.0 m/sec unless velocity improved ≥30% with CSF drainage.”
“At baseline, patients who could not walk 10 meters or who required assistance from a person to walk were excluded, as were those with gait velocity ≥1.0 m/sec unless velocity improved ≥30% with CSF drainage.”
The paper reports that participants were 51.5% male and 48.5% female, with a mean age of 75.0 ± 5.7 years. It also reports educational attainment and comorbidities. Since both sexes are enrolled, a scientific justification for single-sex is not applicable. Species/strain and housing conditions are not applicable for a human trial.
“Participants were 51.5% male and 48.5% female, with mean age 75.0 ± 5.7 years, and 63% with a Bachelor’s degree or higher.”
“Any comorbidities | 46 (92.0%) | 33 (67.3%) | 79 (79.8%)”
“Age at Randomization: Mean ± SD | 74.9 ± 5.76 | 75.1 ± 5.70 | 75.0 ± 5.70”
The paper states that the central IRB at Johns Hopkins Medicine (IRB00305245) approved the study, with local IRBs at Canadian and Swedish sites. Informed consent is implied by the consent rate (125 of 237 approached provided consent) and the statement that participants provided consent. Regulatory compliance is implied by the IRB approval and trial registration.
“For U.S. sites, the central Institutional Review Board (IRB) was at Johns Hopkins Medicine (IRB00305245), with local IRBs at the Canadian and Swedish sites.”
“Of 237 approached for the study, 125 (53%) provided consent and 99 were randomized”
“For U.S. sites, the central Institutional Review Board (IRB) was at Johns Hopkins Medicine (IRB00305245), with local IRBs at the Canadian and Swedish sites.”
The shunt valve is identified as 'Codman Certas Plus with SiphonGuard®, Integra LifeSciences, Princeton, NJ'. The statistical software is not explicitly named, but the Data Coordinating Center at University of Utah analyzed the data; the specific software is not mentioned. Since this is a device trial, antibodies, cell lines, mycoplasma, and organisms are not applicable. Reagents are not applicable beyond the device. Software tools are partially identified (the deep-learning brain extraction tool is mentioned but not versioned).
“The study intervention was the initial setting of a commercially available noninvasively adjustable shunt valve (Codman Certas Plus with SiphonGuard ® , Integra LifeSciences, Princeton, NJ)”
The primary analysis used linear regression with multiple imputation, adjusting for baseline and covariates. Tests are named (linear regression, Fisher's exact test with mid-p correction). Exact p-values are reported for primary and secondary outcomes (e.g., P<0.001, P=0.003). Effect sizes with 95% CIs are reported. Software is not explicitly identified, but the analysis is described in detail. Data presentation includes per-group n and dispersion. Mathematical plausibility checks: the reported percentages and counts are consistent (e.g., 23/50=46%, 12/49=24.5%).
“treatment difference of 0.21 m/s (P<0.001; 95% confidence interval 0.12 to 0.31)”
“A significant treatment difference favoring Open Shunt vs Placebo was seen for the Tinetti (2.9 vs 0.5, P = 0.003)”
“0.21 (0.12, 0.31) | <0.001”
The paper does not include an explicit data availability statement. The trial is registered on ClinicalTrials.gov, but no data sharing plan is described. Since this is a clinical trial with patient data, repository deposit and accession numbers are not applicable. Code sharing is not applicable as no custom code is mentioned.
The trial is registered (NCT05081128). Methods are detailed enough for replication. Limitations are explicitly discussed (e.g., 3-month timepoint, exclusion of patients who cannot walk, anticoagulation). Conclusions are proportional to the evidence, noting the need for longer-term evaluation. Funding and COI are disclosed. A reporting guideline (CONSORT) is not explicitly mentioned, but the paper follows standard reporting.
“Trial registration number: PENS ClinicalTrials.gov (http://ClinicalTrials.gov) number, NCT05081128”
“A potential limitation is the 3-month primary timepoint, which is standard for iNPH research. This study does not yet address the long-term outcomes.”
“The study was funded by the NINDS U01NS122764; ClinicalTrials.gov (http://ClinicalTrials.gov) number NCT05081128”
“Trial registration number: PENS ClinicalTrials.gov (http://ClinicalTrials.gov) number, NCT05081128”
“A potential limitation is the 3-month primary timepoint, which is standard for iNPH research. This study does not yet address the long-term outcomes.”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
None foundReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Checked — nothing surfaced.
Checked 44 references by DOI: 39 verified — 5 no DOI (shown, not verified).
- NO DOIBDI-II, Beck Depression Inventory: ManualNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIAssessment of older people: self-maintaining and instrumental activities of daily livingNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIA multiple testing procedure for clinical trialsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIA Simple Sequentially Rejective Multiple Test ProcedureNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIThe combination of probabilities arising from data in discrete distributionsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
1 of 2 data/code links checked; 1 live; 1 not probed.
- datahttps://clinicaltrials.gov/ct2/show/NCT05081128LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://www.nejm.org/doi/full/10.1056/NEJMoa2503109UNVERIFIEDHTTP 403Liveness indeterminate — content not checked.
Copyediting
5 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 5 minor suggestions below.
5 copyedit issues flagged: mostly consistency, typo, clarity.
- MINORconsistencyAbstract, Results“99 participants were randomized and received the assigned intervention.”→ Clarify that 99 were randomized but 50 to Placebo and 49 to Open Shunt, and that 3 withdrew and 1 died before primary endpoint.The abstract states 99 received intervention, but later it says 3 withdrew and 1 died, so the number analyzed is 98.
- MINORclarityTable 3, footnote“One randomized participant was deceased at the 3-month timepoint and is not included in this table.”→ Clarify that this participant is from the Placebo group and that the analysis uses imputed data for others.The footnote is clear but could be more explicit.
- MINORtypoAbstract, Results“treatment difference=0.21 m/s (95% confidence interval 0.12 to 0.31; P<0.001).”→ Use 'treatment difference = 0.21 m/s' for consistency.Minor formatting.
- MINORtypoMethods, Trial Design“Codman Certas Plus with SiphonGuard ®”→ Codman Certas Plus with SiphonGuard®Inconsistent spacing around the registered trademark symbol.
- MINORconsistencyTable 1“Hispanic or Latino | 0 (0.0%) | 2 (4.1%) | 2 (2.0%)”→ Verify the column order for the Placebo and Open Shunt groups.The table header order is 'Overall | Placebo | Open Shunt', but the ethnicity row appears to list 'Placebo' and 'Open Shunt' values in a different order than the header.
The published work is robust and well-reported, with only minor reporting gaps. An informed reader should weigh the absence of a data availability statement and the lack of explicit statistical software identification as minor transparency issues, but these do not undermine the validity of the findings. No erratum or correction appears warranted based on the integrity checks.
- 1.HIGHdata codeAdd a data availability statement in the Methods or a dedicated section, specifying a concrete access route (e.g., a managed-access platform like Vivli or a data-access committee) and the conditions for requesting the de-identified patient-level data.The absence of a data availability statement is a significant reporting gap for a clinical trial and is required by many journals and funders.
- 2.HIGHstatisticsExplicitly name the statistical software and version used for the analysis (e.g., 'R version 4.3.1') in the Statistical Analysis section.Naming the software enhances reproducibility and is a standard reporting expectation.
- 3.MEDIUMreportingMention adherence to CONSORT guidelines and provide the CONSORT checklist as supplementary material.Referencing the reporting guideline demonstrates compliance with reporting standards and improves transparency.
- 4.MEDIUMreportingClarify in the Abstract that 99 were randomized (50 to Placebo, 49 to Open Shunt) and that 3 withdrew and 1 died before the primary endpoint, so the analysis population is 98 with imputation.The current abstract states 99 received intervention, which is inconsistent with the later report of withdrawals and death; clarifying improves accuracy.
- 5.MEDIUMcopyeditVerify the column order in Table 1 for the ethnicity row (Hispanic or Latino) to ensure it matches the header order (Overall | Placebo | Open Shunt).The copyedit flagged a potential inconsistency in column order, which could mislead readers.
- 6.LOWcopyeditFix the spacing around the registered trademark symbol in 'Codman Certas Plus with SiphonGuard ®' to 'SiphonGuard®'.Minor typographical consistency improves professionalism.
- 7.LOWcopyeditUse consistent formatting for 'treatment difference = 0.21 m/s' in the Abstract.Minor formatting consistency.
- 8.LOWreportingProvide details on the deep-learning brain extraction tool used for imaging analysis, including version and source, to enhance reproducibility.The tool is mentioned but not versioned, which limits reproducibility.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.