Alpha¹ by KaimenConfidential

Kaimen Rigor review

External trigeminal nerve stimulation in youth with ADHD: a randomized, sham-controlled, phase 2b trial.

Conti AA, Bozhilova N, Eraydin IE, Stringer D, Johansson L, Marhenke R, Bilbow A, El Masri S, Hyde J, Giaroli G, Liang H, Fiori F, Mehta MA, Santosh P, Carter B, Cortese S, Rubia K

DOI: 10.1038/s41591-025-04075-x
Record issued: 2026-08-15
Engine: 7.39.0
Exported: 2026-09-22

Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/9a93922a-d3ea-4ac5-85c1-1f8e05b4e52b is authoritative.

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
CitationsUnresolved reference−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

Declared data/code links were not checked for liveness or content.

Biggest issues

01Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
The MEWS improvement may represent a clinically meaningful benefit.
“this may represent a clinically meaningful benefit of the treatment.”
Discussion ¶5Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links · partly checked 06Copyedit4 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported randomized sham-controlled trial. The methods are rigorous, ethical approvals are documented, and data are publicly available. Minor reporting inconsistencies and an overstated claim in the discussion are the main weaknesses.

Both reviewers independently scored all dimensions as pass with high confidence; no divergence. The study is an interventional RCT; non-applicable criteria (e.g., animal housing, cell lines) were excluded. Statistics verification covered only 2 tests; other reported statistics were not machine-verified.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.

Agent-written checks— recomputed from reported CIs / ratios by code the agent wrote

CONSISTENTreported p = .622 · recomputed p = .622Reviewers 1, 2
Primary outcome p-value from aMD and 95% CI
“estimated adjusted mean difference = 0.83; 95% confidence interval: –2.47 to 4.13; P = 0.622”
Find in source
Taken as given: The aMD is the estimate and the CI is two-sided at 95%.; The test is two-sided.
Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.
How we recomputed it: pCI(0.83, -2.47, 4.13, 0)
CONSISTENTreported p = .049 · recomputed p = .049Reviewers 1, 2
Secondary outcome MEWS p-value from aMD and 95% CI
“aMD = −2.17; 95% confidence interval: –4.33 to –0.01; P = 0.049”
Find in source
Taken as given: The aMD is the estimate and the CI is two-sided at 95%.; The test is two-sided.
Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.
How we recomputed it: pCI(-2.17, -4.33, -0.01, 0)

lowinternal contradiction
The percentage for 'Left/mixed handed' in Table 1 appears to be 50.6%, which is inconsistent with the other handedness percentages (74.7% right-handed). The sum exceeds 100%.
“Left/mixed handed | 15 (20) | 23 (30.6) | 38 (50.6)”
Table 1Find in source
lowinternal contradiction
The text states that four children turned 19 before randomization, which may conflict with the inclusion criterion of 8-18 years.
“Although the inclusion criterion for the age range was 8−18 years at the consent stage, four children turned 19 before randomization took place.”
ResultsFind in source

Overstated conclusions

2 findings · worst medium

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

5 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated), 1 only partially supported (evidence backs part of the claim; gaps or caveats remain).

overstatedReviewers 1, 2
The MEWS improvement may represent a clinically meaningful benefit.
The paper itself notes the finding was not replicated in older adolescents and could be a type I error, so the claim is overstated.
Evidence: Discussion: 'this needs to be considered in the context of negative findings in all other 16 measures, and a possible type I error due to multiple testing.'
“this may represent a clinically meaningful benefit of the treatment.”
Discussion ¶5Find in source
partialReviewer 1
The observed improvement in both groups may reflect a neurotechnology-induced placebo effect.
The paper provides indirect evidence (large sham improvement, successful blinding) but acknowledges alternative explanations, so the claim is partially supported.
Evidence: Discussion: 'the observed effects may reflect a neurotechnology-induced placebo effect or ‘neuro-enchantment’ or ‘neuro-suggestion’'
“the observed effects may reflect a neurotechnology-induced placebo effect or ‘neuro-enchantment’ or ‘neuro-suggestion’”
Discussion ¶3Find in source
supportedReviewers 1, 2
TNS is safe for pediatric ADHD.
The paper reports no serious adverse events and no group differences in side effects, supporting the safety claim.
Evidence: Safety results section: 'No serious adverse events were reported, and side effects did not differ between groups.'
“No serious adverse events were reported, and side effects did not differ between groups.”
AbstractFind in source
supportedReviewers 1, 2
TNS does not demonstrate clinical efficacy for pediatric ADHD.
The primary outcome showed no significant difference between groups, and most secondary outcomes were also non-significant, supporting the efficacy claim.
Evidence: Primary outcome result: 'no significant difference was observed between groups (estimated adjusted mean difference (aMD) = 0.83; 95% confidence interval: –2.47 to 4.13; P = 0.622; Cohen’s d = 0.09)'
“In conclusion, TNS is a safe intervention but does not demonstrate clinical efficacy for pediatric ADHD.”
AbstractFind in source
supportedReviewers 1, 2
The sham condition was improved over the previous pilot trial, likely leading to successful blinding.
The paper describes the sham condition with 30-second stimulation every hour and reports successful blinding at week 4, supporting the claim.
Evidence: Discussion: 'a key distinction of our study is the improved design of the sham condition, which is likely responsible for the apparent successful blinding after 4 weeks of treatment.'
“a key distinction of our study is the improved design of the sham condition, which is likely responsible for the apparent successful blinding after 4 weeks of treatment.”
Discussion ¶2Find in source

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

None found

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Checked — nothing surfaced.

Eight Dimensions8 pass

The introduction cites the pilot RCT (McGough et al.) and a meta-analysis of TNS safety, and explains the need for a definitive multicenter trial. It also addresses limitations of prior work, such as the pilot's short duration and narrow age range, and describes how the current study addresses these gaps. The hypothesis follows logically from the cited evidence.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior research, including the pilot RCT that led to FDA clearance, and provides a logical rationale for the confirmatory trial.

Evidence

paraphrase[Introduction, paragraph 3]

“Our recent meta-analysis showed that TNS is safe with good tolerability for neurological and psychiatric conditions.”

paraphrase[Introduction, paragraph 4]

“Furthermore, the pilot study did not assess effects beyond 4 weeks and was limited to very young children aged 8−12 years.”

“We hypothesized that 4 weeks of nightly real versus sham TNS in children and adolescents with ADHD would improve core symptoms, as measured by parent-rated scales (primary outcome).”

Introduction ¶4Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise by citing prior research, including the pilot RCT that led to FDA clearance, and provides a logical rationale for the confirmatory trial.

Evidence

paraphrase[Introduction, paragraph 3]

“The evidence for FDA clearance was based on a pilot double-blind RCT in 62 unmedicated children, showing that 4 weeks of nightly real versus sham TNS significantly decreased parent-rated ADHD symptoms on the ADHD Rating Scale (ADHD-RS), with medium effect size (Cohen’s d = 0.5).”

paraphrase[Introduction, paragraph 4]

“Furthermore, the pilot study did not assess effects beyond 4 weeks and was limited to very young children aged 8−12 years.”

Randomization was done by minimization with a validated web-based system, and blinding was comprehensive (participants, parents, researchers, and analysts). A priori sample size calculation is provided. Inclusion/exclusion criteria are detailed. The analysis population (ITT) and handling of missing data (CACE analysis) are described. The trial is a human RCT, so replicate_distinction, controls, and independent_replication are not applicable.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous: randomization method, blinding, sample size justification, inclusion/exclusion criteria, and analysis population are all adequately described.

Evidence

paraphrase[Methods, Randomization and blinding]

“Randomization was done by minimization by sex (male/female), medication status (on medication, off medication/naive), site (London, Southampton) and age (8–13.5 years, 13.6−19 years) using a validated, online, web-based system from King’s Clinical Trials unit.”

“Participants, parents/carers, postdoctoral research associates, principal investigator, co-investigators and analysts were blinded to treatment group except for the trial manager (L.J.) and trial manager assistants (S.E.M. and J.H.)”

MethodsFind in source

paraphrase[Methods, Sample size justification]

“The estimated sample size of 128 participants (64:64) was calculated using a baseline to posttreatment correlation of 0.5, 90% power, 5% type I error and an anticipated effect size of 0.5 for a reduction in ADHD symptoms at 4 weeks.”

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, sham-controlled, with a prespecified statistical analysis plan, sample size justification, and clear inclusion/exclusion criteria.

Evidence

paraphrase[Methods, Randomization and blinding]

MethodsFind in source

paraphrase[Methods, Sample size justification]

Sex at birth is reported for all participants, and both sexes are included, so sex_justified is not applicable. Age, weight, and health status are reported. Demographics include ethnicity, handedness, and deprivation index. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported: sex, age, health status, and demographics are all described in detail.

Evidence

“150 (97 males, 64.7%) were enrolled in the study”

ResultsFind in source

“Participants had a mean age (s.d.) of 12.6 years (2.8)”

ResultsFind in source

paraphrase[Table 1]

“Child ethnicity | White | 61 (81.3) | 58 (77.3) | 119 (79.3)”

PASSReviewer 2· 90% conf

Demographic and clinical characteristics are well reported, including sex, age, ethnicity, and medication status.

Evidence

paraphrase[Table 1]

“Child sex at birth | Male | 49 (65.3) | 48 (64.0) | 97 (64.7)”

“White | 61 (81.3) | 58 (77.3) | 119 (79.3)”

Table 1Find in source

The trial was approved by the West Midlands–Solihull NHS Research Ethics Committee (with reference numbers) and the MHRA. Informed consent/assent is described. Compliance with the Declaration of Helsinki is stated. All applicable criteria are met.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are fully documented: named ethics committee, regulatory approval, informed consent, and compliance with the Declaration of Helsinki.

Evidence

“The trial was approved by the West Midlands–Solihull NHS Research Ethics Committee (REC; Ref21:/WN/0169; IRAS: 299703) and the Medicines and Healthcare products Regulatory Agency (MHRA; Ref: CI/2022/0003/GB).”

MethodsFind in source

“Children/adolescents and their parents/carers provided both digital and written informed consents/assents”

MethodsFind in source

“It was conducted in accordance with the 1975 Declaration of Helsinki”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approval and consent are clearly documented with named bodies and protocol numbers.

Evidence

MethodsFind in source

“Children/adolescents and their parents/carers provided both digital and written informed consents/assents”

MethodsFind in source

The device is named with manufacturer (NeuroSigma, Inc.) and full stimulation parameters are given. Statistical software (Stata 18) and data capture system (MACRO) are identified. No antibodies, cell lines, or organisms are used, so those are not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational device (Monarch TNS System) is identified with manufacturer and detailed settings; software tools are identified with versions.

Evidence

“Real and sham TNS was performed with the Monarch TNS System (NeuroSigma, Inc.).”

MethodsFind in source

“Analyses were performed in Stata 18 (StataCorp LLC, version 18.0)”

Statistical analysisFind in source

“Study data were entered and managed using the MACRO Electronic Data Capture system (version 4.15.0.116).”

MethodsFind in source

PASSReviewer 2· 90% conf

The investigational device (Monarch TNS System) is identified with manufacturer and detailed settings; software tools are named with versions.

Evidence

“Real and sham TNS was performed with the Monarch TNS System (NeuroSigma, Inc.).”

MethodsFind in source

“Analyses were performed in Stata 18 (StataCorp LLC, version 18.0)”

Statistical analysisFind in source

Tests are named (linear mixed models, MMRM, CACE). Assumptions are handled by design (mixed models). Exact p-values are reported for primary and secondary outcomes. Effect sizes with CIs are reported. Software is identified. Data presentation includes per-group n and CIs. Mathematical plausibility checks were not applicable for most continuous outcomes, but no inconsistencies were found.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well described; effect sizes with confidence intervals are reported; no arithmetic errors detected.

Evidence

“For the primary analysis, a longitudinal linear mixed model was used”

Statistical analysisFind in source

paraphrase[Results, Primary outcome]

“P = 0.622”

“Cohen’s d = 0.09”

ResultsFind in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well described, with exact p-values and effect sizes with confidence intervals.

Evidence

“estimated adjusted mean difference (aMD) = 0.83; 95% confidence interval: –2.47 to 4.13; P = 0.622; Cohen’s d = 0.09”

ResultsFind in source

“P values were calculated using two-sided z -tests from the linear mixed models as outlined in methods.”

Table 2Find in source

The data availability statement names a concrete repository (figshare) with a DOI. Since no custom code was generated, code_sharing is not applicable. Repository deposit and accession numbers are satisfied by the figshare DOI.

Sub-criteria

code sharingN/A

accession numbersADEQUATE

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Data are deposited in a public repository with a DOI; no custom code was used.

Evidence

“All data supporting the findings of this study have been deposited in the figshare repository and are publicly available at 10.6084/m9.figshare.29414744.v1.”

Data availabilityFind in source

“No custom code was generated or used in this study.”

Data availabilityFind in source

PASSReviewer 2· 95% conf

Data are deposited in a public repository with a DOI, and a clear data availability statement is provided.

Evidence

“All data supporting the findings of this study have been deposited in the figshare repository and are publicly available at 10.6084/m9.figshare.29414744.v1.”

Data availabilityFind in source

Trial registration number is provided. CONSORT guidelines are referenced. All pre-specified outcomes are reported, including negative results. Limitations are explicitly discussed. Conclusions are proportional to the evidence. Funding sources and competing interests are stated.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial is registered, reported per CONSORT, all outcomes are reported, limitations are discussed, and funding/COI are disclosed.

Evidence

“Trial registration: ISRCTN82129325”

AbstractFind in source

paraphrase[Methods, Trial design]

“It is reported following CONSORT guidelines”

“Limitations include a high rate of missing data on teacher ratings (80%) due to low teacher participation.”

Discussion ¶7Find in source

PASSReviewer 2· 95% conf

The trial is registered, reported per CONSORT, and includes funding and COI statements; limitations are discussed.

Evidence

“Trial registration: ISRCTN82129325 (http://www.isrctn.com/ISRCTN82129325)”

AbstractFind in source

paraphrase[Methods, Trial design]

“It was conducted in accordance with the 1975 Declaration of Helsinki and is reported following CONSORT guidelines.”

“Limitations include a high rate of missing data on teacher ratings (80%) due to low teacher participation.”

Discussion ¶8Find in source

Registered (1 ID: ISRCTN). Reporting guideline cited: CONSORT.

ISRCTN

ISRCTN82129325

Reporting guidelines: CONSORT

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 63 references by DOI: 3 verified — 1 DOI unresolved, 59 no DOI (shown, not verified).

UNRESOLVED10.6084/m9.figshare.29414744.v1
The efficacy of external trigeminal nerve stimulation (TNS) in youth with attention-deficit/hyperactivity disorder (ADHD): a multi-centre, double-blind, randomized, sham-controlled, parallel-group, phase IIb trial (ATTENS)
Cited DOI does not resolve to any Crossref record.
NO DOI
Incidence, prevalence, and global burden of ADHD from 1990 to 2019 across 204 countries: data, with critical re-analysis, from the Global Burden of Disease study
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition, Text Revision (DSM-5-TR)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The neurocognitive profile of attention-deficit/hyperactivity disorder: a review of meta-analyses
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Evaluating vigilance deficits in ADHD: a meta-analysis of CPT performance
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Cognitive neuroscience of attention deficit hyperactivity disorder (ADHD) and its clinical translation
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Attention-deficit/hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Comparative efficacy and tolerability of medications for attention-deficit hyperactivity disorder in children, adolescents, and adults: a systematic review and network meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
ADHD medication discontinuation and persistence across the lifespan: a retrospective observational study using population-based databases
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Risk of bias and quality of evidence for treatment of ADHD with stimulant medication
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Striatal dopamine transporter alterations in ADHD: pathophysiology or adaptation to psychostimulants? A meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The effects of chronic administration of stimulant and non-stimulant medications on executive functions in ADHD: a systematic review and meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Systematic review of patients’ and parents’ preferences for ADHD treatment options and processes of care
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Neurotherapeutics for attention deficit/hyperactivity disorder (ADHD): a review
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Trigeminal nerve stimulation: a current state-of-the-art review
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Locus coeruleus: from global projection system to adaptive regulation of behavior
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Cognitive functions following trigeminal neuromodulation
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Is autonomic nervous system function atypical in attention deficit hyperactivity disorder (ADHD)? A systematic review of the evidence
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Clinical and cognitive effects of external trigeminal nerve stimulation (eTNS) in neurological and psychiatric disorders: a systematic review and meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Double-blind, sham-controlled, pilot study of trigeminal nerve stimulation for attention-deficit/hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
ADHD Rating Scale-5 for Children and Adolescents: Checklists, Norms, and Clinical Interpretation
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Comparative meta-analyses of brain structural and functional abnormalities during cognitive control in attention-deficit/hyperactivity disorder and autism spectrum disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Meta-analysis of fMRI studies of timing in attention-deficit hyperactivity disorder (ADHD)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Meta-analysis of functional magnetic resonance imaging studies of inhibition and attention in attention-deficit/hyperactivity disorder: exploring task-specific, stimulant medication, and age effects
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Structural and functional brain abnormalities in attention-deficit/hyperactivity disorder and obsessive-compulsive disorder: a comparative meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
An eight-week, open-trial, pilot feasibility study of trigeminal nerve stimulation in youth with attention-deficit/hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Mind wandering perspective on attention-deficit/hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The efficacy of real versus sham external trigeminal nerve stimulation (eTNS) in youth with attention-deficit/hyperactivity disorder (ADHD) over 4 weeks: a protocol for a multi-centre, double-blind, randomized, parallel-group, phase IIb study (ATTENS)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The psychology of neurofeedback: clinical intervention even if applied placebo
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Placebo effects in randomized trials of pharmacological and neurostimulation interventions for mental disorders: an umbrella review
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Nocebo and placebo effects and their implications in psychotherapy
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Treating ADHD with suggestion: neurofeedback and placebo therapeutics
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Placebo and nocebo responses in randomised, controlled trials of medications for ADHD: a systematic review and meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Disorder-specific functional abnormalities during sustained attention in youth with attention deficit hyperactivity disorder (ADHD) and with autism
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Evidence from ‘big data’ for the default-mode hypothesis of ADHD: a mega-analysis of multiple large samples
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Does mind-wandering explain ADHD-related impairment in adolescents?
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Mind wandering (internal distractibility) in ADHD: a literature review
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Mind-wandering in children with and without ADHD
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Validation of the mind excessively wandering scale and the relationship of mind wandering to impairment in adult ADHD
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Trigeminal nerve stimulation for attention-deficit/hyperactivity disorder: cognitive and electroencephalographic predictors of treatment response
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Impact of child and informant gender on parent and teacher ratings of attention-deficit/hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Measuring impairment when diagnosing adolescent ADHD: differentiating problems due to ADHD versus other sources
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Self-report measures of medication adherence behavior: recommendations on optimal use
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Comparative efficacy and acceptability of pharmacological, psychological, and neurostimulatory interventions for ADHD in adults: a systematic review and component network meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Neurotherapeutics for ADHD: do they work?
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Transcranial direct current stimulation (tDCS) in children with ADHD: a randomized, sham-controlled pilot study
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Transcranial direct current stimulation (tDCS) combined with cognitive training in adolescent boys with ADHD: a double-blind, randomised, sham-controlled trial
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Noninvasive brain stimulation in children and adults with attention-deficit/hyperactivity disorder: a systematic review and meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Pharmacologic treatment of attention deficit–hyperactivity disorder
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Performance of children with attention deficit hyperactivity disorder (ADHD) on a test battery of impulsiveness
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Conners, Third Edition (Conners 3)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Strengths and Difficulties Questionnaire: a research note
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Affective Reactivity Index: a concise irritability scale for clinical and research settings
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Assessment of symptoms of DSM-IV anxiety and depression in children: a revised child anxiety and depression scale
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Sleep Disturbance Scale for Children (SDSC). Construction and validation of an instrument to evaluate sleep disturbances in childhood and adolescence
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Mackworth Clock Test: a computerized version
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
An introduction to multiplicity issues in clinical trials: the what, why, when and how
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).

Copyediting

4 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 4 minor suggestions below.

4 copyedit issues flagged: mostly consistency, typo.

MINORtypoTable 3, row for Mackworth Vigilance Task commission errors
“0.95 1”
→ 0.95
Extra space before the digit.
MINORconsistencyResults, Participant disposition
“four children turned 19 before randomization”
→ four participants turned 19 before randomization
Use consistent terminology (children vs participants).
MINORconsistencyTable 1, Handedness row
“Left/mixed handed | 15 (20) | 23 (30.6) | 38 (50.6)”
→ The percentage for the real TNS group appears to be missing a decimal (should be 20.0%). Also, the overall percentage (50.6%) does not sum to 100% with the right-handed percentage (74.7%).
Minor formatting and arithmetic inconsistency in the handedness row.
MINORconsistencyResults, Participant disposition
“four children turned 19 before randomization took place”
→ Clarify whether these participants were included in the trial despite exceeding the age criterion.
Potential inconsistency with the stated inclusion criteria.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and well-reported. An informed reader should weigh the minor reporting inconsistencies (handedness percentage, age criterion) and the overstated MEWS claim, which may warrant a correction or clarification. No major validity threats identified.

1.
HIGHreporting
Temper the claim that the MEWS improvement may represent a clinically meaningful benefit in the Discussion, noting it was not replicated in older adolescents and could be a type I error.
The claim audit rated this as overstated; the paper's own text acknowledges the limitation.
2.
HIGHreporting
Clarify in the Results (Participant disposition) whether the four participants who turned 19 before randomization were included despite exceeding the stated age criterion, and reconcile with the inclusion criteria.
The copyedit and integrity checks flagged a potential internal contradiction with the 8-18 year inclusion criterion.
3.
HIGHreporting
Correct the handedness row in Table 1: the real TNS group percentage should be 20.0% (not 20) and the overall percentage should sum to 100% with the right-handed percentage.
The copyedit and integrity checks flagged an arithmetic inconsistency in the handedness percentages.
4.
MEDIUMreporting
Add a note in the Discussion about the potential for type I error due to multiple testing, particularly for the MEWS finding.
Reviewer 2 suggested this to improve interpretation of secondary outcomes.
5.
MEDIUMreporting
Report the exact p-values for all secondary outcomes in the tables instead of threshold-only values.
Both reviewers noted some secondary outcomes are reported as thresholds, reducing precision.
6.
MEDIUMreporting
Provide the full statistical analysis plan as a supplementary file or appendix.
Both reviewers suggested this to enhance transparency and allow independent replication.
7.
MEDIUMreporting
Include a CONSORT flow diagram in the main text (or ensure Fig. 1 is clearly labeled as such) and report the number of participants completing the 6-month follow-up.
Reviewer 2 noted the flow diagram is referenced but not explicitly included; clarifying attrition improves reporting completeness.
8.
MEDIUMdata code
Provide a data dictionary or codebook for the deposited figshare data to facilitate reuse.
Both reviewers suggested this to improve data usability.
9.
MEDIUMreporting
Add a statement in the Limitations about the generalizability of findings to non-UK settings.
Reviewer 2 suggested this to address external validity.
10.
LOWcopyedit
Fix the extra space in Table 3, Mackworth Vigilance Task commission errors row ("0.95 1" should be "0.95").
Minor typo flagged by copyedit.
11.
LOWcopyedit
Use consistent terminology ("participants" instead of "children") in the Results section.
Copyedit flagged inconsistent terminology.
12.
LOWreporting
Report the results of the CACE analysis in the main text rather than only in extended data.
Reviewer 1 suggested this to improve accessibility of sensitivity analyses.
13.
LOWreporting
Report the results of post hoc subgroup analyses in the main text or clearly label them as exploratory.
Reviewer 1 suggested this to avoid over-interpretation.
14.
LOWreporting
Report the intraclass correlation coefficient or variance components from the mixed models.
Both reviewers suggested this to aid power calculations for future trials.

Full text (69,675 chars)Analyzed: Aug 15, 2026

RigorReviewer 1

RigorReviewer 2

RigorPre-Submission Reviewer

CopyeditAgent Scribe

CitationsCitation Integrity

StatisticsStatistics Consistency

PreregistrationDeterministic check· no model (rule-based)

The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”

How stars are deducted

Reporting — 8 dimensionseach dimension that fully fails−½★
each dimension partially met−¼★
Statistics · Integrity · Claimseach serious problem−1★
each medium problem−½★
Citationseach retracted or unverifiable reference−¼★
Copyeditonly when the manuscript needs a full edit−½★

The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.

The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.

The eight reporting dimensions

Scientific PremisePrior work, rationale, and how it addresses gaps.

Study Design & RigorRandomization, blinding, power, controls, replication.

Biological VariablesSex, age, species/strain, housing, demographics.

Ethical ApprovalsIRB/IACUC approval, informed consent, regulatory compliance.

Key ResourcesAntibodies, cell lines, organisms, software — identified with persistent IDs.

Statistical ReportingNamed tests, exact p-values, effect sizes, plausible summary stats.

Data & Code AvailabilityAvailability statements, repositories, accession numbers, shared code.

Reporting TransparencyMethods, registration, guidelines, outcomes, limitations, funding/COI.

Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.

This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.

External trigeminal nerve stimulation in youth with ADHD: a randomized, sham-controlled, phase 2b trial.

Conti AA, Bozhilova N, Eraydin IE, Stringer D, Johansson L, Marhenke R, Bilbow A, El Masri S, Hyde J, Giaroli G, Liang H, Fiori F, Mehta MA, Santosh P, Carter B, Cortese S, Rubia K

DOI

10.1038/s41591-025-04075-x

Record issued

2026-08-15

Engine

7.39.0

Exported

2026-09-22