Effectiveness of screening and ultra-brief intervention for hazardous drinking in primary care: pragmatic cluster randomised controlled trial.

Name: Αlpha¹ Rigor Record — Effectiveness of screening and ultra-brief intervention for hazardous drinking in primary care: pragmatic cluster randomised controlled trial.
Item: Effectiveness of screening and ultra-brief intervention for hazardous drinking in primary care: pragmatic cluster randomised controlled trial.
Rating: 94
Author: Αlpha¹

So R, Kariyama K, Oyamada S, Matsushita S, Nishimura H, Tezuka Y, Sunami T, Furukawa TA, Sahker E, Kawaguchi M, Kobashi H, Nishina S, Otsuka Y, Kanda H, Tsujimoto Y, Horie Y, Yoshiji H, Yuzuriha T, Nouso K

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 3.5★ (Adequate), 0 critical, 1 high issue for “Effectiveness of screening and ultra-brief intervention for hazardous drinking in primary care: pragmatic cluster randomised controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

3.5 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingStatistical analysis partially met−0.25★
CitationsUnresolved reference−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 9 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Problems surfaced4 types

Overstated conclusions2

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Statistical reporting gaps (tests, assumptions, effect sizes)Assessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and transparently reported pragmatic cluster randomised controlled trial. The design is rigorous, ethical approvals are clear, and data/code are openly available. Minor reporting gaps (e.g., missing table references, unit inconsistencies) and a single unresolved reference do not undermine the core findings.

Both reviewers classified the study as interventional, which is adopted. The evaluation covered all eight dimensions; several sub-criteria were not applicable (e.g., animal-related, cell line authentication). The reviewers diverged on statistical analysis (warn vs. pass), but the combined evidence supports 'pass'.

9 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 8 tests: 8 consistent, 0 inconsistent; 8 via agent-written checks.

Reporting

Eight Dimensions7 pass · 1 warn

The paper discusses the global public health concern of harmful alcohol use and the recommendation of brief interventions. It highlights mixed results for ultra-brief interventions in different settings and explicitly states the lack of randomized controlled trials directly investigating ultra-brief intervention over assessment-only control in primary care settings.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes its scientific premise by citing prior work on brief interventions for hazardous drinking and identifying a gap in the literature regarding ultra-brief interventions in primary care settings.

Evidence

direct quote[Introduction, paragraph 3]

“Available evidence, however, remains inconclusive as to whether the ultra-brief intervention and more time intensive brief intervention are equally effective or equally ineffective compared with assessment only control.”