Rigor Reviewed

Rigor-Reviewed Manuscript

A village doctor-led mobile health intervention for cardiovascular risk reduction in rural China: cluster randomised controlled trial.

Name: Αlpha¹ Rigor Record — A village doctor-led mobile health intervention for cardiovascular risk reduction in rural China: cluster randomised controlled trial.
Item: A village doctor-led mobile health intervention for cardiovascular risk reduction in rural China: cluster randomised controlled trial.
Rating: 96
Author: Αlpha¹

Zhang X, Wang S, Zhou X, Tang Y, Xing L, Ma S, Xu Y, Wu C, Cui J, Yang Y, Lin C, Wu Y, Zhang H, Fan L, Xu C, Li X, SMARTER Collaborative Group

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2★ (Weak), 0 critical, 3 high issues for “A village doctor-led mobile health intervention for cardiovascular risk reduction in rural China: cluster randomised controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★
CitationsUnresolved reference−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No data or code availability links were detected to verify.

Problems surfaced8 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Data authenticity concerns2

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Data look implausibly cleanAssessed
Other integrity concernAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This cluster randomised controlled trial is methodologically rigorous, with a clear premise, robust design, and transparent reporting. The main weakness is the vague and incomplete data availability statement, which lacks a repository or clear access procedure.

Both reviewers agreed on study type (interventional). The evaluation covers all eight dimensions; no dimensions were excluded as not applicable. The statistics verification checked 10 tests and found all consistent; coverage is limited to tests with a test statistic and df or an effect estimate with CI.

4 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 10 tests: 10 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 9 via agent-written checks.

3 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites the burden of cardiovascular disease in China, suboptimal implementation of lifestyle modifications, and the scarcity of mHealth evidence for primary prevention. It identifies gaps in involving primary healthcare workforce and justifies the need for the SMARTER study. Limitations of prior research are implicitly addressed by the study design, though not explicitly detailed.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with adequate citation of prior work and a logical rationale for the study.

Evidence

direct quote[Introduction, paragraph 1]

“Mobile health (mHealth) tools appear promising in the secondary prevention of cardiovascular disease, but evidence on primary prevention, particularly based on randomised controlled trials, is scarce. More importantly, the primary healthcare workforce has rarely been involved, as those mHealth tools were primarily developed to support self-management.”