Rigor Reviewed

Rigor-Reviewed Manuscript

Self-help mobile messaging intervention for depression among older adults in resource-limited settings: a randomized controlled trial.

Name: Αlpha¹ Rigor Record — Self-help mobile messaging intervention for depression among older adults in resource-limited settings: a randomized controlled trial.
Item: Self-help mobile messaging intervention for depression among older adults in resource-limited settings: a randomized controlled trial.
Rating: 96
Author: Αlpha¹

Scazufca M, Nakamura CA, Seward N, Didone TVN, Moretti FA, Oliveira da Costa M, Queiroz de Souza CH, Macias de Oliveira G, Souza Dos Santos M, Pereira LA, Mendes de Sá Martins M, van de Ven P, Hollingworth W, Peters TJ, Araya R

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.25★ (Weak), 0 critical, 3 high issues for “Self-help mobile messaging intervention for depression among older adults in resource-limited settings: a randomized controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 16, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 30 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.
No data or code availability links were detected to verify.

Problems surfaced6 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions4

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and transparently reported pragmatic RCT of a mobile messaging intervention for depression in older adults. The design, ethics, and statistical reporting are strong, with the main weakness being vague data and code availability statements. Minor copyedit issues and a slightly overstated claim about clinical meaningfulness are noted.

Both reviewers classified the study as interventional (RCT), so no divergence. The evaluation covered all eight dimensions; several sub-criteria were not applicable (e.g., animal-related, cell lines). The statistics verification checked only a subset of tests (2 reported with sufficient detail); the rest are unverified. The claim audit flagged one overstated claim.

4 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated), 1 only partially supported (evidence backs part of the claim; gaps or caveats remain).

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites global and local burden of depression in older adults, limitations of existing task-sharing programs, and the lack of evidence for self-help digital interventions in LMICs. It explicitly states the need for scalable solutions and builds the rationale for the Viva Vida intervention based on prior work (PROACTIVE). Limitations of prior research are acknowledged (e.g., need for health professional support, lack of evidence in older adults in LMICs).

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with adequate citation of prior work and a logical rationale for the study.

Evidence

paraphrase[Introduction, paragraphs 1-3]

“However, there is little evidence on the effectiveness of such interventions for older adults with depressive symptoms, especially in LMICs.”

paraphrase[Introduction, paragraph 4]

“It was adapted from a task-shared, collaborative care psychosocial program led by community health workers in Brazil, PROACTIVE, which improved recovery from depression at the 8-month and 12-month follow-ups.”

paraphrase[Introduction, paragraph 2]

“However, these programs often require a prominent role for health professionals, which is not feasible in health systems with few professionals who are already overstretched with other priorities.”

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with adequate citation of prior work and a logical rationale for the study.

Evidence

paraphrase[Introduction, paragraphs 1-3]

“However, there is little evidence on the effectiveness of such interventions for older adults with depressive symptoms, especially in LMICs.”

paraphrase[Introduction, paragraph 3]

“Therefore, we developed a self-help mobile messaging intervention for older adults with substantial depressive symptoms.”

direct quote[Methods, Sample size]

“but there were no local studies that had investigated a clinically meaningful threshold.”