Effectiveness, cost-effectiveness, and positive externalities of integrated chronic care for adults with major depressive disorder in Malawi (IC3D): a stepped-wedge, cluster-randomised, controlled trial.

Name: Αlpha¹ Rigor Record — Effectiveness, cost-effectiveness, and positive externalities of integrated chronic care for adults with major depressive disorder in Malawi (IC3D): a stepped-wedge, cluster-randomised, controlled trial.
Item: Effectiveness, cost-effectiveness, and positive externalities of integrated chronic care for adults with major depressive disorder in Malawi (IC3D): a stepped-wedge, cluster-randomised, controlled trial.
Rating: 96
Author: Αlpha¹

McBain RK, Mwale O, Mpinga K, Kamwiyo M, Kayira W, Ruderman T, Connolly E, Watson SI, Wroe EB, Munyaneza F, Dullie L, Raviola G, Smith SL, Kulisewa K, Udedi M, Patel V, Wagner GJ

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 1.75★ (Critical), 0 critical, 4 high issues for “Effectiveness, cost-effectiveness, and positive externalities of integrated chronic care for adults with major depressive disorder in Malawi (IC3D): a stepped-wedge, cluster-randomised, controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 16, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

1.75 / 5

Critical — serious problems across many checks

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 5 reported means were read, and their group size is not stated where the values are printed. These checks need the count the mean was averaged over, so none was performed.
No data or code availability links were detected to verify.

Problems surfaced6 types

Numerical inconsistencies2

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Reported statistics do not recomputeRecomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-designed and transparently reported stepped-wedge cluster-randomised trial with strong methodological rigor across most dimensions. The main weakness is the vague data availability statement, which lacks a concrete mechanism for accessing data and code. Minor copyedit issues and a small statistical discrepancy in one p-value do not undermine the overall conclusions.

Both reviewers agreed on all dimensions, so no divergence needed reconciliation. The study type is interventional (stepped-wedge cluster-randomised trial). Non-applicable sub-criteria (e.g., animal housing, cell line authentication) were excluded from scoring. The statistics verification covered only a subset of reported tests (8 recomputed), so the overall statistical correctness is not fully confirmed.

5 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 8 tests: 7 consistent, 1 inconsistent; 8 via agent-written checks.

3 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites extensive prior research on the treatment gap for depression in low-income settings, the potential of task-shifting, and the need to measure positive externalities. It explicitly identifies two shortcomings in implementation research (implementation and measurement issues) and explains how the study addresses them. The hypothesis follows logically from the cited evidence.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with substantial prior work cited and a logical rationale linking the evidence to the study objectives.

Evidence

direct quote[Introduction, paragraph 1]

“This treatment gap is persistent, despite behavioural and pharmacological interventions that show efficacy in trials.”