Extension of efficacy range for targeted malaria-elimination interventions due to spillover effects.

Name: Αlpha¹ Rigor Record — Extension of efficacy range for targeted malaria-elimination interventions due to spillover effects.
Item: Extension of efficacy range for targeted malaria-elimination interventions due to spillover effects.
Rating: 59
Author: Αlpha¹

Benjamin-Chung J, Li H, Nguyen A, Barratt Heitmann G, Bennett A, Ntuku H, Prach LM, Tambo M, Wu L, Drakeley C, Gosling R, Mumbengegwi D, Kleinschmidt I, Smith JL, Hubbard A, van der Laan M, Hsiang MS

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 3.5★ (Adequate), 0 critical, 2 high issues for “Extension of efficacy range for targeted malaria-elimination interventions due to spillover effects.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 16, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

3.5 / 5

Adequate — real issues to address

Observational Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
StatisticsPrinted percentage does not match its own count (capped)−0.25★
CitationsUnresolved reference−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Problems surfaced4 types

Numerical inconsistencies2

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions1

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a rigorous re-analysis of a cluster-randomized trial, using TMLE to estimate direct and spillover effects of malaria interventions. It demonstrates strong scientific premise, design, ethics, and transparency, with minor reporting gaps in power analysis, exact p-values, and reagent catalog numbers. The main concern is a minor internal inconsistency in the reported confidence interval for the primary effect.

Both reviewers classified the study as observational, which is appropriate given the re-analysis of trial data using observational methods. The evaluation covered all eight dimensions; several sub-criteria were marked not applicable (e.g., cell line authentication, housing conditions) due to the human study context. The statistics verification covered only a subset of reported tests; the one inconsistency found (CI discrepancy) is minor and does not affect the overall assessment.

7 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit.

1 printed percentage that does not match its own count.

1 integrity concern flagged (0 high).

Reporting

Eight Dimensions8 pass

The introduction cites prior studies on spillover effects of various interventions and identifies a gap: no studies have estimated spillover effects of malaria interventions designed for low-transmission settings approaching elimination. The rationale for the study follows logically from this gap, and the authors acknowledge limitations of prior work, such as non-randomized designs and residual confounding.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior work on spillover effects and the need for evidence in low-transmission settings, and it logically motivates the study objectives.

Evidence

paraphrase[Introduction, paragraph 2]

“Earlier studies have reported spillover effects for mass drug administration for trachoma, school-based deworming, insecticide-treated bed nets and indoor residual spraying for malaria.”

direct quote[Introduction, paragraph 2]

“Furthermore, to our knowledge, no studies have estimated spillover effects of malaria interventions designed for low-transmission settings approaching elimination.”