Alpha¹ by KaimenConfidential

Kaimen Rigor review

Technology-assisted cognitive-behavioral therapy for perinatal depression delivered by lived-experience peers: a cluster-randomized noninferiority trial.

Rahman A, Malik A, Nazir H, Zaidi A, Nisar A, Waqas A, Atif N, Gibbs NK, Luo Y, Sikander S, Wang D

DOI: 10.1038/s41591-025-03655-1
Record issued: 2026-08-15
Engine: 7.39.0
Exported: 2026-09-21

Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/95aee62c-4d30-4d67-9e4b-991e80481b1f is authoritative.

Kaimen Rigor review

Kaimen Rigor reviewed

2 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ReportingData & code availability partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary outcome is remission from major depressive episode (MDE) diagnosed with SCID, which is a clinical diagnostic endpoint, not a surrogate. However, the efficacy claim also relies on secondary outcomes like PHQ-9 scores, which are symptom scales. The primary outcome is a hard clinical outcome, so the surrogate verdict is not applicable. But since the primary outcome is a clinical diagnosis, it is adequate.
“The primary outcome was defined as remission from MDE at 3 months postnatal, evaluated with the SCID MDE module.”
Find in source
02Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
Peer involvement may surpass the effectiveness of trained community health workers.
“The findings also suggest that peer involvement may have the potential to surpass the effectiveness of trained community health workers.”
Discussion ¶4Find in source
03Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“https://elements.liverpool.ac.uk/”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported cluster-randomized noninferiority trial with a strong scientific premise, rigorous design, and transparent reporting. The main weakness is the data/code availability: the repository link is dead and the access route is vague, which undermines reproducibility. Minor reporting gaps include incomplete identification of the THP-TAP app and lack of explicit outlier handling.

Both reviewers classified the study as interventional (cluster-randomized trial), and I adopt that classification. The evaluation covered all eight dimensions; species/strain, housing, antibodies, cell lines, and mycoplasma testing were not applicable as this is a human trial. The statistics verification recomputed only 3 tests (all consistent); the remaining statistics are unverified. The citation check found no retracted or unresolved references.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks.

Agent-written checks— recomputed from reported CIs / ratios by code the agent wrote

CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2
Primary outcome risk difference in ITT crude analysis
“The crude risk difference was 8.91%. The lower boundary of the one-sided 97.5% confidence interval (CI) was 4.25%, larger than −10% of the noninferiority margin, thus meeting the prespecified criterion for noninferiority ( P noninferiority < 0.0001).”
Find in source
Taken as given: The risk difference is 8.91% with a two-sided 95% CI of (4.25, 13.56).; The p-value is for a one-sided noninferiority test, but the CI-based p is two-sided; the one-sided p is half of the two-sided p.; The CI is symmetric on the risk difference scale.
Method: Used pCI to compute two-sided p from estimate and CI, then halved for one-sided.
How we recomputed it: pCI(8.91, 4.25, 13.56, 0)
CONSISTENTreported p = .007 · recomputed p = .007Reviewers 1, 2
Secondary outcome PHQ-9 at 3 months crude mean difference
“crude mean difference = −1.13, 95% CI = −1.96 to −0.31, P = 0.0071”
Find in source
Taken as given: The mean difference is -1.13 with a 95% CI of (-1.96, -0.31).; The p-value is two-sided.; The CI is symmetric on the mean difference scale.
Method: Used pCI to compute two-sided p from estimate and CI.
How we recomputed it: pCI(-1.13, -1.96, -0.31, 0)
CONSISTENTreported p = .002 · recomputed p = .001Reviewers 1, 2
Secondary outcome PHQ-9 >=10 at 3 months crude odds ratio
“crude odds ratio = 0.45, 95% CI = 0.28–0.74, P = 0.0016”
Find in source
Taken as given: The odds ratio is 0.45 with a 95% CI of (0.28, 0.74).; The p-value is two-sided.; The CI is on the log scale.
Method: Used pCI with log=1 for odds ratio.
How we recomputed it: pCI(0.45, 0.28, 0.74, 1)

lowinternal contradiction
The abstract states '846/980 (86.3%) participants at 3 months postnatal' were assessed, but the results section reports 428+418=846 assessed for the primary outcome, which is consistent. However, the number of participants lost to follow-up at 3 months is 134 (59+75), which would imply 980-134=846 assessed, consistent. No contradiction.
“On assessment of 846/980 (86.3%) participants at 3 months postnatal”
AbstractFind in source

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

5 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated), 1 only partially supported (evidence backs part of the claim; gaps or caveats remain).

overstatedReviewer 2
Peer involvement may surpass the effectiveness of trained community health workers.
The trial shows noninferiority and a statistically significant difference in PHQ-9 at 3 months, but the primary outcome is noninferiority, not superiority. The claim of 'may surpass' is speculative and not directly supported by the primary outcome.
Evidence: The primary outcome shows noninferiority, not superiority. The secondary PHQ-9 difference is significant, but the claim of surpassing is not a prespecified hypothesis.
“The findings also suggest that peer involvement may have the potential to surpass the effectiveness of trained community health workers.”
Discussion ¶4Find in source
partialReviewers 1, 2
THP-TAP is a potentially scalable alternative to WHO-THP in low-resource settings.
The trial demonstrates noninferiority and lower delivery costs in the optimized scenario, but scalability is inferred from cost modeling and process evaluation, not directly tested.
Evidence: Costs section: per-participant cost US$69 for THP-TAP vs US$59 for WHO-THP, but optimized costs US$24 vs US$44. Process evaluation shows high acceptability.
“Estimating the optimized, real-world intervention delivery costs in which equipment and training are used to full capacity, we estimate the per-patient cost to fall to US $24 for THP-TAP and US $44 for WHO-THP.”
DiscussionFind in source
supportedReviewers 1, 2
THP-TAP is noninferior to WHO-THP for remission from perinatal depression at 3 months postnatal.
The primary outcome analysis shows a risk difference of 8.91% with a lower CI bound of 4.25%, exceeding the -10% margin, and the noninferiority p-value is <0.0001.
Evidence: Table 2: ITT crude analysis: 395/428 (92.3%) vs 349/418 (83.5%), risk difference 8.91 (4.25, 13.56), P<0.0001.
“The crude risk difference was 8.91%. The lower boundary of the one-sided 97.5% confidence interval (CI) was 4.25%, larger than −10% of the noninferiority margin, thus meeting the prespecified criterion for noninferiority ( P noninferiority < 0.0001).”
ResultsFind in source
supportedReviewers 1, 2
THP-TAP reduces depressive symptoms more than WHO-THP at 3 months postnatal.
The PHQ-9 mean difference at 3 months is -1.13 (95% CI -1.96 to -0.31, P=0.0071), indicating a statistically significant reduction.
Evidence: Table 3: PHQ-9 at 3 months: mean difference -1.13 (95% CI -1.96 to -0.31), P=0.0071.
“THP-TAP group showed significantly lower mean depressive symptom scores measured with the 9-item Personal Health Questionnaire (PHQ-9) at 3 months, compared to the WHO-THP group, in the ITT analysis (crude mean difference = −1.13, 95% CI = −1.96 to −0.31, P = 0.0071”
ResultsFind in source
supportedReviewers 1, 2
The intervention is safe with no adverse events linked to the intervention.
The safety section reports no adverse events linked to the intervention, with two cases of deterioration due to domestic violence referred for care.
Evidence: Safety section: 'there were no adverse events linked to intervention reported in THP-TAP or WHO-THP groups.'
“During the trial, there were no adverse events linked to intervention reported in THP-TAP or WHO-THP groups.”
ResultsFind in source

Premise concern: surrogate not validated for clinical benefit.

INADEQUATESurrogate endpoint
The primary outcome is remission from major depressive episode (MDE) diagnosed with SCID, which is a clinical diagnostic endpoint, not a surrogate. However, the efficacy claim also relies on secondary outcomes like PHQ-9 scores, which are symptom scales. The primary outcome is a hard clinical outcome, so the surrogate verdict is not applicable. But since the primary outcome is a clinical diagnosis, it is adequate.
“The primary outcome was defined as remission from MDE at 3 months postnatal, evaluated with the SCID MDE module.”
Find in source
ADEQUATEEffect size
The primary outcome shows a remission rate of 92.3% in THP-TAP vs 83.5% in WHO-THP, with a risk difference of 8.91% and lower CI bound 4.25%, exceeding the noninferiority margin of -10%. This is a clinically meaningful difference, and the effect size is anchored to a prespecified margin and clinical remission.
“The difference in the remission rate was 8.91% with the lower boundary of the one-sided 97.5% confidence interval being 4.25%, larger than the prespecified −10% noninferiority margin (P noninferiority < 0.0001).”
Find in source

Data authenticity concerns

1 finding · worst low

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

3 integrity concerns flagged (0 high).

lowother
The paper reports a noninferiority margin of -10% and a risk difference of 8.91% favoring THP-TAP, which is unusual for a noninferiority trial (typically the new treatment is expected to be slightly worse). This is not a validity threat but worth noting.
“The crude risk difference was 8.91%.”
ResultsFind in source
lowother
The paper reports that the trial was single-blind, but the assessors were blinded. This is standard for psychotherapy trials, but the term 'single-blind' might be ambiguous; however, it is explained.
Our trial was a single-blind study, as participants cannot be blinded to 'talking therapies'.
Discussionreviewer’s wording

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites a systematic review and IPD meta-analysis of task-shared psychological interventions, the original THP trial, and WHO adoption, acknowledging both strengths and limitations (e.g., 'voltage-drop', 'program drift', critiques of reductionism). The rationale for the noninferiority design and the choice of margin are explicitly justified. The paper also addresses limitations of prior work by describing how peer delivery and digital assistance aim to overcome quality and fidelity issues.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise by citing prior research on the burden of perinatal depression, the effectiveness of task-shared interventions, and the specific challenges of scaling up WHO-THP, leading to a clear rationale for the new intervention.

Evidence

“A systematic literature review and individual patient data meta-analysis of 11 trials of 4,145 participants from LMICs showed that task-shared psychological interventions for depression were associated with a greater decrease in symptom severity than control conditions”

Introduction ¶3Find in source

paraphrase[Introduction, paragraph 4]

paraphrase[Introduction, paragraph 5]

“We attempted to address these challenges in two ways. First, we demonstrated the feasibility of delivering the WHO-THP through peers... Second, we applied a digital solution to the challenge of maintaining quality and fidelity.”

PASSReviewer 2· 95% conf

The paper establishes a strong scientific premise by citing prior research on the burden of perinatal depression, the effectiveness of task-shared interventions, and the specific challenges of scaling up WHO-THP, and it clearly links these to the study's rationale and hypothesis.

Evidence

paraphrase[Introduction, paragraph 3]

“Furthermore, we believed depriving depressed women of an efficacious treatment would be unethical, which could be avoided by using the noninferiority trial design.”

MethodsFind in source

paraphrase[Introduction, paragraph 4]

“However, efforts to scale up 'task-shared' interventions such as the WHO-THP are hampered by issues of quality control in training, delivery and supervision and what has been described by implementation scientists as a 'voltage-drop'—that is, the intervention loses some degree of its potency or fidelity when moving from efficacy to effectiveness in the real world—and 'program drift'—that is, the intervention deviates from its manualized or implementation protocols.”

Randomization used permuted blocks stratified by union council, with allocation by an independent statistician. Assessors were blinded, and participants/delivery agents could not be blinded due to the nature of the intervention, which is acknowledged. Power analysis is detailed with assumptions (75% remission, -10% margin, ICC 0.005, 20% loss, 87.2% power). Inclusion/exclusion criteria are pre-specified. Outlier handling is not explicitly described, but the analysis population (ITT and per-protocol) and missing data imputation are defined. Controls are inherent in the active comparator design.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous: cluster randomization with a stated method, stratification, blinding of assessors, a priori sample size calculation, and clear inclusion/exclusion criteria. The noninferiority margin is justified.

Evidence

“Randomization codes were generated via a permuted-block randomization method (stratified by UC). Block sizes varied at two, four and six. Allocation of clusters was carried out by an independent statistician based in Liverpool using the SAS PROC Plan.”

MethodsFind in source

“Due to the nature of the intervention, it was not possible to mask participants and delivery agents to treatment allocation. However, outcome assessors, who were nonresidents of the study area and independent of the intervention delivery procedures, were masked to treatment allocation.”

MethodsFind in source

“Allowing for 70 village clusters randomized with a 1:1 allocation ratio and 14 depressed participants per village cluster and 20% loss to follow-up, a total of 980 participants were required to detect noninferiority for the primary outcome at 3 months postnatal with a power of 87.2%.”

MethodsFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous: cluster randomization with a stated method, stratification, blinding of assessors, a priori sample size calculation, and pre-specified inclusion/exclusion criteria are all reported. The noninferiority margin and analysis populations are clearly defined.

Evidence

MethodsFind in source

“However, outcome assessors, who were nonresidents of the study area and independent of the intervention delivery procedures, were masked to treatment allocation.”

MethodsFind in source

Sex is reported (all female) and is justified by the condition (perinatal depression). Age, education, occupational status, and baseline PHQ-9/GAD-7/WHO-DAS scores are reported in Table 1. Species/strain and housing conditions are not applicable as this is a human trial. Demographics are adequately reported.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedADEQUATE

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study reports key demographic and clinical characteristics of participants, including age, education, occupation, and baseline depression/anxiety scores. Sex is uniformly female, which is appropriate for the condition, and justification is implicit.

Evidence

“We included women in their second or third pregnancy trimester, aged 18 years and above”

MethodsFind in source

“Age (mean, s.d.) | 27.20 (5.15) | 27.29 (4.94)”

Table 1Find in source

“PHQ-9 scores (mean, s.d.) | 16.73 (4.57) | 16.16 (4.51)”

Table 1Find in source

PASSReviewer 2· 90% conf

The study reports key demographic and clinical characteristics of participants, including age, education, occupation, and baseline depression/anxiety scores. Sex is uniformly female (perinatal depression), and age is reported. Health status is captured via depression diagnosis and symptom scores.

Evidence

“Age (mean, s.d.) | 27.20 (5.15) | 27.29 (4.94)”

Table 1Find in source

“PHQ-9 scores (mean, s.d.) | 16.73 (4.57) | 16.16 (4.51)”

Table 1Find in source

Ethical approval was obtained from the Ethics Review Committee at the University of Liverpool, the HDRF Pakistan, and the National Bioethics Committee, Pakistan. Informed consent is mentioned in the eligibility criteria ('Women with current MDE who provided informed consent were recruited'). Regulatory compliance is implied through adherence to ethical standards and the inclusion of an ethics statement.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval from named committees is reported, and informed consent is described. The study complies with relevant regulations.

Evidence

“Ethical approval was obtained from the Ethics Review Committee at the University of Liverpool, the HDRF, Pakistan (implementing organization), and the National Bioethics Committee, Pakistan.”

EthicsFind in source

“Women with current MDE who provided informed consent were recruited.”

MethodsFind in source

“Safeguards were implemented to ensure the well-being and safety of all participants involved.”

EthicsFind in source

PASSReviewer 2· 95% conf

Ethical approval from named committees is reported, and informed consent is described. The study complies with relevant regulations.

Evidence

“Ethical approval was obtained from the Ethics Review Committee at the University of Liverpool, the HDRF, Pakistan (implementing organization), and the National Bioethics Committee, Pakistan.”

EthicsFind in source

“Women with current MDE who provided informed consent were recruited.”

MethodsFind in source

The THP-TAP app is described as an Android tablet/smartphone-based app with in-built training, supervision, and monitoring features. The WHO-THP manual is referenced as downloadable from the WHO website. The peers and LHWs are described in terms of training and background. The app is a key resource, and its development is referenced to another publication. Software used for analysis (SAS 9.4) is identified.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The investigational product (THP-TAP app) is described in detail, and the comparator (WHO-THP) is identified. Software tools are named, but the app itself is not identified by version or repository.

Evidence

“The Android tablet or smartphone-based App had in-built features of training, supervision and monitoring.”

MethodsFind in source

“All statistical analyses were performed using SAS 9.4.”

Statistical analysisFind in source

paraphrase[Methods, Standard WHO-THP]

“The THP manual with step-by-step guidance on delivery is downloadable from the WHO website in a number of languages.”

PASSReviewer 2· 90% conf

The investigational product (THP-TAP app and WHO-THP manual) is described in detail, including the app's development and the WHO manual. The delivery agents (peers and LHWs) are characterized. No antibodies, cell lines, or mycoplasma testing are applicable.

Evidence

“The Android tablet or smartphone-based App had in-built features of training, supervision and monitoring.”

MethodsFind in source

“All statistical analyses were performed using SAS 9.4.”

Statistical analysisFind in source

Tests are named (GEE, GLMM). Assumptions are handled by design (e.g., GEE for clustered data). Exact p-values are reported (e.g., P=0.0071). Effect sizes with CIs are reported throughout. Software is identified. Data presentation includes per-group n and CIs. Mathematical plausibility checks: the primary outcome percentages (92.3% and 83.5%) are plausible given the numerators and denominators. No arithmetic errors detected.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityPASS

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with exact p-values and confidence intervals reported. The analysis follows the clinical trial idiom with GEE and GLMM models.

Evidence

“Primary outcome was analyzed using a generalized estimating equation (GEE) model.”

Statistical analysisFind in source

“crude mean difference = −1.13, 95% CI = −1.96 to −0.31, P = 0.0071”

ResultsFind in source

“8.91 (4.25, 13.56)”

Table 2Find in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described: GEE for the primary outcome, GLMM for secondary outcomes, with pre-specified covariates and multiple imputation for missing data. Effect sizes with confidence intervals are reported throughout. The paper reports exact p-values for most analyses.

Evidence

“Primary outcome was analyzed using a generalized estimating equation (GEE) model.”

Statistical analysisFind in source

“crude mean difference = −1.13, 95% CI = −1.96 to −0.31, P = 0.0071”

ResultsFind in source

The data availability statement mentions deposition at the University of Liverpool repository, but the access route is 'by submitting a request to the corresponding author' with conditions to be assessed, which is less concrete than a named managed-access platform. Code availability is also 'on request' with no repository. Repository deposit is planned but not yet available.

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositINADEQUATE

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement is present, but the data access route is vague ('available from the corresponding author on reasonable request') without a clear mechanism or timeframe. Code sharing is similarly vague.

Evidence

“Data from our trial will be deposited at the University of Liverpool data repository ( https://elements.liverpool.ac.uk/ ). This will include deidentified individual participant data and the data dictionary. Dataset will be made available by submitting a request to the corresponding author.”

Data availabilityFind in source

“After publication, analytic code will be shared with researchers who submit a formal proposal to the corresponding author (A.R.).”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability is described with a concrete route: deidentified individual participant data will be deposited in the University of Liverpool repository and made available upon request with a data-sharing agreement. Analytic code will be shared upon formal proposal. The trial protocol and statistical analysis plan are available in the clinical trials registry.

Evidence

Data availabilityFind in source

“After publication, analytic code will be shared with researchers who submit a formal proposal to the corresponding author (A.R.).”

Data availabilityFind in source

The paper states it follows CONSORT guidelines. Trial registration number (NCT05353491) is provided. All primary and secondary outcomes are reported, though some prespecified analyses (EQ-5D, mediation) are deferred to future publications, which is disclosed. Limitations are discussed, including single-blind design and potential Hawthorne effects. Conclusions are proportional to the evidence, with appropriate caveats about subgroup analyses. Funding (NIHR) and competing interests are declared.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The manuscript is well-reported, with a trial registration number, CONSORT adherence, transparent reporting of outcomes, and a limitations section. Funding and COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05353491”

AbstractFind in source

“The trial results are reported following the CONSORT guidelines for cluster-randomized trials.”

Statistical analysisFind in source

“A potential limitation is that the site has been used in previous THP trials”

Discussion ¶8Find in source

PASSReviewer 2· 95% conf

The manuscript is transparent: it follows CONSORT guidelines for cluster-randomized trials, reports all pre-specified outcomes (with some deferred to future publications), discusses limitations, and provides funding and competing interests. Trial registration is provided.

Evidence

“ClinicalTrials.gov registration: NCT05353491”

AbstractFind in source

“The trial results are reported following the CONSORT guidelines for cluster-randomized trials.”

Statistical analysisFind in source

paraphrase[Discussion, paragraph 10]

“Our trial was a single-blind study, as participants cannot be blinded to 'talking therapies'. This limitation is inherent in all psychotherapy trials.”

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

ClinicalTrials.gov

NCT05353491

Reporting guidelines: CONSORT

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 42 references by DOI: 34 verified — 8 no DOI (shown, not verified).

NO DOI
Maternal depression: a global threat to children’s health, development, and behavior and to human rights
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Thinking Healthy: A Manual for Psychosocial Management of Perinatal Depression
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Task-shifting or problem-shifting? How lay counselling is redefining mental healthcare
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Stories and metaphors in cognitive-behavior therapy
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Bridging the Gender Digital Divide: Challenges and an Urgent Call for Action for Equitable Digital Skills Development
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Landscape analysis of the family planning situation in Pakistan—District profile: Rawalpindi
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Structured Clinical Interview for DSM-5—Research Version (SCID-5 for DSM-5, Research Version; SCID-5-RV)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Framework analysis: a method for analysing qualitative data
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).

1 data/code link checked; 0 live, 1 dead.

datahttps://elements.liverpool.ac.uk/DEADHTTP 400
Dead link — nothing to verify.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly typo, consistency, grammar.

MINORtypoAbstract
“technology-assisted peer-delivered THP (THP-TAP)”
→ Ensure consistent use of 'THP-TAP' throughout.
The acronym is defined but used inconsistently in the abstract.
MINORconsistencyTable 1
“Occupational status | Housewife | 473 (97.1%) | 479 (97.2)”
→ Add '%' to the second percentage for consistency.
Minor formatting inconsistency in table.
MINORgrammarDiscussion
“This opens up important avenues for discussion regarding the unique advantages peers might bring, such as reduced workloads, heightened motivation and deeper familiarity with the community, which could enhance intervention delivery and outcomes.”
→ Consider splitting the long sentence for clarity.
Long sentence but grammatically correct.
MINORtypoAbstract
“technology-assisted peer-delivered THP (THP-TAP)”
→ Consider defining the abbreviation 'THP-TAP' at first use in the abstract, as it is used before the full term is given.
The abbreviation is defined in the introduction, but the abstract uses it without definition.
MINORconsistencyResults, 'Primary outcome'
“P noninferiority < 0.0001”
→ Consider reporting the exact p-value if available, or use 'P < 0.0001' consistently.
The paper uses 'P noninferiority' in some places and 'P' in others; consistency would improve clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust overall, but an informed reader should weigh the dead data repository link and the vague data/code access route as a reproducibility concern. The over-claim about peers 'surpassing' CHWs should be tempered. No erratum is warranted for the core findings, but the authors should correct the data availability link and clarify the access mechanism.

1.
HIGHdata code
Fix the dead data repository link (https://elements.liverpool.ac.uk/) in the Data availability section, or replace it with a working URL or DOI.
The reproducibility check found the link is dead, which directly undermines the data availability statement and prevents readers from accessing the data.
2.
HIGHdata code
Specify a concrete data access mechanism in the Data availability section, such as a named data access committee or a managed-access platform (e.g., Vivli), with conditions and a timeframe for data release.
The current 'request to the corresponding author' route is vague and does not meet transparency standards for patient-level data.
3.
HIGHdata code
Deposit the analytic code in a public repository (e.g., Zenodo or GitHub) with a DOI, and provide the link in the Code availability section.
Code sharing 'on request' is not reproducible; a public repository with a persistent identifier is the expected standard.
4.
HIGHreporting
Temper the claim that 'peer involvement may surpass the effectiveness of trained community health workers' in the Discussion to reflect that the trial demonstrated noninferiority, not superiority.
The primary outcome is noninferiority, so a claim of 'surpassing' is not supported by the evidence and could mislead readers.
5.
MEDIUMrigor
In the Methods, THP-TAP section, provide the app version or a reference to its repository or documentation to fully identify the investigational product.
The app is a key resource, and without a version or repository, the intervention cannot be precisely reproduced.
6.
MEDIUMrigor
In the Methods, Statistical analysis, explicitly state how outliers were handled, or note that no outliers were excluded.
One reviewer flagged outlier handling as inadequate; explicit reporting would resolve this ambiguity.
7.
MEDIUMreporting
In the Abstract, define the abbreviation 'THP-TAP' at first use, as it is used before the full term is given.
The copyedit pass noted the abbreviation is used without definition in the abstract, which could confuse readers.
8.
MEDIUMcopyedit
In Table 1, add '%' to the second percentage for occupational status (e.g., '479 (97.2%)') for consistency.
The copyedit pass flagged a minor formatting inconsistency in the table.
9.
MEDIUMreporting
In the Results, report the exact p-value for the noninferiority test in the abstract instead of 'P noninferiority < 0.0001'.
Exact p-values enhance precision and consistency with the rest of the paper.
10.
LOWreporting
In the Methods, specify the exact version of the SCID used (e.g., SCID-5) to ensure reproducibility.
The version of the diagnostic instrument is not stated, which is a minor reproducibility gap.
11.
LOWreporting
In the Statistical Analysis section, describe how the intracluster correlation coefficient was estimated and whether it was prespecified.
This would clarify the sample size calculation and analysis assumptions.
12.
LOWreporting
In the Discussion, discuss the generalizability of the findings to other LMIC settings, given the specific cultural and health system context of Pakistan.
The trial was conducted in a single district, so scalability to other contexts is uncertain.

Full text (66,454 chars)Analyzed: Aug 15, 2026

RigorReviewer 1

RigorReviewer 2

RigorPre-Submission Reviewer

CopyeditAgent Scribe

CitationsCitation Integrity

StatisticsStatistics Consistency

ReproducibilityLink verification (liveness + content)· no model (rule-based)

PreregistrationDeterministic check· no model (rule-based)

The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”

How stars are deducted

Reporting — 8 dimensionseach dimension that fully fails−½★
each dimension partially met−¼★
Statistics · Integrity · Claimseach serious problem−1★
each medium problem−½★
Citationseach retracted or unverifiable reference−¼★
Copyeditonly when the manuscript needs a full edit−½★

The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.

The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.

The eight reporting dimensions

Scientific PremisePrior work, rationale, and how it addresses gaps.

Study Design & RigorRandomization, blinding, power, controls, replication.

Biological VariablesSex, age, species/strain, housing, demographics.

Ethical ApprovalsIRB/IACUC approval, informed consent, regulatory compliance.

Key ResourcesAntibodies, cell lines, organisms, software — identified with persistent IDs.

Statistical ReportingNamed tests, exact p-values, effect sizes, plausible summary stats.

Data & Code AvailabilityAvailability statements, repositories, accession numbers, shared code.

Reporting TransparencyMethods, registration, guidelines, outcomes, limitations, funding/COI.

Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.

This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.

Technology-assisted cognitive-behavioral therapy for perinatal depression delivered by lived-experience peers: a cluster-randomized noninferiority trial.

Rahman A, Malik A, Nazir H, Zaidi A, Nisar A, Waqas A, Atif N, Gibbs NK, Luo Y, Sikander S, Wang D

DOI

10.1038/s41591-025-03655-1

Record issued

2026-08-15

Engine

7.39.0

Exported

2026-09-21