Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.

Name: Kaimen Rigor review — Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.
Item: Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.
Rating: 96
Author: Alpha1

Singla DR, Silver RK, Vigod SN, Schoueri-Mychasiw N, Kim JJ, La Porte LM, Ravitz P, Schiller CE, Lawson AS, Kiss A, Hollon SD, Dennis CL, Berenbaum TS, Krohn HA, Gibori JE, Charlebois J, Clark DM, Dalfen AK, Davis W, Gaynes BN, Leszcz M, Katz SR, Murphy KE, Naslund JA, Reyes-Rodríguez ML, Stuebe AM, Zlobin C, Mulsant BH, Patel V, Meltzer-Brody S

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.25★ (Weak), 0 critical, 6 high issues for “Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.

Read full text (PMC)

DOI

10.1038/s41591-024-03482-w

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/ba7608cd-1ead-42da-b8df-534fd51968b0" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/ba7608cd-1ead-42da-b8df-534fd51968b0/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 6 high issues for “Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

cc5387cd2ec5732419c2b2021c8bc99709c1e963f19bf248959624acecfc8449

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.

Paper source

Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 62 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on the Edinburgh Postnatal Depression Scale (EPDS), a symptom rating scale, which is a surrogate for clinical outcomes. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD) nor cite validated evidence linking EPDS changes to hard clinical outcomes such as remission or functional improvement. The EPDS is a screening tool, and while it is widely used, the paper does not establish it as a validated surrogate for the clinical outcome of interest.
“The primary outcome was depressive symptoms (Edinburgh Postnatal Depression Scale (EPDS))”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary outcome is a noninferiority comparison, and the reported effect sizes are small absolute differences in EPDS scores (e.g., 0.36 for provider comparison, 0.23 for modality comparison). These differences are not anchored to a minimal clinically important difference (MCID) for the primary outcome. The paper mentions an MCID of 1.4–6.4 for EPDS in the discussion, but the observed differences are far below this range, and the paper does not explicitly state that the noninferiority margins are clinically meaningful. The effect sizes are presented as noninferiority results, but the clinical meaningfulness of the absolute differences is not clearly established.
“absolute difference in EPDS means (0.36)”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported pragmatic noninferiority RCT. The main methodological strengths include a strong scientific premise, rigorous study design, detailed reporting of biological variables, ethical approvals, and transparent reporting. The primary weakness is the vague data and code availability statements, which rely on email requests rather than a formal managed-access platform or repository.

Both reviewers agreed on study type (interventional) and all dimension statuses. The evaluation covered all eight rigor dimensions; no dimensions were excluded as not applicable. The statistics verification component checked 3 tests and found all consistent; no citation or reproducibility issues were flagged.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

5 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

1 finding · worst low

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

3 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites a systematic review of 45 RCTs of nonspecialist-delivered psychological treatments and notes that no trials compared different provider types. It also cites evidence on telemedicine efficacy and notes the lack of adequately powered comparisons with in-person care. The rationale logically links these gaps to the trial's objectives, and the limitations of prior research (e.g., inactive control groups, inadequate power) are explicitly addressed.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper establishes a strong scientific premise by citing prior research on task-sharing and telemedicine, identifying gaps in the literature, and providing a clear rationale for the trial.

Evidence

“A previous systematic review yielded 45 randomized controlled trials of nonspecialist-delivered psychological treatments for perinatal populations with common mental health conditions.”

Introduction ¶2Find in source

“no trials, to our knowledge, evaluated whether different provider types were able to deliver the same treatments comparably.”

Introduction ¶2Find in source

“meaningful comparisons of telemedicine-delivered psychotherapy with in-person delivery have been impeded by inadequately powered trials to assess their effectiveness in common mental disorders.”

Introduction ¶3Find in source

PASSReviewer 2· 95% conf

The paper establishes a strong scientific premise by citing prior research on task-sharing and telemedicine, identifying gaps in the literature, and providing a clear rationale for the study objectives.

Evidence

“A previous systematic review yielded 45 randomized controlled trials of nonspecialist-delivered psychological treatments for perinatal populations with common mental health conditions.”

Introduction ¶2Find in source

“no trials, to our knowledge, evaluated whether different provider types were able to deliver the same treatments comparably.”

Introduction ¶2Find in source

“meaningful comparisons of telemedicine-delivered psychotherapy with in-person delivery have been impeded by inadequately powered trials to assess their effectiveness in common mental disorders.”

Introduction ¶3Find in source

Randomization was 1:1:1:1 to four arms, with a method described (though the specific randomization algorithm is not detailed in the text, it is referenced to the protocol). The unit of randomization is the individual participant. Blinding is not explicitly described, but the pragmatic nature of the trial and the use of self-report outcomes (EPDS, GAD-7) mitigate the need for assessor blinding; however, the paper does not state this rationale. Power analysis is reported in the protocol (referenced). Inclusion/exclusion criteria are clearly stated. Outlier handling is defined (1.5×IQR rule). The analysis population (ITT and PP) is defined, with PP only for modality due to COVID-19 switches.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsINADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodINADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous: randomization method and unit are described, blinding is addressed (though not fully detailed), power analysis is reported, inclusion/exclusion criteria are pre-specified, and the analysis population is defined.

Evidence

“pregnant and postpartum adult participants were randomized 1:1:1:1 to each arm”

AbstractFind in source

“inclusion criteria included being a pregnant (≤36 weeks) or postpartum (4–30 weeks) adult (≥18 years; inclusive of gender identities and birthing persons) with a score ≥10 on the EPDS and speaking English or Spanish.”

MethodsFind in source

“Outliers were defined as scores that were greater than 1.5× the interquartile range + the third quartile OR lower than the first quartile – 1.5× the interquartile range.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous: randomization method and unit are described, blinding is addressed, a power analysis is reported, inclusion/exclusion criteria are pre-specified, and the analysis population is defined.

Evidence

“pregnant and postpartum adult participants were randomized 1:1:1:1 to each arm”

AbstractFind in source

MethodsFind in source

“Outliers were defined as scores that were greater than 1.5× the interquartile range + the third quartile OR lower than the first quartile – 1.5× the interquartile range.”

Statistical analysisFind in source

Sex is reported (99.57% cis-women). Age is reported (mean 33.27 years). Demographics are extensive, including race/ethnicity, education, income, marital status, and employment. Health status is reported via psychiatric history and psychotropic medication use. Since the study enrolled both sexes (though predominantly women), sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study reports sex, age, and extensive demographics; sex is not justified because both sexes were enrolled (though nearly all were cis-women).

Evidence

“who predominantly identified as cis-women (1,168/1,173, 99.57%)”

ResultsFind in source

“Participants’ mean age was 33.27 (95% confidence interval (CI) 33.00–33.55) years”

ResultsFind in source

paraphrase[Table 1]

“Race/ethnicity (1,226) a | American Indian/Alaska Native | 5 (0.41) | 1 (0.16) | 4 (0.66) | 4 (0.43) | 1 (0.35)”

PASSReviewer 2· 95% conf

The study reports sex, age, and extensive demographics; sex is not justified because both sexes were enrolled (though predominantly cis-women), and species/housing are not applicable.

Evidence

“who predominantly identified as cis-women (1,168/1,173, 99.57%)”

ResultsFind in source

“Participants’ mean age was 33.27 (95% confidence interval (CI) 33.00–33.55) years”

ResultsFind in source

paraphrase[Table 1]

“Race/ethnicity (1,226) a | American Indian/Alaska Native | 5 (0.41) | 1 (0.16) | 4 (0.66) | 4 (0.43) | 1 (0.35)”

The paper states: 'The study received ethical approvals from the following three institutional review boards (IRBs): UNC Biomedical IRB (19-1786), Endeavor Health IRB (EH18-129) and Clinical Trials Ontario (1895).' It also states 'All participants provided written informed consent before enrollment.' Regulatory compliance is not explicitly named (e.g., Declaration of Helsinki), but the IRB approvals and consent process are adequate.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study received ethical approval from three named IRBs and all participants provided written informed consent; regulatory compliance is implied through IRB approval.

Evidence

“The study received ethical approvals from the following three institutional review boards (IRBs): UNC Biomedical IRB (19-1786), Endeavor Health IRB (EH18-129) and Clinical Trials Ontario (1895).”

MethodsFind in source

“All participants provided written informed consent before enrollment.”

MethodsFind in source

PASSReviewer 2· 95% conf

The study received ethical approval from three named IRBs, and all participants provided written informed consent; regulatory compliance is implied through adherence to ethical standards.

Evidence

MethodsFind in source

“All participants provided written informed consent before enrollment.”

MethodsFind in source

The intervention is behavioral activation, described as manualized with an open-access manual available at www.thesummittrial.com. The manual is adapted from two established manuals. Statistical software is identified as SAS version 9.4. No antibodies, cell lines, or other reagents are used. The trial is a behavioral intervention, so the investigational product is the therapy itself, which is adequately identified.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational product (behavioral activation therapy) is described with a manual and online access; software (SAS 9.4) is identified; no other biological/chemical resources are used.

Evidence

“The SUMMIT open-access treatment manual is available online at no cost ( www.thesummittrial.com (http://www.thesummittrial.com) ).”

Introduction ¶4Find in source

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (behavioral activation therapy) is described with a manual and online access; software (SAS 9.4) is identified; no antibodies, cell lines, or organisms are used.

Evidence

“The SUMMIT open-access treatment manual is available online at no cost ( www.thesummittrial.com (http://www.thesummittrial.com) ).”

IntroductionFind in source

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

The paper reports noninferiority using CIs around mean differences, which is the standard idiom. Tests are named (e.g., two-sample t-tests, linear mixed models, F-tests). Effect sizes are reported as mean differences with 95% CIs. Software is identified (SAS 9.4). Data presentation includes figures with means over time and tables with CIs. Exact p-values are reported for some analyses (e.g., t-test for sessions attended, P < 0.001), but for primary outcomes, noninferiority is assessed via CIs, so exact_p_values is not applicable. Assumptions are not explicitly verified, but the use of standard methods and sensitivity analyses is adequate for a large trial.

Sub-criteria

tests namedADEQUATE

exact p valuesN/A

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical tests are named, effect sizes with CIs are reported, software is identified, and data presentation is appropriate for a clinical trial; exact p-values are not always reported but the trial uses estimation with CIs.

Evidence

paraphrase[Methods, Statistical analysis]

“we looked at the CI around the difference in outcome based on the actual data (for example, EPDS scores between nonspecialist and specialist or between telemedicine and in-person) to see whether the upper bound contained the noninferiority margin”

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

“those randomized to telemedicine attended significantly more sessions than those randomized to in-person BA (6.55 versus 5.07, t (1,228) = −8.15, P < 0.001).”

ResultsFind in source

PASSReviewer 2· 90% conf

Evidence

“EPDS: nonspecialist 9.27 (95% CI 8.85–9.70) versus specialist 8.91 (95% CI 8.49–9.33), absolute difference in EPDS means (0.36)”

ResultsFind in source

“Linear mixed models assessed the moderating effects of severity at baseline, with participants as a random effect and a treatment-by-time interaction.”

Statistical analysisFind in source

“We tested for a modality by provider interaction ( P = 0.93) for our primary (EPDS) outcome”

ResultsFind in source

The data availability statement says: 'Two years after publication, all individual participant deidentified data will be shared with researchers who submit a written proposal to: summittrial@sinaihealth.ca.' This is a concrete route (email) but lacks a formal data-access committee or platform, and the conditions are minimal. Code availability is similarly vague. Repository deposit and accession numbers are not applicable for patient-level data.

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

A data availability statement is present but vague, offering data 'on request' with a contact email but no platform or formal access committee; code sharing is similarly vague.

Evidence

“Two years after publication, all individual participant deidentified data will be shared with researchers who submit a written proposal to: summittrial@sinaihealth.ca.”

Data availabilityFind in source

“Two years after publication, analytic code will be shared with researchers who submit a formal written proposal to summittrial@sinaihealth.ca.”

Data availabilityFind in source

WARNReviewer 2· 90% conf

Data and code availability statements are present but vague, lacking a concrete repository or managed-access platform; they only offer 'on request' via email.

Evidence

“Two years after publication, all individual participant deidentified data will be shared with researchers who submit a written proposal to: summittrial@sinaihealth.ca.”

Data availabilityFind in source

“Two years after publication, analytic code will be shared with researchers who submit a formal written proposal to summittrial@sinaihealth.ca.”

Data availabilityFind in source

The trial is registered at ClinicalTrials.gov (NCT04153864). Methods are detailed enough for replication. Limitations are discussed (e.g., COVID-19 modifications, generalizability). Conclusions are proportional to the noninferiority findings. Funding and competing interests are disclosed. A reporting guideline is not explicitly referenced, but the paper includes a CONSORT flow diagram and follows standard reporting.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial is registered, methods are detailed, limitations are discussed, conclusions are proportional, and funding/COI are disclosed; a reporting guideline is not explicitly mentioned but the paper follows CONSORT-like structure.

Evidence

“ClinicalTrials.gov NCT04153864 (https://clinicaltrials.gov/ct2/show/NCT04153864)”

AbstractFind in source

“The study also has limitations. Substantial modifications were required due to COVID-19, including a change in noninferiority margin from 10% to 13% in the telemedicine versus in-person comparison, and deviation from the assigned modality due to institutional mandates during the pandemic.”

Discussion ¶8Find in source

“We also thank the Patient-Centered Outcomes Research Institute award (PCS-2018C1-10621, to D.R.S.) who funded SUMMIT.”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

Evidence

“ClinicalTrials.gov NCT04153864 (https://clinicaltrials.gov/ct2/show/NCT04153864)”

AbstractFind in source

DiscussionFind in source

“We also thank the Patient-Centered Outcomes Research Institute award (PCS-2018C1-10621, to D.R.S.) who funded SUMMIT.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 84 references by DOI: 2 verified — 82 no DOI (shown, not verified).

3 data/code links checked; 3 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published paper is robust overall, with minor reporting gaps in data/code availability and a few copyedit issues. An informed reader should weigh the vague data-sharing mechanism and the lack of explicit blinding and power analysis details in the main text. No erratum-level concerns are warranted, but the authors could strengthen the paper by depositing data and code in a managed-access repository.

1.
HIGHdata code
Replace the email-based data availability statement with a named managed-access platform (e.g., Vivli, YODA) or provide a data-sharing agreement template.
A simple email address does not meet the standard for managed access and may deter legitimate researchers from requesting data.
2.
HIGHdata code
Deposit the analytic code in a public repository (e.g., Zenodo, GitHub) with a DOI or permanent identifier, and update the code availability statement accordingly.
Code sharing via email request is vague and not reproducible; a public repository ensures long-term accessibility.
3.
HIGHreporting
In the Methods, explicitly state whether blinding of outcome assessors was performed or provide a rationale for not blinding, given the pragmatic design.
Blinding is a key quality indicator for RCTs; its absence should be justified to allow readers to assess potential bias.
4.
HIGHreporting
In the Methods, describe the randomization sequence generation and allocation concealment in more detail (e.g., central randomization, block sizes).
Adequate randomization and allocation concealment are critical for preventing selection bias; the current description is insufficient.
5.
HIGHreporting
In the Methods or Reporting summary, explicitly reference the CONSORT guideline and include the CONSORT checklist as supplementary material.
Explicit adherence to a reporting guideline improves completeness and transparency, and is expected by many journals.
6.
HIGHethics
Add a statement on regulatory compliance (e.g., Declaration of Helsinki) in the ethics section.
Explicit mention of regulatory compliance is a standard requirement for clinical trials and strengthens the ethics statement.
7.
MEDIUMreporting
In the Methods, add a formal power analysis or sample size calculation, stating the assumed effect size, alpha, power, and noninferiority margin used to determine N=1230.
A power analysis is a key design element; referencing the protocol is insufficient for readers who do not have access to it.
8.
MEDIUMstatistics
In the Statistical analysis section, explicitly state how normality and homogeneity of variance assumptions were checked for the linear models, or justify the use of robust methods.
Verification of model assumptions is important for the validity of parametric tests; the current reporting is inadequate.
9.
MEDIUMreporting
In the Discussion, provide a more detailed discussion of the implications of the GAD-7 PP analysis where noninferiority was not met, and why the result is not clinically meaningful.
A noninferiority failure in a secondary outcome warrants careful interpretation to avoid misleading conclusions.
10.
MEDIUMstatistics
Consider reporting exact p-values for the primary noninferiority comparisons (e.g., for the difference in means) in addition to CIs, to facilitate interpretation.
Exact p-values can aid readers in assessing the strength of evidence, though CIs are the primary method for noninferiority.
11.
LOWcopyedit
Fix the typographical error 's ame' to 'same' in the Discussion, paragraph 2.
Typographical errors reduce the professional appearance of the manuscript.
12.
LOWcopyedit
Ensure consistent ordering of arm numbers in the Abstract and Results (e.g., list as 472, 469, 145, 144 in both places).
Inconsistent ordering may confuse readers, even if the numbers are the same.
13.
LOWcopyedit
Use consistent terminology: replace 'recruited' with 'enrolled and randomized' in the Abstract to match the Results.
Consistent terminology improves clarity and avoids potential misinterpretation.
14.
LOWcopyedit
Clarify the footnote in Table 2 to specify that the 95% upper/lower bound applies to the difference in means, not the individual scores.
A clearer footnote helps readers correctly interpret the noninferiority comparison.

Full text (87,738 chars · analyzed ~85%, head + tail)Analyzed: Aug 15, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.

Read full text (PMC)

DOI

10.1038/s41591-024-03482-w

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/ba7608cd-1ead-42da-b8df-534fd51968b0" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/ba7608cd-1ead-42da-b8df-534fd51968b0/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 6 high issues for “Task-sharing and telemedicine delivery of psychotherapy to treat perinatal depression: a pragmatic, noninferiority randomized trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

cc5387cd2ec5732419c2b2021c8bc99709c1e963f19bf248959624acecfc8449

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 62 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on the Edinburgh Postnatal Depression Scale (EPDS), a symptom rating scale, which is a surrogate for clinical outcomes. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD) nor cite validated evidence linking EPDS changes to hard clinical outcomes such as remission or functional improvement. The EPDS is a screening tool, and while it is widely used, the paper does not establish it as a validated surrogate for the clinical outcome of interest.
“The primary outcome was depressive symptoms (Edinburgh Postnatal Depression Scale (EPDS))”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary outcome is a noninferiority comparison, and the reported effect sizes are small absolute differences in EPDS scores (e.g., 0.36 for provider comparison, 0.23 for modality comparison). These differences are not anchored to a minimal clinically important difference (MCID) for the primary outcome. The paper mentions an MCID of 1.4–6.4 for EPDS in the discussion, but the observed differences are far below this range, and the paper does not explicitly state that the noninferiority margins are clinically meaningful. The effect sizes are presented as noninferiority results, but the clinical meaningfulness of the absolute differences is not clearly established.
“absolute difference in EPDS means (0.36)”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

5 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

1 finding · worst low

Other integrity concernAssessed

3 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper establishes a strong scientific premise by citing prior research on task-sharing and telemedicine, identifying gaps in the literature, and providing a clear rationale for the trial.

Evidence

“A previous systematic review yielded 45 randomized controlled trials of nonspecialist-delivered psychological treatments for perinatal populations with common mental health conditions.”

Introduction ¶2Find in source

“no trials, to our knowledge, evaluated whether different provider types were able to deliver the same treatments comparably.”

Introduction ¶2Find in source

“meaningful comparisons of telemedicine-delivered psychotherapy with in-person delivery have been impeded by inadequately powered trials to assess their effectiveness in common mental disorders.”

Introduction ¶3Find in source

PASSReviewer 2· 95% conf

Evidence

“A previous systematic review yielded 45 randomized controlled trials of nonspecialist-delivered psychological treatments for perinatal populations with common mental health conditions.”

Introduction ¶2Find in source

“no trials, to our knowledge, evaluated whether different provider types were able to deliver the same treatments comparably.”

Introduction ¶2Find in source

“meaningful comparisons of telemedicine-delivered psychotherapy with in-person delivery have been impeded by inadequately powered trials to assess their effectiveness in common mental disorders.”

Introduction ¶3Find in source

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsINADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodINADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Evidence

“pregnant and postpartum adult participants were randomized 1:1:1:1 to each arm”

AbstractFind in source

MethodsFind in source

“Outliers were defined as scores that were greater than 1.5× the interquartile range + the third quartile OR lower than the first quartile – 1.5× the interquartile range.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

Evidence

“pregnant and postpartum adult participants were randomized 1:1:1:1 to each arm”

AbstractFind in source

MethodsFind in source

“Outliers were defined as scores that were greater than 1.5× the interquartile range + the third quartile OR lower than the first quartile – 1.5× the interquartile range.”

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study reports sex, age, and extensive demographics; sex is not justified because both sexes were enrolled (though nearly all were cis-women).

Evidence

“who predominantly identified as cis-women (1,168/1,173, 99.57%)”

ResultsFind in source

“Participants’ mean age was 33.27 (95% confidence interval (CI) 33.00–33.55) years”

ResultsFind in source

paraphrase[Table 1]

“Race/ethnicity (1,226) a | American Indian/Alaska Native | 5 (0.41) | 1 (0.16) | 4 (0.66) | 4 (0.43) | 1 (0.35)”

PASSReviewer 2· 95% conf

The study reports sex, age, and extensive demographics; sex is not justified because both sexes were enrolled (though predominantly cis-women), and species/housing are not applicable.

Evidence

“who predominantly identified as cis-women (1,168/1,173, 99.57%)”

ResultsFind in source

“Participants’ mean age was 33.27 (95% confidence interval (CI) 33.00–33.55) years”

ResultsFind in source

paraphrase[Table 1]

“Race/ethnicity (1,226) a | American Indian/Alaska Native | 5 (0.41) | 1 (0.16) | 4 (0.66) | 4 (0.43) | 1 (0.35)”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study received ethical approval from three named IRBs and all participants provided written informed consent; regulatory compliance is implied through IRB approval.

Evidence

MethodsFind in source

“All participants provided written informed consent before enrollment.”

MethodsFind in source

PASSReviewer 2· 95% conf

The study received ethical approval from three named IRBs, and all participants provided written informed consent; regulatory compliance is implied through adherence to ethical standards.

Evidence

MethodsFind in source

“All participants provided written informed consent before enrollment.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational product (behavioral activation therapy) is described with a manual and online access; software (SAS 9.4) is identified; no other biological/chemical resources are used.

Evidence

“The SUMMIT open-access treatment manual is available online at no cost ( www.thesummittrial.com (http://www.thesummittrial.com) ).”

Introduction ¶4Find in source

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (behavioral activation therapy) is described with a manual and online access; software (SAS 9.4) is identified; no antibodies, cell lines, or organisms are used.

Evidence

“The SUMMIT open-access treatment manual is available online at no cost ( www.thesummittrial.com (http://www.thesummittrial.com) ).”

IntroductionFind in source

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesN/A

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Evidence

paraphrase[Methods, Statistical analysis]

“The trial biostatistician conducted all analyses using SAS version 9.4 (SAS Institute).”

Statistical analysisFind in source

“those randomized to telemedicine attended significantly more sessions than those randomized to in-person BA (6.55 versus 5.07, t (1,228) = −8.15, P < 0.001).”

ResultsFind in source

PASSReviewer 2· 90% conf

Evidence

“EPDS: nonspecialist 9.27 (95% CI 8.85–9.70) versus specialist 8.91 (95% CI 8.49–9.33), absolute difference in EPDS means (0.36)”

ResultsFind in source

“Linear mixed models assessed the moderating effects of severity at baseline, with participants as a random effect and a treatment-by-time interaction.”

Statistical analysisFind in source

“We tested for a modality by provider interaction ( P = 0.93) for our primary (EPDS) outcome”

ResultsFind in source

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

A data availability statement is present but vague, offering data 'on request' with a contact email but no platform or formal access committee; code sharing is similarly vague.

Evidence

“Two years after publication, all individual participant deidentified data will be shared with researchers who submit a written proposal to: summittrial@sinaihealth.ca.”

Data availabilityFind in source

“Two years after publication, analytic code will be shared with researchers who submit a formal written proposal to summittrial@sinaihealth.ca.”

Data availabilityFind in source

WARNReviewer 2· 90% conf

Data and code availability statements are present but vague, lacking a concrete repository or managed-access platform; they only offer 'on request' via email.

Evidence

“Two years after publication, all individual participant deidentified data will be shared with researchers who submit a written proposal to: summittrial@sinaihealth.ca.”

Data availabilityFind in source

“Two years after publication, analytic code will be shared with researchers who submit a formal written proposal to summittrial@sinaihealth.ca.”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Evidence

“ClinicalTrials.gov NCT04153864 (https://clinicaltrials.gov/ct2/show/NCT04153864)”

AbstractFind in source

Discussion ¶8Find in source

“We also thank the Patient-Centered Outcomes Research Institute award (PCS-2018C1-10621, to D.R.S.) who funded SUMMIT.”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

Evidence

“ClinicalTrials.gov NCT04153864 (https://clinicaltrials.gov/ct2/show/NCT04153864)”

AbstractFind in source

DiscussionFind in source

“We also thank the Patient-Centered Outcomes Research Institute award (PCS-2018C1-10621, to D.R.S.) who funded SUMMIT.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 84 references by DOI: 2 verified — 82 no DOI (shown, not verified).

3 data/code links checked; 3 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Replace the email-based data availability statement with a named managed-access platform (e.g., Vivli, YODA) or provide a data-sharing agreement template.
A simple email address does not meet the standard for managed access and may deter legitimate researchers from requesting data.
2.
HIGHdata code
Deposit the analytic code in a public repository (e.g., Zenodo, GitHub) with a DOI or permanent identifier, and update the code availability statement accordingly.
Code sharing via email request is vague and not reproducible; a public repository ensures long-term accessibility.
3.
HIGHreporting
In the Methods, explicitly state whether blinding of outcome assessors was performed or provide a rationale for not blinding, given the pragmatic design.
Blinding is a key quality indicator for RCTs; its absence should be justified to allow readers to assess potential bias.
4.
HIGHreporting
In the Methods, describe the randomization sequence generation and allocation concealment in more detail (e.g., central randomization, block sizes).
Adequate randomization and allocation concealment are critical for preventing selection bias; the current description is insufficient.
5.
HIGHreporting
In the Methods or Reporting summary, explicitly reference the CONSORT guideline and include the CONSORT checklist as supplementary material.
Explicit adherence to a reporting guideline improves completeness and transparency, and is expected by many journals.
6.
HIGHethics
Add a statement on regulatory compliance (e.g., Declaration of Helsinki) in the ethics section.
Explicit mention of regulatory compliance is a standard requirement for clinical trials and strengthens the ethics statement.
7.
MEDIUMreporting
In the Methods, add a formal power analysis or sample size calculation, stating the assumed effect size, alpha, power, and noninferiority margin used to determine N=1230.
A power analysis is a key design element; referencing the protocol is insufficient for readers who do not have access to it.
8.
MEDIUMstatistics
In the Statistical analysis section, explicitly state how normality and homogeneity of variance assumptions were checked for the linear models, or justify the use of robust methods.
Verification of model assumptions is important for the validity of parametric tests; the current reporting is inadequate.
9.
MEDIUMreporting
In the Discussion, provide a more detailed discussion of the implications of the GAD-7 PP analysis where noninferiority was not met, and why the result is not clinically meaningful.
A noninferiority failure in a secondary outcome warrants careful interpretation to avoid misleading conclusions.
10.
MEDIUMstatistics
Consider reporting exact p-values for the primary noninferiority comparisons (e.g., for the difference in means) in addition to CIs, to facilitate interpretation.
Exact p-values can aid readers in assessing the strength of evidence, though CIs are the primary method for noninferiority.
11.
LOWcopyedit
Fix the typographical error 's ame' to 'same' in the Discussion, paragraph 2.
Typographical errors reduce the professional appearance of the manuscript.
12.
LOWcopyedit
Ensure consistent ordering of arm numbers in the Abstract and Results (e.g., list as 472, 469, 145, 144 in both places).
Inconsistent ordering may confuse readers, even if the numbers are the same.
13.
LOWcopyedit
Use consistent terminology: replace 'recruited' with 'enrolled and randomized' in the Abstract to match the Results.
Consistent terminology improves clarity and avoids potential misinterpretation.
14.
LOWcopyedit
Clarify the footnote in Table 2 to specify that the 95% upper/lower bound applies to the difference in means, not the individual scores.
A clearer footnote helps readers correctly interpret the noninferiority comparison.

Full text (87,738 chars · analyzed ~85%, head + tail)Analyzed: Aug 15, 2026