Rigor Reviewed

Rigor-Reviewed Manuscript

A socially assistive robot to support mental wellbeing in LGBTQ+ young people at risk of self-harm: a randomized controlled trial.

Name: Αlpha¹ Rigor Record — A socially assistive robot to support mental wellbeing in LGBTQ+ young people at risk of self-harm: a randomized controlled trial.
Item: A socially assistive robot to support mental wellbeing in LGBTQ+ young people at risk of self-harm: a randomized controlled trial.
Rating: 96
Author: Αlpha¹

Williams AJ, Rhodes CA, Cleare S, Borschmann R, Gross JJ, Petrova K, Posada L, Tench CR, Chapman-Nisar A, Martin L, Hollis C, Townsend E, Slovak P, Digital Youth research team

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.75★ (Weak), 0 critical, 3 high issues for “A socially assistive robot to support mental wellbeing in LGBTQ+ young people at risk of self-harm: a randomized controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.75 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 12 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Problems surfaced5 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and transparently reported RCT of a socially assistive robot for emotion regulation in LGBTQ+ youth, with strong scientific premise, rigorous design, and full ethical approvals. The main weaknesses are the lack of an explicit power analysis, a vague data availability statement, and minor reporting gaps (statistical software not named, some p-values as thresholds, sex not reported separately from gender identity).

Both reviewers classified the study as interventional (RCT), and this was adopted. The evaluation covered all eight dimensions; non-applicable sub-criteria (e.g., animal housing, cell line authentication) were excluded. The statistics verification recomputed 6 reported tests consistently, but this does not confirm the correctness of unreported analyses. The integrity check found no high-severity concerns.

5 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 6 tests: 6 consistent, 0 inconsistent; 3 recomputed directly from the reported test statistics, 3 via agent-written checks.

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites numerous studies on LGBTQ+ youth mental health disparities, emotion regulation as a transdiagnostic target, and prior pilot work on Purrble. The rationale for the intervention is logically developed, and the paper explicitly addresses limitations of prior research, such as the lack of RCTs for Purrble and the need to examine gender identity subgroups.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise with extensive prior work and a clear rationale linking emotion regulation to mental health outcomes in LGBTQ+ youth.

Evidence

paraphrase[Introduction, paragraphs 1-3]

“LGBTQ+ youth are at increased risk for poor mental health outcomes, including elevated rates of depression and anxiety, self-harm, and suicidality.”

paraphrase[Introduction, paragraph 4]

“Purrble is designed to support emotion regulation in real-world settings through in-the-moment, intuitive, self-directed interaction, requiring no explicit instruction or prior orientation.”

direct quote[Introduction, final paragraph]

“However, to date, no randomized controlled trials evaluating the efficacy of the Purrble intervention have been conducted.”