Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Name: Kaimen Rigor review — Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.
Item: Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.
Rating: 59
Author: Alpha1

Glue P, Loo C, Fam J, Lane HY, Young AH, Surman P, BEDROC study investigators

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 3★ (Adequate), 0 critical, 2 high issues for “Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Glue P, Loo C, Fam J, Lane HY, Young AH, Surman P, BEDROC study investigators

Read full text (PMC)

DOI

10.1038/s41591-024-03063-x

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/33f2947f-5ac4-4737-b85a-6f91a4cc1847" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/33f2947f-5ac4-4737-b85a-6f91a4cc1847/badge" alt="Kaimen Rigor review — 3★ (Adequate), 0 critical, 2 high issues for “Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

a38a2db4a237d8e096206b0ded90464d5b187e5ed2449524227d229f41388c16

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Glue P, Loo C, Fam J, Lane HY, Young AH, Surman P, BEDROC study investigators

Paper source

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

3 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped)−0.25★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 10 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy endpoint is the change in MADRS score, a clinician-rated depression severity scale. While MADRS is a validated clinical scale, it is a surrogate for the clinical outcome of depression remission/response. The paper does not provide evidence linking MADRS changes to hard clinical outcomes, nor does it demonstrate target engagement at the tested dose beyond the clinical response itself. The efficacy claim rests on this surrogate measure without a validated link to long-term functional outcomes or mortality.
“The primary endpoint was least square mean change in MADRS for each active treatment compared with placebo at 13 weeks”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect size is a mean difference of -6.1 points on the MADRS scale for the 180 mg dose vs placebo. While the paper claims this exceeds the minimal clinically important difference (MCID), the MCID for MADRS is typically around 2-3 points, so 6.1 is above that. However, the effect is presented as a group mean difference, and the clinical meaningfulness is not robustly anchored to individual-level response or remission rates. The paper does not report the proportion of patients achieving response or remission at the primary endpoint, and the effect size is modest relative to the baseline severity (mean MADRS ~30).
“the least square mean difference of MADRS score for the 180 mg tablet group and placebo was −6.1 (95% confidence interval 1.0 to 11.16, P = 0.019) at 13 weeks”
Find in source
03Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
11.6% does not match the reported count 26/231
“26 participants (11.6%)”
Safety outcomes, open-label enrichment…Find in source

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 2 randomized placebo-controlled trial with rigorous design, clear reporting, and appropriate statistical methods. The main weaknesses are a vague data availability statement and the lack of named statistical software, both minor reporting gaps. The copyedit issues are minor typos and consistency problems.

Both reviewers agreed on all dimensions and study type (interventional). The statistics verification component checked only 4 tests (3 consistent, 1 inconsistent) and cannot verify threshold-only p-values or resampling-based tests; the inconsistent test is not specified and does not constitute a demonstrable error. The integrity concern about the wide CI is low severity and not a validity threat.

Numerical inconsistencies

2 findings · worst medium

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks. 1 printed percentage that does not match its own count.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior research on ketamine's antidepressant effects, oral dosing, and the prodrug hypothesis, and explains the rationale for an extended-release formulation. It also addresses limitations of prior work, such as high failure rates in acute trials and the need for enrichment designs. The hypothesis follows logically from the cited evidence.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale for the study hypothesis.

Evidence

paraphrase[Introduction, paragraph 1]

“A meta-analysis of ketamine formulations identified that formulations that maximize first-pass metabolism of ketamine and delay time to maximum concentrations were better tolerated (less dissociation) and safer (less blood pressure change) than formulations that lack those characteristics.”

“We chose this design owing to observations that acute antidepressant clinical trials in non-TRD depression have high failure rates (inability to separate clinical response between active and placebo arms), as high as 50% (refs. , ).”

Introduction ¶3Find in source

“We hypothesized that an extended-release tablet formulation of ketamine could be an effective and well-tolerated treatment option for patients with TRD.”

Introduction ¶2Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale for the study hypothesis.

Evidence

paraphrase[Introduction, paragraph 1]

Introduction ¶3Find in source

“We hypothesized that an extended-release tablet formulation of ketamine could be an effective and well-tolerated treatment option for patients with TRD.”

Introduction ¶2Find in source

Randomization was by an automated integrated web response system, and blinding was described for patients and all personnel. A power analysis was provided with effect size, alpha, and power. Inclusion/exclusion criteria were pre-specified. The enrichment design and double-blind phase are well described. Outlier handling is addressed via the pre-specified analysis population and imputation method.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

“Randomization was by an automated integrated web response system.”

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Extended-release ketamine tablets for treatment-resistant depression: a randomized placebo-controlled phase 2 trial.

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting