Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Name: Kaimen Rigor review — The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.
Item: The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.
Rating: 59
Author: Alpha1

Bryant JA, Vulić M, Walsh EA, Allen EG Jr, Beauchemin NJ, Chafee ME, Diao L, Fenn K, Ford KA, Hasson BR, Litcofsky KD, Lombardo MJ, Martinez A, O'Brien EJ, Straub TJ, Sykes SM, Marshall LF, Winkler JA, McGovern BH, Ford CB, Wortman JR, Henn MR

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.5★ (Weak), 0 critical, 3 high issues for “The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Read full text (PMC)

DOI

10.1038/s41591-025-04076-w

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/bc1e0967-cfa8-43be-a3f8-9ba307302ede" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/bc1e0967-cfa8-43be-a3f8-9ba307302ede/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 3 high issues for “The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

ae97ee1ff0f00b9d88cd799b05437a664012231151524f3389fcd9cf6d5a0a74

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Paper source

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Observational Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
StatisticsPrinted percentage does not match its own count (capped)−0.25★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Printed percentage does not match its own count
highArithmeticrecomputedFull detail
66.7% is unattainable for n=28 (nearest: 64.3, 67.9%)
“66.7% female”
ResultsFind in source
02Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is prevention of recurrent CDI, a hard clinical outcome, but the paper's main analyses focus on surrogate biomarkers (microbiome composition, engraftment, bile acids, fatty acids) as evidence of efficacy. While the phase 3 trial reported a hard clinical endpoint (recurrence), this manuscript's post hoc analyses use these surrogates to support the mechanism and efficacy. The paper does not establish a validated link between these surrogates and the clinical outcome beyond citing the phase 3 result, and target engagement is shown via engraftment but not linked to a validated surrogate-to-clinical-outcome relationship.
“In-depth phase 3 analyses revealed that VOS significantly altered microbial composition, significantly enriching the diversity and abundance of Firmicutes species and reducing the prevalence and abundance of C. difficile and opportunistic pathogens...…”
Find in source
03Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
67.4% is unattainable for n=79 (nearest: 67.1, 68.4%)
“67.4% female”
ResultsFind in source
04Other integrity concern
mediumAuthenticityreviewer-assessedFull detail
Trial NCT02437487 was first submitted to ClinicalTrials.gov on 2015-05-05, after the registered study start date of 2015-05. Retrospective registration means the protocol and outcomes were not on the public record before the study ran, which is what prospective registration exists to establish.
NCT02437487
reviewer’s wording

Findings by category

301ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a rigorous post hoc analysis of a phase 3 randomized trial, with strong scientific premise, design, ethics, and reporting. The main weaknesses are incomplete data/code availability (no repository deposit or accession numbers) and some statistical reporting gaps (threshold p-values, unverified assumptions). Minor copyedit issues and a potential internal inconsistency in patient numbers should be addressed.

Both reviewers classified the study as observational (post hoc analysis of an RCT). The statistics verification covered only 3 tests, of which 2 were inconsistent but not decision errors; this is not sufficient to declare the statistics unsound. The citation check found no retracted or non-existent references. The integrity check flagged a potential internal contradiction in patient numbers and retrospective registration of one trial.

Numerical inconsistencies

3 findings · worst high

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks. 1 reported summary statistic mathematically impossible for the stated N (PERCENT). 1 printed percentage that does not match its own count.

Overstated conclusions

2 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit.

Data authenticity concerns

1 finding · worst medium

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

2 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior research on bile acid and fatty acid mechanisms, the phase 1b/2/3 trials, and the hypothesis of suboptimal dosing. The rationale for the post hoc analysis is clearly linked to the discordant phase 2 results and the need to understand VOS pharmacology. Limitations of prior work (e.g., phase 2 failure) are addressed by the higher dose in phase 3.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior work on CDI, microbiome mechanisms, and the VOS development program, and links this to the study's objectives.

Evidence

“Microbe-mediated conversion of conjugated primary bile acids to secondary bile acids is inhibitory to C. difficile spore germination and growth”

Introduction ¶1Find in source

“A follow-up pharmacological assessment led to the hypothesis that these markedly discordant results were due to differences in VOS dosing titer and frequency”

Introduction ¶3Find in source

“An approximately 10-fold higher dose was given over 3 days in the phase 3 trial”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale linking dosing to engraftment and clinical outcomes.

Evidence

“Microbe-mediated conversion of conjugated primary bile acids to secondary bile acids is inhibitory to C. difficile spore germination and growth”

Introduction ¶1Find in source

“we compared the pharmacokinetics of the phase 3 trial to the phase 1b and phase 2 trials to address the hypothesis that different dosing regimens across the VOS clinical development program led to different clinical results.”

IntroductionFind in source

“These discordant outcomes were hypothesized to be due to suboptimal dosing.”

Introduction ¶4Find in source

The phase 3 trial was randomized, double-blind, and placebo-controlled, with randomization stratified by age and antibiotic. Blinding of patients, site staff, and sponsor is stated. The primary and preplanned exploratory endpoints are defined. However, the randomization method (e.g., computer-generated) is not described, and the power analysis is not reported in this paper (likely in the primary publication). Inclusion/exclusion criteria are described. Outlier handling is not explicitly discussed, but sample exclusions are detailed.

Sub-criteria

controlsADEQUATE

power analysisNOT REPORTED

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodINADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The study design is rigorous for a post hoc analysis of a randomized trial, with clear randomization, blinding, and pre-specified analyses, though some elements are not fully reported.

Evidence

“Patients were randomly assigned 1:1 to VOS (approximately 3 × 10 7 spore colony-forming units) or matching placebo administered as four oral capsules once daily over three consecutive days . All patients, site staff and the sponsor were blinded to treatment assignment.”

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting