Rigor Reviewed

Rigor-Reviewed Manuscript

The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.

Name: Αlpha¹ Rigor Record — The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.
Item: The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.
Rating: 59
Author: Αlpha¹

Bryant JA, Vulić M, Walsh EA, Allen EG Jr, Beauchemin NJ, Chafee ME, Diao L, Fenn K, Ford KA, Hasson BR, Litcofsky KD, Lombardo MJ, Martinez A, O'Brien EJ, Straub TJ, Sykes SM, Marshall LF, Winkler JA, McGovern BH, Ford CB, Wortman JR, Henn MR

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.5★ (Weak), 0 critical, 3 high issues for “The impact of an oral purified microbiome therapeutic on the gastrointestinal microbiome.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.5 / 5

Weak — serious problems found

Observational Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
StatisticsPrinted percentage does not match its own count (capped)−0.25★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Problems surfaced7 types

Numerical inconsistencies3

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions2

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions only partially backed by the presented evidenceAssessed

Data authenticity concerns1

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a rigorous post hoc analysis of a phase 3 randomized trial, with strong scientific premise, design, ethics, and reporting. The main weaknesses are incomplete data/code availability (no repository deposit or accession numbers) and some statistical reporting gaps (threshold p-values, unverified assumptions). Minor copyedit issues and a potential internal inconsistency in patient numbers should be addressed.

Both reviewers classified the study as observational (post hoc analysis of an RCT). The statistics verification covered only 3 tests, of which 2 were inconsistent but not decision errors; this is not sufficient to declare the statistics unsound. The citation check found no retracted or non-existent references. The integrity check flagged a potential internal contradiction in patient numbers and retrospective registration of one trial.

9 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit.

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks. 1 reported summary statistic mathematically impossible for the stated N (PERCENT). 1 printed percentage that does not match its own count.

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites prior research on bile acid and fatty acid mechanisms, the phase 1b/2/3 trials, and the hypothesis of suboptimal dosing. The rationale for the post hoc analysis is clearly linked to the discordant phase 2 results and the need to understand VOS pharmacology. Limitations of prior work (e.g., phase 2 failure) are addressed by the higher dose in phase 3.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior work on CDI, microbiome mechanisms, and the VOS development program, and links this to the study's objectives.

Evidence

direct quote[Introduction, paragraphs 1-3]

“Microbe-mediated conversion of conjugated primary bile acids to secondary bile acids is inhibitory to C. difficile spore germination and growth”