Rigor Reviewed

Rigor-Reviewed Manuscript

A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial.

Name: Αlpha¹ Rigor Record — A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial.
Item: A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial.
Rating: 59
Author: Αlpha¹

Xu Z, Ren F, Wang P, Cao J, Tan C, Ma D, Zhao L, Dai J, Ding Y, Fang H, Li H, Liu H, Luo F, Meng Y, Pan P, Xiang P, Xiao Z, Rao S, Satler C, Liu S, Lv Y, Zhao H, Chen S, Cui H, Korzinkin M, Gennert D, Zhavoronkov A

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 1.75★ (Critical), 0 critical, 6 high issues for “A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

1.75 / 5

Critical — serious problems across many checks

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
StatisticsStatistic did not reproduce−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped) ×6−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Problems surfaced7 types

Numerical inconsistencies3

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Data authenticity concerns1

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 2a randomized controlled trial with strong scientific premise, rigorous design, and transparent reporting. The main weaknesses are the lack of a formal efficacy power calculation, some threshold-based p-value reporting, and minor internal inconsistencies in the safety results.

Both reviewers classified the study as interventional, and I adopted that classification. The evaluation covered the full text, with all eight dimensions scored. Non-applicable sub-criteria (e.g., animal housing, cell line authentication) were excluded. The statistics verification component could only recompute a subset of tests; 7 of 8 were inconsistent, but the coverage note limits interpretation, and no specific errors were identified.

5 major claims checked against the paper's own evidence: 3 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks. 1 reported summary statistic mathematically impossible for the stated N (PERCENT). 6 printed percentages that do not match their own count.

3 integrity concerns flagged (0 high).

Reporting

Eight Dimensions8 pass

The introduction extensively cites prior research on AI in drug discovery, TNIK's role in IPF, and the limitations of current therapies. It explicitly acknowledges the high failure rate of AI-discovered drugs in phase 2 trials and the lack of phase 3 successes, framing the study as addressing this gap. The rationale for targeting TNIK and testing rentosertib is logically derived from prior evidence, and the study aims to address the limitation of prior work by conducting a randomized controlled trial.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a strong scientific premise by citing prior work on AI-driven drug discovery, TNIK as a target, and the unmet need in IPF, with a clear rationale linking these to the study objectives.

Evidence

paraphrase[Main, paragraph 2]

“AI-discovered drugs have experienced similar levels of phase 2 trial failure as non-AI-discovered drugs, and none has so far progressed through phase 3 trials.”

paraphrase[Main, paragraph 3]

“our group used generative AI-driven discovery tools, to identify Traf2- and Nck-interacting kinase (TNIK) de novo as a critical regulator of idiopathic pulmonary fibrosis (IPF) pathology”

direct quote[Main, paragraph 5]

“Here, we present the results of a phase 2a multicenter, double-blind, randomized, placebo-controlled trial to assess the safety, tolerability, PK and impact on FVC of rentosertib”