Rigor Reviewed

Rigor-Reviewed Manuscript

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Name: Αlpha¹ Rigor Record — Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.
Item: Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.
Rating: 59
Author: Αlpha¹

Ogbogu PU, Roufosse F, Akuthota P, Kuna P, Groh M, Reiter A, Yokota A, Siddiqui SH, Mutsaers PGNJ, Li B, Khoury P, Bahadori LM, Bednarczyk A, Bouma G, Brooks LG, Ferreira J, Grindebacke H, Ho CN, Jain P, Palmer RL, Jison ML, Klion AD, NATRON study group

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.25★ (Weak), 0 critical, 4 high issues for “Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 10, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsOverstated claim−0.5★
ReportingKey resources partially met−0.25★
ReportingStatistical analysis partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.29.0Source: full text

Not verified in this report

References were found (29) but none could be checked — every lookup failed or lacked a DOI.

Problems surfaced7 types

Numerical inconsistencies2

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions2

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

Reporting gaps2

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Statistical reporting gaps (tests, assumptions, effect sizes)Assessed
Key resources under-identified (antibodies, cell lines, RRIDs)Assessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a methodologically strong, well-designed, prospectively registered phase 3 RCT with thorough ethics reporting, transparent data-availability routes, and a headline result (HR 0.35, p=0.0024) that survives the checks performed. Its weaknesses are reporting-quality issues rather than validity threats: missing SAS version, unverified model assumptions, two minor internal inconsistencies (placebo completion percentage and Table 1 race denominators), a slightly overbroad adolescent safety claim, and several truncated cross-references.

Two independent evaluator runs of the same model scored all eight dimensions; the only pass/warn split (statistical analysis) was resolved via checklist-level scoring and corroborating verification components. Citation audit: 29 references checked, 0 retracted, 0 not-found. Statistics audit: 12 tests recomputed, 11 consistent, 1 minor inconsistency (completion percentage), 0 decision errors; tests without full statistics (threshold-only p-values, resampling/exact p-values) were not machine-verified. Reproducibility audit: 6/7 links live, 1 dead. Claim audit: 1 overstated claim (adolescent safety). Copyedit: 11 minor issues.

11 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

Recomputed 11 tests: 11 consistent, 0 inconsistent; 2 recomputed directly from the reported test statistics, 9 via agent-written checks. 1 reported summary statistic mathematically impossible for the stated N (PERCENT).

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions6 pass · 2 warn

The introduction discusses the limitations of current treatments for HES and the potential of benralizumab based on its mechanism and prior phase 2 data. It cites key studies on mepolizumab and benralizumab, and clearly links the premise to the study objectives.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper establishes a clear scientific foundation by citing prior research on HES and benralizumab, providing a logical rationale for the study, and addressing limitations of existing therapies.

Evidence

paraphrase[Introduction, paragraphs 3-6]

“Treatment options for patients with imatinib-insensitive HES, including those with lymphocytic HES... or idiopathic HES... are limited.”

paraphrase[Introduction, paragraph 5]

“The central role of eosinophilic inflammation and eosinophil-mediated end organ damage in the pathophysiology of HES, as well as the efficacy of IL-5 inhibition with mepolizumab, suggests that a more direct eosinophil-depleting approach may also be beneficial.”

paraphrase[Introduction, paragraph 6]

“In a phase 2 study of patients with symptomatic, treatment-refractory FIP1L1::PDGFRA -negative HES, 90% of patients achieved a ≥50% reduction in absolute eosinophil counts (AECs) from baseline to week 12...”

PASSReviewer 2· 90% conf

The introduction establishes a clear scientific foundation, citing the mepolizumab trials and benralizumab phase 2 data, acknowledges residual gaps, and the hypothesis follows directly from the cited evidence.

Evidence

paraphrase[Introduction, paragraph 3]

“Results from two clinical trials demonstrated that mepolizumab, a monoclonal antibody that inhibits eosinophil activation and differentiation by binding interleukin (IL)-5, reduced disease flares compared to placebo and had corticosteroid-sparing effects in patients with uncontrolled FIP1L1::PDGFRA-negative HES.”

paraphrase[Introduction, paragraph 4]

paraphrase[Introduction, paragraph 3]

“Some patients do not achieve a clinical response, or respond only partially to mepolizumab, highlighting the need for alternative therapies.”

Randomization is central and computer-generated with permuted block design, stratified by region and flare status. Double-blind design is described with explicit unblinding exceptions. A power analysis is provided. Inclusion and exclusion criteria are detailed. The primary analysis uses the full analysis set (ITT).

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and inclusion/exclusion criteria. The analysis follows intention-to-treat principles.

Evidence

direct quote[Methods, Randomization and masking section]

“All patients were centrally assigned to a randomized study treatment using Interactive Web Response Systems (IWRS)/Interactive Voice Response Systems (IVRS).”