Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Name: Kaimen Rigor review — Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.
Item: Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.
Rating: 59
Author: Alpha1

Ogbogu PU, Roufosse F, Akuthota P, Kuna P, Groh M, Reiter A, Yokota A, Siddiqui SH, Mutsaers PGNJ, Li B, Khoury P, Bahadori LM, Bednarczyk A, Bouma G, Brooks LG, Ferreira J, Grindebacke H, Ho CN, Jain P, Palmer RL, Jison ML, Klion AD, NATRON study group

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.25★ (Weak), 0 critical, 4 high issues for “Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 10, 2026

Read alongside

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Read full text (PMC)

DOI

10.1038/s41591-026-04315-8

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/53ad7c8c-0543-4158-a417-3ccca3f97977" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/53ad7c8c-0543-4158-a417-3ccca3f97977/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 4 high issues for “Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d7d4a91bf467379b1646c7639a8b81040fc8a5e03f358a6b01787fd621cd79f1

Verify via API

Issued Aug 10, 2026Engine 7.29.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Paper source

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 10, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsOverstated claim−0.5★
ReportingKey resources partially met−0.25★
ReportingStatistical analysis partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.29.0Source: full text

Not verified in this report

References were found (29) but none could be checked — every lookup failed or lacked a DOI.

Biggest issues

01Printed percentage does not match its own count
highArithmeticrecomputedFull detail
92.5% does not match the reported count 62/66
“92.5% (62/66)”
92.5% (62/66) of placebo-treated patien…Find in source
02Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
The safety of benralizumab was consistent with its known profile, including in adolescents.
“Safety and tolerability results were consistent with the known safety profile for benralizumab, including in adolescents.”
Discussion ¶2Find in source
03Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“https://vivli.org/members/enquiries-about-studies-not-listed-on-the-vivli-platform/”
Find in source

Findings by category

201ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 204DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit11 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a methodologically strong, well-designed, prospectively registered phase 3 RCT with thorough ethics reporting, transparent data-availability routes, and a headline result (HR 0.35, p=0.0024) that survives the checks performed. Its weaknesses are reporting-quality issues rather than validity threats: missing SAS version, unverified model assumptions, two minor internal inconsistencies (placebo completion percentage and Table 1 race denominators), a slightly overbroad adolescent safety claim, and several truncated cross-references.

Two independent evaluator runs of the same model scored all eight dimensions; the only pass/warn split (statistical analysis) was resolved via checklist-level scoring and corroborating verification components. Citation audit: 29 references checked, 0 retracted, 0 not-found. Statistics audit: 12 tests recomputed, 11 consistent, 1 minor inconsistency (completion percentage), 0 decision errors; tests without full statistics (threshold-only p-values, resampling/exact p-values) were not machine-verified. Reproducibility audit: 6/7 links live, 1 dead. Claim audit: 1 overstated claim (adolescent safety). Copyedit: 11 minor issues.

Numerical inconsistencies

2 findings · worst high

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Internal contradictions in the reported numbersAssessed

Recomputed 11 tests: 11 consistent, 0 inconsistent; 2 recomputed directly from the reported test statistics, 9 via agent-written checks. 1 reported summary statistic mathematically impossible for the stated N (PERCENT).

Overstated conclusions

2 findings · worst medium

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

11 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

2 findings · worst high

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Statistical reporting gaps (tests, assumptions, effect sizes)Assessed
Key resources under-identified (antibodies, cell lines, RRIDs)Assessed

Eight Dimensions6 pass · 2 warn

The introduction discusses the limitations of current treatments for HES and the potential of benralizumab based on its mechanism and prior phase 2 data. It cites key studies on mepolizumab and benralizumab, and clearly links the premise to the study objectives.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper establishes a clear scientific foundation by citing prior research on HES and benralizumab, providing a logical rationale for the study, and addressing limitations of existing therapies.

Evidence

paraphrase[Introduction, paragraphs 3-6]

“Treatment options for patients with imatinib-insensitive HES, including those with lymphocytic HES... or idiopathic HES... are limited.”

paraphrase[Introduction, paragraph 5]

“The central role of eosinophilic inflammation and eosinophil-mediated end organ damage in the pathophysiology of HES, as well as the efficacy of IL-5 inhibition with mepolizumab, suggests that a more direct eosinophil-depleting approach may also be beneficial.”

paraphrase[Introduction, paragraph 6]

“In a phase 2 study of patients with symptomatic, treatment-refractory FIP1L1::PDGFRA -negative HES, 90% of patients achieved a ≥50% reduction in absolute eosinophil counts (AECs) from baseline to week 12...”

PASSReviewer 2· 90% conf

The introduction establishes a clear scientific foundation, citing the mepolizumab trials and benralizumab phase 2 data, acknowledges residual gaps, and the hypothesis follows directly from the cited evidence.

Evidence

paraphrase[Introduction, paragraph 3]

“Results from two clinical trials demonstrated that mepolizumab, a monoclonal antibody that inhibits eosinophil activation and differentiation by binding interleukin (IL)-5, reduced disease flares compared to placebo and had corticosteroid-sparing effects in patients with uncontrolled FIP1L1::PDGFRA-negative HES.”

paraphrase[Introduction, paragraph 4]

paraphrase[Introduction, paragraph 3]

“Some patients do not achieve a clinical response, or respond only partially to mepolizumab, highlighting the need for alternative therapies.”

Randomization is central and computer-generated with permuted block design, stratified by region and flare status. Double-blind design is described with explicit unblinding exceptions. A power analysis is provided. Inclusion and exclusion criteria are detailed. The primary analysis uses the full analysis set (ITT).

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and inclusion/exclusion criteria. The analysis follows intention-to-treat principles.

Evidence

“All patients were centrally assigned to a randomized study treatment using Interactive Web Response Systems (IWRS)/Interactive Voice Response Systems (IVRS).”

MethodsFind in source

paraphrase[Methods, Randomization and masking section]

“Patients, sponsor, site staff and investigators were blinded to treatment allocation and to patients’ blood and biopsy leukocyte counts during the double-blind treatment period...”

paraphrase[Methods, Statistical analysis section]

“It was estimated that approximately 38 first HES flare events during the double-blind period were required to detect a statistically significant difference between treatment groups at the two-sided 5% significance level with approximately 80% power if the true treatment effect is an HR of 0.389...”

PASSReviewer 2· 95% conf

Well-designed, adequately powered double-blind RCT with fully described randomization, masking, sample-size calculation, and eligibility criteria.

Evidence

“The randomization sequence was computer-generated centrally using a permuted block design with a fixed block size of 4 and stratified by geographic region (North America, Europe, Asia and rest of the world) and HES flare status at screening.”

MethodsFind in source

paraphrase[Methods, Randomization and masking]

“Patients, sponsor, site staff and investigators were blinded to treatment allocation and to patients' blood and biopsy leukocyte counts during the double-blind treatment period and up to week 4 of the OLE.”

Statistical analysisFind in source

Table 1 and the Results report sex (61.7% female), age (median 51.0 years, range 14–87, including 4 adolescents), race, region, HES subtype, organ involvement, and background therapy. Health status is characterized in depth via AEC, prior flares, OCS dose, and organ systems. Weight is not reported, which is not material for this patient-level trial; both sexes enrolled, so sex_justified is not applicable.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Sex and demographics are adequately reported, but weight is not reported and health status is only partially captured. This meets the threshold for pass.

Evidence

paraphrase[Table 1]

“Female: 43 (64.2%) [benralizumab], 39 (59.1%) [placebo]”

paraphrase[Table 1]

“Median (range) age: 49.0 (14.0–87.0) [benralizumab], 53.5 (16.0–83.0) [placebo]”

absence[Table 1 and Methods]

Weight is not reported.

PASSReviewer 2· 90% conf

Sex, age, health status and detailed demographics are reported in baseline tables; both sexes were enrolled, so a single-sex justification is not applicable.

Evidence

“Overall, 62% (82/133) of patients were female, 38% (51/133) were male and the median (range) age was 51.0 (14.0–87.0) years.”

ResultsFind in source

“White | 42 (72.4%) | 45 (78.9%) | 87 (75.7%)”

Table 1Find in source

“The median (range) time since diagnosis was 1.9 (0.1–32.3) years, and patients had experienced a median (range) of 2 (0–12) HES flares in the 12 months before enrollment.”

ResultsFind in source

The paper states that the protocol was reviewed and approved by Independent Ethics Committees/Institutional Review Boards (listed in supplementary). All patients provided written informed consent. Compliance with Declaration of Helsinki and ICH-GCP is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are adequately reported, including IRB approval, written informed consent, and compliance with regulatory guidelines.

Evidence

paraphrase[Methods, Study design section]

“The protocol, protocol amendments and any other relevant documents were reviewed and approved by the Independent Ethics Committees/Institutional Review Boards listed in the [Supplementary Information].”

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design section]

“The trial was conducted in accordance with the ethical principles of the Declaration of Helsinki and is consistent with the International Council for Harmonisation Good Clinical Practice guidelines...”

PASSReviewer 2· 95% conf

Ethics approval by IEC/IRBs, written informed consent, and Declaration of Helsinki/ICH-GCP compliance are all explicitly stated.

Evidence

“The protocol, protocol amendments and any other relevant documents were reviewed and approved by the Independent Ethics Committees/Institutional Review Boards listed in the .”

MethodsFind in source

“All patients provided written informed consent.”

MethodsFind in source

Benralizumab is identified as a 30 mg dose via accessorized prefilled syringe, with manufacturer (AstraZeneca) and regimen. This is adequate. However, the statistical software (SAS System) is mentioned without a version number, which is reported but inadequate.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

The investigational product (benralizumab) is adequately identified, but the statistical software version is not reported, leading to a warn.

Evidence

paraphrase[Methods, Procedures section]

“Patients were randomly assigned 1:1 into the 24-week double-blind period where they received benralizumab 30 mg (accessorized prefilled syringe) subcutaneously every 4 weeks or a matching placebo...”

“All data analyses were performed with SAS System (SAS Institute Inc.) software.”

Statistical analysisFind in source

WARNReviewer 2· 80% conf

The investigational product is well identified, but analysis software lacks a version number and the PK/immunogenicity assays are referenced rather than specified.

Evidence

“benralizumab 30 mg (accessorized prefilled syringe) subcutaneously every 4 weeks or a matching placebo”

MethodsFind in source

“All data analyses were performed with SAS System (SAS Institute Inc.) software.”

Statistical analysisFind in source

“PK was assessed through benralizumab serum concentrations and immunogenicity assessed through ADA assays and neutralizing antibody testing, as previously described”

MethodsFind in source

All statistical tests are named (log-rank, Cox, logistic, negative binomial, MMRM). Exact p-values and CIs are reported. However, assumptions such as proportional hazards for Cox are not discussed. The SAS version is not given. The race percentages in Table 1 are based on a subset of patients, but the denominator is not indicated, which is a minor plausibility issue.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedINADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityWARN

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 85% conf

Statistical tests are named and effect sizes with CIs are reported, but assumptions are not verified, software version is missing, and mathematical plausibility has a minor issue (race denominators).

Evidence

“Time-to-event endpoints were analyzed using a stratified log-rank test, adjusted for region. HRs and 95% CIs were estimated using a Cox proportional hazards model with treatment group and region as covariates.”

Statistical analysisFind in source

paraphrase[Results, Table 2]

“HR 0.35 (0.18 to 0.69) P = 0.0024”

paraphrase[Table 1]

“White: 42 (72.4%) [benralizumab, n=67]”

PASSReviewer 2· 85% conf

Statistical methods are fully pre-specified, all tests are named, exact p-values and 95% CIs are reported; one minor completion-percentage arithmetic slip is noted.

Evidence

“Time to first HES flare, n events (%) | 13 (19.4%) | 28 (42.4%) | HR 0.35 (0.18 to 0.69) a | 0.0024”

Table 2Find in source

Statistical analysisFind in source

“In total, 97% (65/67) of benralizumab-treated patients and 92.5% (62/66) of placebo-treated patients completed the 24-week double-blind period”

ResultsFind in source

The data availability statement provides two concrete routes: through AstraZeneca's data sharing policy (with URL) and through Vivli (with URL). This meets the standard for managed access. No sequence data warrants accession numbers, and no custom code was written, so those are not applicable.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is adequately stated with concrete access routes via Vivli and AstraZeneca's platform. No custom code was developed, so code sharing is not applicable.

Evidence

“Data underlying the findings described in this Article can be requested in accordance with AstraZeneca’s data sharing policy available via AstraZeneca at https://astrazenecagrouptrials.pharmacm.com/ST/Submission/Disclosure . Data for studies directly listed on Vivli are available via Vivli at https://www.vivli.org .”

Data availabilityFind in source

PASSReviewer 2· 90% conf

A concrete managed-access data route (AstraZeneca data-sharing policy and Vivli platform) is stated; protocol and trial registration are publicly linked; raw-data deposit and code sharing are not applicable for this IPD trial.

Evidence

paraphrase[Data availability]

“Data underlying the findings described in this Article can be requested in accordance with AstraZeneca's data sharing policy available via AstraZeneca at https://astrazenecagrouptrials.pharmacm.com/ST/Submission/Disclosure”

“Data for studies directly listed on Vivli are available via Vivli at https://www.vivli.org”

Data availabilityFind in source

“The full protocol is publicly available at https://www.astrazenecaclinicaltrials.com/study/D3254C00001/”

MethodsFind in source

All applicable sub-criteria are adequately addressed: methods are comprehensive, trial registration is provided, a reporting summary is linked, all outcomes (including non-significant) are reported, limitations are discussed, conclusions are proportional, and funding and conflicts of interest are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The manuscript is transparent in reporting, with a clinical trial registration, detailed methods, outcome reporting, limitations discussion, and funding/COI statements.

Evidence

“ClinicalTrials.gov identifier: NCT04191304”

AbstractFind in source

paraphrase[Discussion, paragraph 5]

“First, the sample size was small owing to the rarity of the disease. Unfortunately, this limited the ability to draw conclusions on efficacy on the basis of subgroups...”

“The study is sponsored and funded by AstraZeneca (Södertälje, Sweden).”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

Comprehensive reporting: trial registration, funding/COI, explicit limitations, and proportional conclusions; a reporting summary checklist is linked.

Evidence

“This trial is registered with ClinicalTrials.gov ( NCT04191304 (https://clinicaltrials.gov/ct2/show/NCT04191304) )”

MethodsFind in source

“First, the sample size was small owing to the rarity of the disease.”

Discussion ¶5Find in source

“The study is sponsored and funded by AstraZeneca (Södertälje, Sweden).”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 29 references by DOI: 0 verified — 29 no DOI (shown, not verified).

7 data/code links checked; 6 live, 1 dead.

Copyediting

11 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 11 minor suggestions below.

11 copyedit issues flagged: mostly clarity, typo, consistency.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published findings are robust overall: the design, registration, and transparency are strong, and the primary result is supported by the recomputed statistics (11/12 consistent). An informed reader should weigh the minor internal inconsistencies (92.5% vs 93.9% completion; Table 1 race denominators), the unverified model assumptions and missing SAS version, one dead external link, and the overstated adolescent safety claim; none of these currently undermines the primary conclusion, but a corrigendum correcting the percentage and repairing the truncated cross-references would be appropriate.

1.
HIGHstatistics
Correct the placebo completion percentage in Results/Patient disposition: 62/66 = 93.9%, not 92.5%, and reconcile the text with the Figure 1 flow counts.
A verifiable internal inconsistency in the Results is the single inconsistency found in the statistics audit and will be caught by an informed reader.
2.
HIGHrigor
Temper the Discussion claim that benralizumab safety was consistent with its known profile 'including in adolescents': only 4 adolescents (3 benralizumab) were enrolled, so either report their safety outcomes explicitly or qualify the claim.
The claim audit rated this statement as overstated because an n of 4 cannot support an adolescent-specific safety generalization.
3.
HIGHcopyedit
Repair the truncated cross-references ('please refer to the for further details', 'described in the .', 'linked to this article') in Methods (Outcomes, Statistical analysis, Study design), Results (Safety), and the Reporting summary by naming the target (Supplementary Methods/Information, Reporting Summary).
Dead cross-references make methods, ethics listings, and reporting checklists unauditable; they were flagged by both the copyedit pass and Reviewer 2.
4.
HIGHdata code
Identify and fix the single dead external link among the 7 checked (protocol/registration/data pages) and re-verify the remaining links resolve.
A broken link undercuts the data-availability and protocol-access statements that reviewers will follow.
5.
MEDIUMstatistics
Add an explicit statement in Methods/Statistical analysis on checking model assumptions (e.g., proportional hazards for Cox models, residual checks for MMRM), or cite where these were assessed and satisfied.
Reviewer 1 flagged assumptions as unverified; Reviewer 2 accepted them without evidence, so making the assessment explicit removes ambiguity.
6.
MEDIUMstatistics
Add the SAS version (e.g., 'SAS 9.4') to the 'All data analyses were performed with SAS System (SAS Institute Inc.) software' sentence in Methods/Statistical analysis.
Software without a version lowers both the key-resources and statistical-analysis ratings and impedes reproducibility.
7.
MEDIUMreporting
Specify the PK, ADA, and neutralizing-antibody assay platforms, vendors, and validation/performance data in Methods/Outcomes instead of 'as previously described'.
Immunogenicity and PK methods need to be self-contained for the trial to be auditable.
8.
MEDIUMreporting
Add a Table 1 footnote stating the denominators for race percentages (e.g., n=58 for benralizumab, n=57 for placebo) and noting missing race data.
Percentages that do not sum to the group N are an internal-consistency issue flagged by both reviewers and the integrity check.
9.
MEDIUMethics
Cite the IEC/IRB names and approval identifiers in the main text (or explicitly reference supplementary listing entries) and repair the truncated 'listed in the .' sentence in Methods/Study design.
Ethics approval must be auditable without relying on a broken cross-reference to the supplement.
10.
MEDIUMreporting
Name the reporting guideline (e.g., CONSORT 2010) with item-level compliance in addition to the linked Nature Portfolio reporting summary.
Explicitly naming the guideline makes the reporting-checklist mechanism clear to readers and reviewers.
11.
MEDIUMdata code
Add a dataset identifier (e.g., a Vivli study-page DOI) to the data-availability statement and note that no custom code was used (SAS analyses), so code sharing is not applicable.
A specific identifier strengthens the managed-access route and preempts ambiguity about code availability.
12.
LOWcopyedit
Fix the typos 'avialable' → 'available' in the Data Availability statement and 'Universtié' → 'Université' in the author affiliations.
These are minor copyedit issues flagged by the copyedit pass.
13.
LOWreporting
Report weight or BMI as a baseline characteristic in Table 1, or note its omission in the Limitations.
Weight was the only biological-variable gap noted by Reviewer 1 and would complete the biological-variables reporting.

Full text (61,221 chars)Analyzed: Aug 10, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.

Read full text (PMC)

DOI

10.1038/s41591-026-04315-8

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/53ad7c8c-0543-4158-a417-3ccca3f97977" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/53ad7c8c-0543-4158-a417-3ccca3f97977/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 4 high issues for “Benralizumab versus placebo for hypereosinophilic syndrome: a randomized, placebo-controlled phase 3 trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d7d4a91bf467379b1646c7639a8b81040fc8a5e03f358a6b01787fd621cd79f1

Verify via API

Issued Aug 10, 2026Engine 7.29.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
StatisticsStatistic did not reproduce−0.5★
ClaimsOverstated claim−0.5★
ReportingKey resources partially met−0.25★
ReportingStatistical analysis partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.29.0Source: full text

Not verified in this report

References were found (29) but none could be checked — every lookup failed or lacked a DOI.

Biggest issues

01Printed percentage does not match its own count
highArithmeticrecomputedFull detail
92.5% does not match the reported count 62/66
“92.5% (62/66)”
92.5% (62/66) of placebo-treated patien…Find in source
02Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
The safety of benralizumab was consistent with its known profile, including in adolescents.
“Safety and tolerability results were consistent with the known safety profile for benralizumab, including in adolescents.”
Discussion ¶2Find in source
03Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“https://vivli.org/members/enquiries-about-studies-not-listed-on-the-vivli-platform/”
Find in source

Findings by category

Numerical inconsistencies

2 findings · worst high

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions

2 findings · worst medium

Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

11 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

2 findings · worst high

Statistical reporting gaps (tests, assumptions, effect sizes)Assessed
Key resources under-identified (antibodies, cell lines, RRIDs)Assessed

Eight Dimensions6 pass · 2 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper establishes a clear scientific foundation by citing prior research on HES and benralizumab, providing a logical rationale for the study, and addressing limitations of existing therapies.

Evidence

paraphrase[Introduction, paragraphs 3-6]

“Treatment options for patients with imatinib-insensitive HES, including those with lymphocytic HES... or idiopathic HES... are limited.”

paraphrase[Introduction, paragraph 5]

paraphrase[Introduction, paragraph 6]

PASSReviewer 2· 90% conf

Evidence

paraphrase[Introduction, paragraph 3]

paraphrase[Introduction, paragraph 4]

paraphrase[Introduction, paragraph 3]

“Some patients do not achieve a clinical response, or respond only partially to mepolizumab, highlighting the need for alternative therapies.”

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and inclusion/exclusion criteria. The analysis follows intention-to-treat principles.

Evidence

“All patients were centrally assigned to a randomized study treatment using Interactive Web Response Systems (IWRS)/Interactive Voice Response Systems (IVRS).”

MethodsFind in source

paraphrase[Methods, Randomization and masking section]

“Patients, sponsor, site staff and investigators were blinded to treatment allocation and to patients’ blood and biopsy leukocyte counts during the double-blind treatment period...”

paraphrase[Methods, Statistical analysis section]

PASSReviewer 2· 95% conf

Well-designed, adequately powered double-blind RCT with fully described randomization, masking, sample-size calculation, and eligibility criteria.

Evidence

MethodsFind in source

paraphrase[Methods, Randomization and masking]

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Sex and demographics are adequately reported, but weight is not reported and health status is only partially captured. This meets the threshold for pass.

Evidence

paraphrase[Table 1]

“Female: 43 (64.2%) [benralizumab], 39 (59.1%) [placebo]”

paraphrase[Table 1]

“Median (range) age: 49.0 (14.0–87.0) [benralizumab], 53.5 (16.0–83.0) [placebo]”

absence[Table 1 and Methods]

Weight is not reported.

PASSReviewer 2· 90% conf

Sex, age, health status and detailed demographics are reported in baseline tables; both sexes were enrolled, so a single-sex justification is not applicable.

Evidence

“Overall, 62% (82/133) of patients were female, 38% (51/133) were male and the median (range) age was 51.0 (14.0–87.0) years.”

ResultsFind in source

“White | 42 (72.4%) | 45 (78.9%) | 87 (75.7%)”

Table 1Find in source

“The median (range) time since diagnosis was 1.9 (0.1–32.3) years, and patients had experienced a median (range) of 2 (0–12) HES flares in the 12 months before enrollment.”

ResultsFind in source

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are adequately reported, including IRB approval, written informed consent, and compliance with regulatory guidelines.

Evidence

paraphrase[Methods, Study design section]

“All patients provided written informed consent.”

MethodsFind in source

paraphrase[Methods, Study design section]

PASSReviewer 2· 95% conf

Ethics approval by IEC/IRBs, written informed consent, and Declaration of Helsinki/ICH-GCP compliance are all explicitly stated.

Evidence

“The protocol, protocol amendments and any other relevant documents were reviewed and approved by the Independent Ethics Committees/Institutional Review Boards listed in the .”

MethodsFind in source

“All patients provided written informed consent.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

The investigational product (benralizumab) is adequately identified, but the statistical software version is not reported, leading to a warn.

Evidence

paraphrase[Methods, Procedures section]

“All data analyses were performed with SAS System (SAS Institute Inc.) software.”

Statistical analysisFind in source

WARNReviewer 2· 80% conf

The investigational product is well identified, but analysis software lacks a version number and the PK/immunogenicity assays are referenced rather than specified.

Evidence

“benralizumab 30 mg (accessorized prefilled syringe) subcutaneously every 4 weeks or a matching placebo”

MethodsFind in source

“All data analyses were performed with SAS System (SAS Institute Inc.) software.”

Statistical analysisFind in source

“PK was assessed through benralizumab serum concentrations and immunogenicity assessed through ADA assays and neutralizing antibody testing, as previously described”

MethodsFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedINADEQUATE

assumptions verifiedINADEQUATE

mathematical plausibilityWARN

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 85% conf

Statistical tests are named and effect sizes with CIs are reported, but assumptions are not verified, software version is missing, and mathematical plausibility has a minor issue (race denominators).

Evidence

Statistical analysisFind in source

paraphrase[Results, Table 2]

“HR 0.35 (0.18 to 0.69) P = 0.0024”

paraphrase[Table 1]

“White: 42 (72.4%) [benralizumab, n=67]”

PASSReviewer 2· 85% conf

Statistical methods are fully pre-specified, all tests are named, exact p-values and 95% CIs are reported; one minor completion-percentage arithmetic slip is noted.

Evidence

“Time to first HES flare, n events (%) | 13 (19.4%) | 28 (42.4%) | HR 0.35 (0.18 to 0.69) a | 0.0024”

Table 2Find in source

Statistical analysisFind in source

“In total, 97% (65/67) of benralizumab-treated patients and 92.5% (62/66) of placebo-treated patients completed the 24-week double-blind period”

ResultsFind in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is adequately stated with concrete access routes via Vivli and AstraZeneca's platform. No custom code was developed, so code sharing is not applicable.

Evidence

Data availabilityFind in source

PASSReviewer 2· 90% conf

Evidence

paraphrase[Data availability]

“Data for studies directly listed on Vivli are available via Vivli at https://www.vivli.org”

Data availabilityFind in source

“The full protocol is publicly available at https://www.astrazenecaclinicaltrials.com/study/D3254C00001/”

MethodsFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The manuscript is transparent in reporting, with a clinical trial registration, detailed methods, outcome reporting, limitations discussion, and funding/COI statements.

Evidence

“ClinicalTrials.gov identifier: NCT04191304”

AbstractFind in source

paraphrase[Discussion, paragraph 5]

“First, the sample size was small owing to the rarity of the disease. Unfortunately, this limited the ability to draw conclusions on efficacy on the basis of subgroups...”

“The study is sponsored and funded by AstraZeneca (Södertälje, Sweden).”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

Comprehensive reporting: trial registration, funding/COI, explicit limitations, and proportional conclusions; a reporting summary checklist is linked.

Evidence

“This trial is registered with ClinicalTrials.gov ( NCT04191304 (https://clinicaltrials.gov/ct2/show/NCT04191304) )”

MethodsFind in source

“First, the sample size was small owing to the rarity of the disease.”

Discussion ¶5Find in source

“The study is sponsored and funded by AstraZeneca (Södertälje, Sweden).”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 29 references by DOI: 0 verified — 29 no DOI (shown, not verified).

7 data/code links checked; 6 live, 1 dead.

Copyediting

11 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 11 minor suggestions below.

11 copyedit issues flagged: mostly clarity, typo, consistency.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHstatistics
Correct the placebo completion percentage in Results/Patient disposition: 62/66 = 93.9%, not 92.5%, and reconcile the text with the Figure 1 flow counts.
A verifiable internal inconsistency in the Results is the single inconsistency found in the statistics audit and will be caught by an informed reader.
2.
HIGHrigor
Temper the Discussion claim that benralizumab safety was consistent with its known profile 'including in adolescents': only 4 adolescents (3 benralizumab) were enrolled, so either report their safety outcomes explicitly or qualify the claim.
The claim audit rated this statement as overstated because an n of 4 cannot support an adolescent-specific safety generalization.
3.
HIGHcopyedit
Repair the truncated cross-references ('please refer to the for further details', 'described in the .', 'linked to this article') in Methods (Outcomes, Statistical analysis, Study design), Results (Safety), and the Reporting summary by naming the target (Supplementary Methods/Information, Reporting Summary).
Dead cross-references make methods, ethics listings, and reporting checklists unauditable; they were flagged by both the copyedit pass and Reviewer 2.
4.
HIGHdata code
Identify and fix the single dead external link among the 7 checked (protocol/registration/data pages) and re-verify the remaining links resolve.
A broken link undercuts the data-availability and protocol-access statements that reviewers will follow.
5.
MEDIUMstatistics
Add an explicit statement in Methods/Statistical analysis on checking model assumptions (e.g., proportional hazards for Cox models, residual checks for MMRM), or cite where these were assessed and satisfied.
Reviewer 1 flagged assumptions as unverified; Reviewer 2 accepted them without evidence, so making the assessment explicit removes ambiguity.
6.
MEDIUMstatistics
Add the SAS version (e.g., 'SAS 9.4') to the 'All data analyses were performed with SAS System (SAS Institute Inc.) software' sentence in Methods/Statistical analysis.
Software without a version lowers both the key-resources and statistical-analysis ratings and impedes reproducibility.
7.
MEDIUMreporting
Specify the PK, ADA, and neutralizing-antibody assay platforms, vendors, and validation/performance data in Methods/Outcomes instead of 'as previously described'.
Immunogenicity and PK methods need to be self-contained for the trial to be auditable.
8.
MEDIUMreporting
Add a Table 1 footnote stating the denominators for race percentages (e.g., n=58 for benralizumab, n=57 for placebo) and noting missing race data.
Percentages that do not sum to the group N are an internal-consistency issue flagged by both reviewers and the integrity check.
9.
MEDIUMethics
Cite the IEC/IRB names and approval identifiers in the main text (or explicitly reference supplementary listing entries) and repair the truncated 'listed in the .' sentence in Methods/Study design.
Ethics approval must be auditable without relying on a broken cross-reference to the supplement.
10.
MEDIUMreporting
Name the reporting guideline (e.g., CONSORT 2010) with item-level compliance in addition to the linked Nature Portfolio reporting summary.
Explicitly naming the guideline makes the reporting-checklist mechanism clear to readers and reviewers.
11.
MEDIUMdata code
Add a dataset identifier (e.g., a Vivli study-page DOI) to the data-availability statement and note that no custom code was used (SAS analyses), so code sharing is not applicable.
A specific identifier strengthens the managed-access route and preempts ambiguity about code availability.
12.
LOWcopyedit
Fix the typos 'avialable' → 'available' in the Data Availability statement and 'Universtié' → 'Université' in the author affiliations.
These are minor copyedit issues flagged by the copyedit pass.
13.
LOWreporting
Report weight or BMI as a baseline characteristic in Table 1, or note its omission in the Limitations.
Weight was the only biological-variable gap noted by Reviewer 1 and would complete the biological-variables reporting.

Full text (61,221 chars)Analyzed: Aug 10, 2026