Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.

Name: Kaimen Rigor review — Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.
Item: Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.
Rating: 96
Author: Alpha1

Al-Samkari H, Kasthuri RS, Iyer VN, Pishko AM, Decker JE, Weiss CR, Whitehead KJ, Conrad MB, Zumberg MS, Zhou JY, Parambil J, Marsh D, Clancy M, Bradley L, Wisniewski L, Carper BA, Thomas SM, McCrae KR

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.75★ (Weak), 0 critical, 3 high issues for “Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.

Read full text (PMC)

DOI

10.1056/NEJMoa2312749

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/67e16d4b-a86d-4f6a-9cd5-0d65d31adfb0" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/67e16d4b-a86d-4f6a-9cd5-0d65d31adfb0/badge" alt="Kaimen Rigor review — 2.75★ (Weak), 0 critical, 3 high issues for “Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

b18dc1eef98ec0bdbce7f3a6990d58b92810abea7b78781f6c37f998dd4ea9b9

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.

Paper source

Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.75 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 15 reported means were read, and their group size is not stated where the values are printed. These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy endpoint is the Epistaxis Severity Score (ESS), a validated patient-reported bleeding severity score, which is a surrogate for clinical benefit. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking the ESS to hard clinical outcomes such as mortality or major morbidity. Although the ESS is validated for HHT, it is a subjective symptom score, and the claim of clinical benefit rests on this surrogate without establishing a direct link to hard outcomes.
“The primary outcome was the change from baseline in the Epistaxis Severity Score, a validated bleeding score in HHT, from randomization to the end of the treatment. A reduction of 0.71 points or more is considered clinically significant.”
Find in source
02Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
Pomalidomide may be disease-modifying in HHT.
“These results suggest that pomalidomide effects may extend beyond the duration of treatment in HHT”
Discussion ¶5Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted randomized, double-blind, placebo-controlled phase 2/3 trial with rigorous design, clear reporting of demographics, ethics, and statistical methods. The main weakness is the lack of a concrete data availability statement for individual patient data, and there are minor copyediting issues.

Both reviewers independently scored all eight dimensions and agreed on all statuses; no divergence to reconcile. The statistics verification component recomputed only 3 tests (all consistent); other statistics were not machine-verified. The citation check found no retracted or non-existent references.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

5 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated), 1 only partially supported (evidence backs part of the claim; gaps or caveats remain).

Premise concern: surrogate not validated for clinical benefit.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior studies on HHT pathophysiology and antiangiogenic agents, including a 31-patient thalidomide study, and acknowledges limitations of prior work (e.g., non-randomized, underpowered). The rationale for pomalidomide is clearly linked to its favorable toxicity profile. Limitations of prior research are addressed by the randomized, placebo-controlled design.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for testing pomalidomide.

Evidence

“Thalidomide, an immunomodulatory imide drug (IMiD), is the only antiangiogenic agent with positive prospective efficacy in HHT, demonstrated in a 31-patient study.”

Introduction ¶3Find in source

“We wished to determine whether pomalidomide, a thalidomide derivative, may have efficacy in treating HHT with a more favorable toxicity profile.”

Introduction ¶3Find in source

“Non-randomized and/or underpowered studies with bevacizumab or thalidomide suggest some effectiveness in treating HHT-associated bleeding.”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise by citing prior research on HHT and antiangiogenic agents, and provides a logical rationale for testing pomalidomide.

Evidence

paraphrase[Introduction, paragraph 3]

“Non-randomized and/or underpowered studies with bevacizumab or thalidomide suggest some effectiveness in treating HHT-associated bleeding. Thalidomide, an immunomodulatory imide drug (IMiD), is the only antiangiogenic agent with positive prospective efficacy in HHT, demonstrated in a 31-patient study. However, thalidomide is associated with serious toxicities, such as thromboembolism and irreversible peripheral neuropathy.”

“We wished to determine whether pomalidomide, a thalidomide derivative, may have efficacy in treating HHT with a more favorable toxicity profile.”

Introduction ¶3Find in source

Randomization used permuted blocks with random sizes, stratified by site, and blinding was maintained except for one statistician. A priori power analysis was provided (159 participants for 90% power). Inclusion/exclusion criteria were pre-specified. The mITT and per-protocol populations were defined, and missing data were handled with multiple imputation. As a human RCT, replicate_distinction, controls, and independent_replication are not applicable.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified analysis populations.

Evidence

MethodsFind in source

“Participants and study staff were blinded to treatment assignment except for one statistician (BAC) who provided emergency unblinding and interim analyses.”

MethodsFind in source

“We planned to randomize 159 participants to obtain 90% power to identify a treatment difference in Epistaxis Severity Score change from baseline at 24 weeks of 1.0, assuming a standard deviation of 1.7 and discontinuation rate of 10%.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, placebo-controlled, with adequate power, pre-specified analysis populations, and appropriate statistical methods.

Evidence

“Participants were randomized 2:1: to pomalidomide 4 mg daily or matching placebo using permuted blocks with random sizes of 3 and 6, stratified by site and implemented within the electronic data management system. Participants and study staff were blinded to treatment assignment except for one statistician (BAC) who provided emergency unblinding and interim analyses.”

MethodsFind in source

Statistical analysisFind in source

“Efficacy outcomes were analyzed for all randomized and treated participants with post-baseline data (modified intent-to-treat mITT population). A supportive pre-specified per-protocol analysis excluded early discontinuations and participants with treatment compliance less than 80%.”

Statistical analysisFind in source

The paper reports sex (48% female), age (mean 58.8 years), and health status (anemia, iron infusions, etc.) in Table 1. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Demographic and clinical characteristics are well reported, including sex, age, and health status.

Evidence

“Participants included 48% females, 11% race other than white, 3% Hispanic/Latino ethnicity; mean (± standard deviation) age was 58.8 ± 12.2 years.”

ResultsFind in source

“Anemia - no. (%) | 99 (69) | 66 (69) | 33 (67)”

Table 1Find in source

PASSReviewer 2· 90% conf

Demographic and clinical characteristics are well reported, including sex, age, race, ethnicity, and key disease-related variables.

Evidence

“Participants included 48% females, 11% race other than white, 3% Hispanic/Latino ethnicity; mean (± standard deviation) age was 58.8 ± 12.2 years.”

ResultsFind in source

paraphrase[Results, Patients, Treatment Exposure, and Adherence]

“The mean Epistaxis Severity Score was 5.0 ± 1.5 (moderate severity) and the mean HHT-QoL score was 6.3 ± 3.1.”

The protocol was approved by the institutional review board at Cleveland Clinic and an independent Data and Safety Monitoring Board. All participants provided written informed consent. Regulatory compliance with FDA requirements is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals and informed consent are clearly documented.

Evidence

“The protocol was approved by an independent Data and Safety Monitoring Board and the institutional review board at Cleveland Clinic.”

MethodsFind in source

“All participants provided written informed consent upon entry.”

MethodsFind in source

“Trial activities and oversight were conducted in accordance with FDA regulatory requirements.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals and consent are clearly documented: IRB approval, informed consent, and regulatory compliance are all stated.

Evidence

“The protocol was approved by an independent Data and Safety Monitoring Board and the institutional review board at Cleveland Clinic. Trial activities and oversight were conducted in accordance with FDA regulatory requirements. All participants provided written informed consent upon entry.”

MethodsFind in source

Pomalidomide and matching placebo are identified as donated by Bristol-Myers-Squibb, with dose and regimen specified. Statistical software (SAS 9.4) is identified. Other bench resources are not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational product (pomalidomide) and placebo are identified, and statistical software is named.

Evidence

“Pomalidomide and matching placebo were kindly donated by Bristol-Meyers-Squibb.”

Supplementary materialFind in source

“Analyses were based on a statistical plan prepared by a masked statistician and performed using SAS, version 9.4.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (pomalidomide) and placebo are identified, and the statistical software is named.

Evidence

“Pomalidomide and matching placebo were kindly donated by Bristol-Meyers-Squibb.”

AcknowledgementsFind in source

“Analyses were based on a statistical plan prepared by a masked statistician and performed using SAS, version 9.4.”

Statistical analysisFind in source

The primary analysis used a mixed model for repeated measures, with pre-specified alpha spending and multiplicity adjustments. Effect sizes with 95% CIs are reported for primary and secondary outcomes. Exact p-values are provided for the primary outcome and key safety comparisons. Software is identified. Data presentation includes model estimates and CIs, appropriate for a clinical trial. Mathematical plausibility checks are not applicable due to continuous outcomes and model-based estimates.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with effect sizes and confidence intervals reported.

Evidence

“mean difference, −0.94 [95% CI, −1.57 to −0.31], p=0.004”

ResultsFind in source

paraphrase[Table 2]

“Epistaxis Severity Score | −1.84 (−2.25, −1.43) | −0.90 (−1.39, −0.40) | −0.94 (−1.57, −0.31) | 0.004”

“Changes from baseline outcomes were analyzed with a repeated measures linear model or generalized logistic model which accounts for correlation of measurements over time, with adjustment for baseline value and clinical site.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with effect sizes and confidence intervals reported; p-values are exact for the primary outcome.

Evidence

“mean difference, −0.94 [95% CI, −1.57 to −0.31], p=0.004”

ResultsFind in source

paraphrase[Table 2]

“Epistaxis Severity Score: −1.84 (−2.25, −1.43) vs −0.90 (−1.39, −0.40); mean difference −0.94 (−1.57, −0.31)”

Statistical analysisFind in source

The paper states that the protocol and statistical analysis plan are available with the article at NEJM.org, but does not provide a data availability statement for individual patient data. No repository deposit or accession numbers are provided. Code sharing is not applicable as no custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

Data availability is mentioned but lacks a concrete access mechanism.

Evidence

“The protocol and statistical analysis plan are available with this article at NEJM.org (http://NEJM.org) .”

MethodsFind in source

WARNReviewer 2· 80% conf

The data availability statement is vague, and no data repository or code sharing is mentioned.

Evidence

paraphrase[Methods, Trial Design, Randomization, and Treatment]

“The protocol and statistical analysis plan are available with this article at NEJM.org.”

The trial is registered at ClinicalTrials.gov (NCT03910244). Methods are detailed enough for replication. Limitations are discussed (e.g., early termination, underrepresentation of Black patients). Conclusions are proportional to the evidence. Funding sources and COI are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are complete, limitations are discussed, and funding/COI are disclosed.

Evidence

“Clinicaltrials.gov (http://Clinicaltrials.gov) : NCT03910244 (https://clinicaltrials.gov/ct2/show/NCT03910244)”

AbstractFind in source

Discussion ¶7Find in source

“The project was funded by the National Heart Lung and Blood Institute, under grants UG3HL140097 (K. McCrae, Cleveland Clinic, clinical coordinating center) and U24HL140090 (S. Thomas, RTI, data coordinating center).”

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent: trial registration, funding, COI, and limitations are reported; methods are detailed.

Evidence

paraphrase[Abstract]

“Clinicaltrials.gov: NCT03910244”

“Evidence of efficacy based on changes in the Epistaxis Severity Score led to early study termination, resulting in reduction from the planned sample size, thus impacting power for secondary outcome analyses. A potential weakness of the study is that similar efficacy might have been observed with lower doses of pomalidomide with less toxicity. In addition, Black patients were underrepresented.”

Discussion ¶7Find in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 40 references by DOI: 31 verified — 9 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is methodologically robust and the conclusions are well-supported by the reported analyses. An informed reader should weigh the vague data availability statement and the minor copyediting issues, but these do not undermine the validity of the findings. No erratum is warranted based on the current evidence.

1.
HIGHdata code
Add a data availability statement in the Methods or a dedicated section specifying how to request de-identified individual patient data (e.g., via a data access committee or a repository like Vivli), including conditions and timeframe.
The current statement only mentions protocol and SAP availability, which is inadequate for a data-driven clinical trial and would be a common reviewer request.
2.
HIGHreporting
Mention adherence to CONSORT reporting guidelines in the Methods or acknowledgements and include the CONSORT checklist as supplementary material.
Explicitly stating CONSORT adherence improves transparency and is expected for a randomized trial.
3.
HIGHrigor
Temper the claim that pomalidomide may be disease-modifying in HHT, as this is speculative and not directly proven by the data.
The claim audit flagged this as overstated; over-claiming is a common reviewer objection and could mislead readers.
4.
MEDIUMcopyedit
Correct the spelling of 'Bristol-Meyers-Squibb' to 'Bristol-Myers Squibb' in the Supplementary Material.
Incorrect spelling of a company name is a minor but noticeable error.
5.
MEDIUMcopyedit
Remove the stray semicolon in the Abstract Results sentence: '...95% confidence interval −2.6 to −0.3;).'
Punctuation error that should be fixed for clarity.
6.
MEDIUMcopyedit
Clarify the Table 2 footnote about the p-value threshold (p=0.0425) to indicate it is for the final analysis, not the interim.
The current wording could be misinterpreted regarding the alpha spending function.
7.
MEDIUMcopyedit
Ensure consistent use of units (K/uL vs K/µL) and spacing in Table 3.
Minor formatting inconsistency that could be polished.
8.
MEDIUMcopyedit
Use 'pathogenic' consistently instead of 'pathogenetic' in Table 1 footnote.
Spelling inconsistency that should be standardized.
9.
MEDIUMcopyedit
Rephrase 'All treatment group comparisons include an estimated difference with 95% confidence interval' to include the article 'a' before '95%'.
Minor grammatical improvement for clarity.
10.
LOWdata code
Consider depositing the statistical analysis plan and any analysis code in a public repository (e.g., Zenodo) with a DOI.
Enhances reproducibility and is a good practice for clinical trials.
11.
LOWreporting
Provide a CONSORT flow diagram in the main text (currently only referenced as Figure 1).
A flow diagram improves transparency of participant disposition.

Full text (39,372 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.

Read full text (PMC)

DOI

10.1056/NEJMoa2312749

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/67e16d4b-a86d-4f6a-9cd5-0d65d31adfb0" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/67e16d4b-a86d-4f6a-9cd5-0d65d31adfb0/badge" alt="Kaimen Rigor review — 2.75★ (Weak), 0 critical, 3 high issues for “Pomalidomide for Epistaxis in Hereditary Hemorrhagic Telangiectasia.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

b18dc1eef98ec0bdbce7f3a6990d58b92810abea7b78781f6c37f998dd4ea9b9

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.75 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 15 reported means were read, and their group size is not stated where the values are printed. These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy endpoint is the Epistaxis Severity Score (ESS), a validated patient-reported bleeding severity score, which is a surrogate for clinical benefit. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking the ESS to hard clinical outcomes such as mortality or major morbidity. Although the ESS is validated for HHT, it is a subjective symptom score, and the claim of clinical benefit rests on this surrogate without establishing a direct link to hard outcomes.
“The primary outcome was the change from baseline in the Epistaxis Severity Score, a validated bleeding score in HHT, from randomization to the end of the treatment. A reduction of 0.71 points or more is considered clinically significant.”
Find in source
02Conclusion reaches beyond the evidence
mediumOverreachreviewer-assessedFull detail
Pomalidomide may be disease-modifying in HHT.
“These results suggest that pomalidomide effects may extend beyond the duration of treatment in HHT”
Discussion ¶5Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 3 via agent-written checks.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions overstated beyond the evidenceAssessed
Conclusions only partially backed by the presented evidenceAssessed

Premise concern: surrogate not validated for clinical benefit.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for testing pomalidomide.

Evidence

“Thalidomide, an immunomodulatory imide drug (IMiD), is the only antiangiogenic agent with positive prospective efficacy in HHT, demonstrated in a 31-patient study.”

Introduction ¶3Find in source

“We wished to determine whether pomalidomide, a thalidomide derivative, may have efficacy in treating HHT with a more favorable toxicity profile.”

Introduction ¶3Find in source

“Non-randomized and/or underpowered studies with bevacizumab or thalidomide suggest some effectiveness in treating HHT-associated bleeding.”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise by citing prior research on HHT and antiangiogenic agents, and provides a logical rationale for testing pomalidomide.

Evidence

paraphrase[Introduction, paragraph 3]

“We wished to determine whether pomalidomide, a thalidomide derivative, may have efficacy in treating HHT with a more favorable toxicity profile.”

Introduction ¶3Find in source

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified analysis populations.

Evidence

MethodsFind in source

“Participants and study staff were blinded to treatment assignment except for one statistician (BAC) who provided emergency unblinding and interim analyses.”

MethodsFind in source

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, placebo-controlled, with adequate power, pre-specified analysis populations, and appropriate statistical methods.

Evidence

MethodsFind in source

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Demographic and clinical characteristics are well reported, including sex, age, and health status.

Evidence

“Participants included 48% females, 11% race other than white, 3% Hispanic/Latino ethnicity; mean (± standard deviation) age was 58.8 ± 12.2 years.”

ResultsFind in source

“Anemia - no. (%) | 99 (69) | 66 (69) | 33 (67)”

Table 1Find in source

PASSReviewer 2· 90% conf

Demographic and clinical characteristics are well reported, including sex, age, race, ethnicity, and key disease-related variables.

Evidence

“Participants included 48% females, 11% race other than white, 3% Hispanic/Latino ethnicity; mean (± standard deviation) age was 58.8 ± 12.2 years.”

ResultsFind in source

paraphrase[Results, Patients, Treatment Exposure, and Adherence]

“The mean Epistaxis Severity Score was 5.0 ± 1.5 (moderate severity) and the mean HHT-QoL score was 6.3 ± 3.1.”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals and informed consent are clearly documented.

Evidence

“The protocol was approved by an independent Data and Safety Monitoring Board and the institutional review board at Cleveland Clinic.”

MethodsFind in source

“All participants provided written informed consent upon entry.”

MethodsFind in source

“Trial activities and oversight were conducted in accordance with FDA regulatory requirements.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals and consent are clearly documented: IRB approval, informed consent, and regulatory compliance are all stated.

Evidence

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational product (pomalidomide) and placebo are identified, and statistical software is named.

Evidence

“Pomalidomide and matching placebo were kindly donated by Bristol-Meyers-Squibb.”

Supplementary materialFind in source

“Analyses were based on a statistical plan prepared by a masked statistician and performed using SAS, version 9.4.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (pomalidomide) and placebo are identified, and the statistical software is named.

Evidence

“Pomalidomide and matching placebo were kindly donated by Bristol-Meyers-Squibb.”

AcknowledgementsFind in source

“Analyses were based on a statistical plan prepared by a masked statistician and performed using SAS, version 9.4.”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-described, with effect sizes and confidence intervals reported.

Evidence

“mean difference, −0.94 [95% CI, −1.57 to −0.31], p=0.004”

ResultsFind in source

paraphrase[Table 2]

“Epistaxis Severity Score | −1.84 (−2.25, −1.43) | −0.90 (−1.39, −0.40) | −0.94 (−1.57, −0.31) | 0.004”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with effect sizes and confidence intervals reported; p-values are exact for the primary outcome.

Evidence

“mean difference, −0.94 [95% CI, −1.57 to −0.31], p=0.004”

ResultsFind in source

paraphrase[Table 2]

“Epistaxis Severity Score: −1.84 (−2.25, −1.43) vs −0.90 (−1.39, −0.40); mean difference −0.94 (−1.57, −0.31)”

Statistical analysisFind in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

Data availability is mentioned but lacks a concrete access mechanism.

Evidence

“The protocol and statistical analysis plan are available with this article at NEJM.org (http://NEJM.org) .”

MethodsFind in source

WARNReviewer 2· 80% conf

The data availability statement is vague, and no data repository or code sharing is mentioned.

Evidence

paraphrase[Methods, Trial Design, Randomization, and Treatment]

“The protocol and statistical analysis plan are available with this article at NEJM.org.”

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are complete, limitations are discussed, and funding/COI are disclosed.

Evidence

“Clinicaltrials.gov (http://Clinicaltrials.gov) : NCT03910244 (https://clinicaltrials.gov/ct2/show/NCT03910244)”

AbstractFind in source

Discussion ¶7Find in source

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent: trial registration, funding, COI, and limitations are reported; methods are detailed.

Evidence

paraphrase[Abstract]

“Clinicaltrials.gov: NCT03910244”

Discussion ¶7Find in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 40 references by DOI: 31 verified — 9 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Add a data availability statement in the Methods or a dedicated section specifying how to request de-identified individual patient data (e.g., via a data access committee or a repository like Vivli), including conditions and timeframe.
The current statement only mentions protocol and SAP availability, which is inadequate for a data-driven clinical trial and would be a common reviewer request.
2.
HIGHreporting
Mention adherence to CONSORT reporting guidelines in the Methods or acknowledgements and include the CONSORT checklist as supplementary material.
Explicitly stating CONSORT adherence improves transparency and is expected for a randomized trial.
3.
HIGHrigor
Temper the claim that pomalidomide may be disease-modifying in HHT, as this is speculative and not directly proven by the data.
The claim audit flagged this as overstated; over-claiming is a common reviewer objection and could mislead readers.
4.
MEDIUMcopyedit
Correct the spelling of 'Bristol-Meyers-Squibb' to 'Bristol-Myers Squibb' in the Supplementary Material.
Incorrect spelling of a company name is a minor but noticeable error.
5.
MEDIUMcopyedit
Remove the stray semicolon in the Abstract Results sentence: '...95% confidence interval −2.6 to −0.3;).'
Punctuation error that should be fixed for clarity.
6.
MEDIUMcopyedit
Clarify the Table 2 footnote about the p-value threshold (p=0.0425) to indicate it is for the final analysis, not the interim.
The current wording could be misinterpreted regarding the alpha spending function.
7.
MEDIUMcopyedit
Ensure consistent use of units (K/uL vs K/µL) and spacing in Table 3.
Minor formatting inconsistency that could be polished.
8.
MEDIUMcopyedit
Use 'pathogenic' consistently instead of 'pathogenetic' in Table 1 footnote.
Spelling inconsistency that should be standardized.
9.
MEDIUMcopyedit
Rephrase 'All treatment group comparisons include an estimated difference with 95% confidence interval' to include the article 'a' before '95%'.
Minor grammatical improvement for clarity.
10.
LOWdata code
Consider depositing the statistical analysis plan and any analysis code in a public repository (e.g., Zenodo) with a DOI.
Enhances reproducibility and is a good practice for clinical trials.
11.
LOWreporting
Provide a CONSORT flow diagram in the main text (currently only referenced as Figure 1).
A flow diagram improves transparency of participant disposition.

Full text (39,372 chars)Analyzed: Aug 16, 2026