Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Name: Kaimen Rigor review — Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.
Item: Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.
Rating: 39
Author: Alpha1

Gill SK, Barsky A, Guan X, Bunting KV, Karwath A, Tica O, Stanbury M, Haynes S, Folarin A, Dobson R, Kurps J, Asselbergs FW, Grobbee DE, Camm AJ, Eijkemans MJC, Gkoutos GV, Kotecha D, BigData@Heart Consortium, cardAIc group, RATE-AF trial team

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 1★ (Critical), 2 critical, 2 high issues for “Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Read full text (PMC)

DOI

10.1038/s41591-024-03094-4

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/8279ed23-1ebc-4bfd-9a0c-752809c2f28f" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/8279ed23-1ebc-4bfd-9a0c-752809c2f28f/badge" alt="Kaimen Rigor review — 1★ (Critical), 2 critical, 2 high issues for “Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

827670766349fbb98e9c8ec8eb03f7870531ccb96b1e3bcf452243549c54ca55

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Paper source

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic ×2−2★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped)−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 22 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues2 demonstrable

01Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
59.3% does not match the reported count 16/28
“16 patients (59.3%) in the digoxin group”
DiscussionFind in source
02Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
54.2% does not match the reported count 13/25
“and 13 (54.2%) in the beta-blocker group”
DiscussionFind in source
03Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is that digoxin and beta-blockers have equivalent effects on heart rate in atrial fibrillation, based on wearable heart rate measurements. Heart rate is a surrogate biomarker for clinical outcomes in AF. The paper does not demonstrate target engagement at the tested dose (e.g., no PK/PD or dose-exposure relationship linking the measured heart rate to drug effect) nor does it cite validated evidence linking heart rate control to hard clinical outcomes in this context. The claim of equivalence is based solely on the surrogate heart rate measurement.
“The results of this study indicate that digoxin and beta-blockers have equivalent effects on heart rate in atrial fibrillation at rest and on exertion”
Find in source
04Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is a null result (no significant difference in heart rate between digoxin and beta-blockers), with a regression coefficient of 1.22 bpm (95% CI -2.82 to 5.27; P=0.55). The paper interprets this as equivalence, but no minimal clinically important difference (MCID) for heart rate in AF is provided, and the confidence interval is wide, spanning a range that could include clinically meaningful differences. The effect size is not anchored to any clinical or biological meaningfulness.
“The unadjusted regression coefficient for digoxin versus beta-blockers was 1.22 (95% CI −2.82 to 5.27; P = 0.55)”
Find in source
05Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
90.4% is unattainable for n=53 (nearest: 88.7, 90.6%)
“90.4% of participants using this every day for the last 7 days before the interim review”
ResultsFind in source

Findings by category

201ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 05AvailabilityNone found 06Copyedit4 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a well-conducted randomized controlled trial substudy with clear scientific premise, rigorous design, and transparent reporting. Minor reporting gaps exist in data availability specifics and statistical verification, but overall the methodology is sound.

Both reviewers classified the study as interventional, and this was adopted. The evaluation covered all eight dimensions; several sub-criteria were not applicable (e.g., animal-related items, cell line authentication). The statistics verification component checked only a subset of tests, and the inconsistent findings were not detailed, so they were not treated as demonstrable errors.

Numerical inconsistencies

2 findings · worst critical

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Printed percentage does not match its own countRecomputed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks. 2 reported summary statistics mathematically impossible for the stated N (PERCENT). 1 printed percentage that does not match its own count.

Overstated conclusions

2 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

4 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

None found

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Checked — nothing surfaced.

Eight Dimensions8 pass

The introduction cites prior research on wearable technology, digoxin's efficacy, and the need for longer-term assessment. The hypothesis follows logically from the cited evidence. Limitations of prior research (e.g., acute studies only) are acknowledged and addressed by the longer-term design.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

“digoxin has typically been considered a poorly effective drug for controlling heart rate, particularly on exertion, although this is based on acute studies only”

Introduction ¶1Find in source

“we hypothesized that a wrist-worn wearable could: (1) address whether digoxin is inferior to beta-blockers for longer-term heart rate control in patients with AF at rest and on exertion; (2) adjust for differences in individual physical activity; and (3) explore whether wearable sensor data are comparable with conventional measurements for the prediction of clinical progress”

Introduction ¶2Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

“digoxin has typically been considered a poorly effective drug for controlling heart rate, particularly on exertion, although this is based on acute studies only”

Introduction ¶2Find in source

Introduction ¶3Find in source

“Wearables offer an opportunity to assess each patient in their own environment, with longer-term evaluation better reflecting the extended time taken to achieve therapeutic benefit from digoxin”

Introduction ¶2Find in source

Randomization used a computer-generated minimization algorithm, and the trial was open-label with blinded endpoint assessment. A sample size calculation was performed post hoc but justified the target enrollment. Inclusion/exclusion criteria were defined, and the analysis was intention-to-treat. Controls are inherent in the randomized comparison. Independent replication is not applicable for a single trial.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The study design is rigorous for a randomized trial substudy, with adequate randomization, blinding, and sample size justification.

Evidence

“Randomization was completed using a computer-generated minimization algorithm to ensure treatment arms were balanced for gender and AF symptoms”

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Consumer wearable devices for evaluation of heart rate control using digoxin versus beta-blockers: the RATE-AF randomized trial.

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting

Numerical inconsistencies

Overstated conclusions

Data authenticity concerns

Reporting gaps

Broken references and links

Copyediting