Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.

Name: Kaimen Rigor review — Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.
Item: Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.
Rating: 94
Author: Alpha1

Ozanne EM, Barnes GD, Brito JP, Cameron KA, Cavanaugh KL, Greene T, Jackson EA, Montori VM, Steinberg BA, Witt DM, Noseworthy P, Passman RS, Kansal P, Crossley G, Roden DM, Christensen JT, Ariotti A, Jones AE, Bardsley T, Wu C, Fagerlin A, STEP-UP Writing Group

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 3 high issues for “Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.

Read full text (PMC)

DOI

10.1136/bmj-2024-079976

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/26faa9b0-6b01-477c-b4b0-656ac65de8aa" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/26faa9b0-6b01-477c-b4b0-656ac65de8aa/badge" alt="Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 3 high issues for “Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d566e3889830ca05d3add3e4f2d726fe3b8942775d41e10a22cacaec3a3798df

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.

Paper source

Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary outcomes are surrogate measures of shared decision making (OPTION12 score, knowledge, decisional conflict) rather than hard clinical outcomes. The paper does not demonstrate target engagement at the tested dose (not applicable for a behavioral intervention) nor cite validated evidence linking these surrogates to clinical outcomes such as stroke prevention or patient-important outcomes. The claim of effectiveness rests on these surrogates without establishing a validated link to clinical benefit.
“Primary outcome measures were quality of shared decision making measured by OPTION12, knowledge of atrial fibrillation and its management, and decisional conflict.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect sizes are small relative to the scale ranges and lack anchoring to clinically meaningful thresholds. For example, the OPTION12 score improved by 12.1 points on a 0-100 scale, knowledge odds ratio 1.68, and decisional conflict reduced by 6.3 points on a 0-100 scale. The paper does not provide a minimal clinically important difference or other anchor to establish that these changes are clinically material. The discussion mentions a threshold for decisional conflict (<25) but does not use it to interpret the effect size.
“Compared with usual care, the combined use of both the patient decision aid and the encounter decision aid improved the quality of shared decision making (adjusted mean difference 12.1 (95% confidence interval (CI) 8.0 to 16.2; P<0.001), improved patients’…”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted cluster randomized trial with clear randomization, sample size justification, and transparent reporting. The main weaknesses are a vague data availability statement, lack of statistical software identification, and minor copyedit issues. Overall, the paper is methodologically sound and the findings are credible.

Both reviewers classified the study as interventional, which is appropriate for a cluster RCT. The key resources dimension was rated not applicable by one reviewer and pass by the other; I adopted 'pass' because the decision aids are investigational products. The statistics verification checked 6 tests, all consistent, but coverage is limited to tests with test statistics or effect estimates with CIs; other p-values were not machine-verified.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 6 tests: 6 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 5 via agent-written checks.

Overstated conclusions

2 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

11 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior research on decision aids and identifies a gap in comparative effectiveness. The rationale linking the premise to the study objectives is clear. Limitations of prior research are implicitly addressed by the study design, though not explicitly detailed.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

“Evidence has shown the effectiveness of a patient decision aid or encounter decision aid in improving shared decision making outcomes in a clinical setting ; however, no reliable estimate exists of the comparative effectiveness of these different types of decision aids in supporting shared decision making in practice.”

Introduction ¶4Find in source

“The aim of this study was to evaluate the effectiveness of a patient decision aid and an encounter decision aid in promoting high quality shared decision making for stroke prevention in the care of patients with non-valvular atrial fibrillation at risk of stroke.”

Introduction ¶4Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

Randomization method and unit are clearly described (patients and clinicians randomized, stratified by site and other factors). Blinding is described as not possible for participants, but outcome assessors were not blinded (noted as a limitation). Power analysis is provided with assumptions. Inclusion/exclusion criteria are detailed. Outlier handling is addressed through imputation and intention-to-treat analysis. Controls are the usual care group. Independent replication is not applicable for a single trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsINADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with appropriate randomization, blinding considerations, and sample size justification.

Evidence

“Patients were randomly assigned with equal allocation to either the use of the patient decision aid or usual care. Clinicians were randomly assigned with equal allocation to either use the encounter decision aid with all study participants or a usual care arm in which they did not use the encounter decision aid for any study participants.”

MethodsFind in source

“Participants could not be blinded to allocation owing to the nature of the intervention.”

MethodsFind in source

“Under these assumptions, the sample size of 1200 would provide 80% power with a two sided α of 0.05 to detect mean differences, expressed as fractions of one standard deviation, of 0.40, 0.33, and 0.33 for the OPTION12, knowledge, and decisional conflict scores, respectively”

MethodsFind in source

PASSReviewer 2· 90% conf

The trial design is rigorous with appropriate randomization, blinding considerations, and sample size justification.

Evidence

“A study coordinator allocated all participants by using the REDCap randomization function.”

MethodsFind in source

“Participants could not be blinded to allocation owing to the nature of the intervention.”

MethodsFind in source

Sex, age, race/ethnicity, education, and health insurance are reported in Table 1. Age and sex are reported for the cohort. Since both sexes are enrolled, sex justification is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Patient demographics and clinical characteristics are well reported.

Evidence

paraphrase[Table 1]

“Sex assigned at birth: Female 103/298 (35) ... Male 195/298 (65)”

“The mean age of the patients was 69 (standard deviation 9) years”

Results ¶1Find in source

PASSReviewer 2· 90% conf

Patient demographics and clinical characteristics are well reported.

Evidence

paraphrase[Table 1]

“Sex assigned at birth: Female 103/298 (35) ... Male 195/298 (65)”

“The mean age of the patients was 69 (standard deviation 9) years”

Results ¶1Find in source

The study has ethical approval from a named IRB with a protocol number, and informed consent was obtained from all participants. Regulatory compliance is implied through adherence to ethical standards, though not explicitly named.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“The study has ethical approval from the University of Utah Institutional Review Board (IRB_00124127).”

EthicsFind in source

“All participants provided informed consent before taking part in the study.”

EthicsFind in source

PASSReviewer 2· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“The study has ethical approval from the University of Utah Institutional Review Board (IRB_00124127).”

EthicsFind in source

“All participants provided informed consent before taking part in the study.”

EthicsFind in source

The decision aids are described in detail, though not with a manufacturer/catalog number as they are custom tools. Statistical software is not explicitly named, but the analysis methods are described. No wet-lab reagents are used.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedINADEQUATE

Per reviewer (2) — the votes behind the verdict

N/AReviewer 1· 90% conf

The study uses decision aids as interventions, which are not typical biological/chemical resources; no investigational drug or device is involved.

Evidence

“The patient decision aid was designed as an interactive, non-linear online tool”

MethodsFind in source

PASSReviewer 2· 85% conf

The investigational products (decision aids) are described, and software tools are identified.

Evidence

“The patient decision aid includes an explanation of atrial fibrillation and how it affects a patient’s life and features the CHA 2 DS 2 -VASc and HAS-BLED calculators”

MethodsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

Statistical tests are named (linear mixed effects models, generalized linear mixed effects models). Assumptions are handled through model design. Exact p-values are reported for primary outcomes. Effect sizes with confidence intervals are provided. Software is not explicitly identified. Data presentation includes means, SDs, and CIs. Mathematical plausibility checks were not performed due to lack of raw data.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well described, with effect sizes and confidence intervals reported.

Evidence

“We did the co-primary statistical analyses for the OPTION12 scale and Decisional Conflict Scale by using separate analyses of linear mixed effects models”

MethodsFind in source

paraphrase[Results, Table 3]

“12.1 (8.0 to 16.2) ... P<0.001”

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well described, with effect sizes and confidence intervals reported.

Evidence

“We did the co-primary statistical analyses for the OPTION12 scale and Decisional Conflict Scale by using separate analyses of linear mixed effects models”

MethodsFind in source

paraphrase[Results, Table 3]

“12.1 (8.0 to 16.2) ... P<0.001”

absence[Methods]

Statistical software is not identified.

The data availability statement says de-identified data will be posted to ClinicalTrials.gov, but no timeline or accession number is provided. Additional data may be shared on reasonable request, but no mechanism is specified. No code is shared.

Sub-criteria

code sharingNOT REPORTED

accession numbersNOT REPORTED

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

Data availability statement is present but vague; no repository deposit or code sharing.

Evidence

“De-identified data will be posted to ClinicalTrials.gov according to our sponsors’ requirements and timeline. Additional data may be shared on reasonable request.”

Data availabilityFind in source

WARNReviewer 2· 80% conf

Data availability statement is present but vague, and no code is shared.

Evidence

“De-identified data will be posted to ClinicalTrials.gov according to our sponsors’ requirements and timeline. Additional data may be shared on reasonable request.”

Data availabilityFind in source

absence[Data availability statement]

No code sharing mentioned.

Trial registration is provided. CONSORT diagram is included. All outcomes are reported, including non-significant ones. Limitations are discussed. Conclusions are proportional to evidence. Funding and COI statements are provided.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The manuscript is transparent with trial registration, CONSORT diagram, and limitations discussed.

Evidence

“Trial registration ClinicalTrials.gov NCT04357288”

AbstractFind in source

“Fig 2 CONSORT (Consolidated Standards of Reporting Trials) diagram.”

Figure 2Find in source

“Observers assessing the OPTION12 outcome measure on video recorded encounters cannot be blinded to allocation; their unblinded assessments could be biased in favor of decision aids”

LimitationsFind in source

PASSReviewer 2· 90% conf

The trial is registered, reporting guidelines are followed, and limitations are discussed.

Evidence

“Trial registration ClinicalTrials.gov NCT04357288”

AbstractFind in source

“Fig 2 CONSORT (Consolidated Standards of Reporting Trials) diagram.”

Figure 2Find in source

“Observers assessing the OPTION12 outcome measure on video recorded encounters cannot be blinded to allocation; their unblinded assessments could be biased in favor of decision aids”

LimitationsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 36 references by DOI: 31 verified — 5 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and credible, with no major integrity concerns. An informed reader should weigh the minor reporting gaps (vague data availability, missing software identification) and the unblinded outcome assessors as limitations, but these do not undermine the main conclusions. No erratum is warranted based on the checks performed.

1.
HIGHdata code
In the Data availability statement, specify the exact timeline for posting de-identified data to ClinicalTrials.gov and the process for requesting additional data (e.g., contact email or data access committee).
The current statement is vague and does not meet common reproducibility standards.
2.
HIGHstatistics
In the Methods, Statistical analyses section, name the statistical software and version used (e.g., R 4.2, SAS 9.4).
Software identification is a standard reporting requirement and was flagged by both reviewers.
3.
HIGHdata code
Share analysis code in a public repository (e.g., GitHub) and link it in the Data availability statement.
Code sharing enhances reproducibility and was recommended by both reviewers.
4.
MEDIUMreporting
In the Methods, Randomization and blinding section, explicitly state whether outcome assessors were blinded (or not) and any measures taken to mitigate bias.
The copyedit pass and reviewers noted that assessor blinding is not clearly described.
5.
MEDIUMreporting
In the Introduction, add a sentence discussing limitations of prior research that this study addresses.
Both reviewers flagged that limitations of prior work are not explicitly discussed.
6.
MEDIUMcopyedit
In the Abstract, standardize p-value formatting (e.g., use 'P<0.001' consistently) and fix the author name formatting (e.g., 'Elissa M Ozanne, associate professor').
Minor copyedit issues affect professionalism and consistency.
7.
MEDIUMcopyedit
In Table 1, define 'limited reading ability' in a footnote.
The term is not defined and could be ambiguous to readers.
8.
MEDIUMcopyedit
In the Methods, Sample size section, clarify which outcome each minimum detectable effect size corresponds to.
The current text is ambiguous about which effect size is for which outcome.
9.
LOWcopyedit
In the Introduction, fix the grammar error: change 'an oral anticoagulants' to 'an oral anticoagulant'.
Subject-verb agreement error.
10.
LOWethics
In the Ethics statements, add an explicit statement of adherence to the Declaration of Helsinki or equivalent ethical framework.
One reviewer noted regulatory compliance is only implied; explicit statement strengthens the ethics section.

Full text (53,535 chars)Analyzed: Aug 15, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.

Read full text (PMC)

DOI

10.1136/bmj-2024-079976

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/26faa9b0-6b01-477c-b4b0-656ac65de8aa" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/26faa9b0-6b01-477c-b4b0-656ac65de8aa/badge" alt="Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 3 high issues for “Effectiveness of shared decision making strategies for stroke prevention among patients with atrial fibrillation: cluster randomized controlled trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d566e3889830ca05d3add3e4f2d726fe3b8942775d41e10a22cacaec3a3798df

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary outcomes are surrogate measures of shared decision making (OPTION12 score, knowledge, decisional conflict) rather than hard clinical outcomes. The paper does not demonstrate target engagement at the tested dose (not applicable for a behavioral intervention) nor cite validated evidence linking these surrogates to clinical outcomes such as stroke prevention or patient-important outcomes. The claim of effectiveness rests on these surrogates without establishing a validated link to clinical benefit.
“Primary outcome measures were quality of shared decision making measured by OPTION12, knowledge of atrial fibrillation and its management, and decisional conflict.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The reported effect sizes are small relative to the scale ranges and lack anchoring to clinically meaningful thresholds. For example, the OPTION12 score improved by 12.1 points on a 0-100 scale, knowledge odds ratio 1.68, and decisional conflict reduced by 6.3 points on a 0-100 scale. The paper does not provide a minimal clinically important difference or other anchor to establish that these changes are clinically material. The discussion mentions a threshold for decisional conflict (<25) but does not use it to interpret the effect size.
“Compared with usual care, the combined use of both the patient decision aid and the encounter decision aid improved the quality of shared decision making (adjusted mean difference 12.1 (95% confidence interval (CI) 8.0 to 16.2; P<0.001), improved patients’…”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 6 tests: 6 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 5 via agent-written checks.

Overstated conclusions

2 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed

11 major claims checked against the paper's own evidence: all adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

Introduction ¶4Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with prior work cited and a logical rationale for the study.

Evidence

Introduction ¶3Find in source

absence[Introduction]

Limitations of prior research are not explicitly discussed.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsINADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with appropriate randomization, blinding considerations, and sample size justification.

Evidence

MethodsFind in source

“Participants could not be blinded to allocation owing to the nature of the intervention.”

MethodsFind in source

PASSReviewer 2· 90% conf

The trial design is rigorous with appropriate randomization, blinding considerations, and sample size justification.

Evidence

“A study coordinator allocated all participants by using the REDCap randomization function.”

MethodsFind in source

“Participants could not be blinded to allocation owing to the nature of the intervention.”

MethodsFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Patient demographics and clinical characteristics are well reported.

Evidence

paraphrase[Table 1]

“Sex assigned at birth: Female 103/298 (35) ... Male 195/298 (65)”

“The mean age of the patients was 69 (standard deviation 9) years”

Results ¶1Find in source

PASSReviewer 2· 90% conf

Patient demographics and clinical characteristics are well reported.

Evidence

paraphrase[Table 1]

“Sex assigned at birth: Female 103/298 (35) ... Male 195/298 (65)”

“The mean age of the patients was 69 (standard deviation 9) years”

Results ¶1Find in source

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“The study has ethical approval from the University of Utah Institutional Review Board (IRB_00124127).”

EthicsFind in source

“All participants provided informed consent before taking part in the study.”

EthicsFind in source

PASSReviewer 2· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“The study has ethical approval from the University of Utah Institutional Review Board (IRB_00124127).”

EthicsFind in source

“All participants provided informed consent before taking part in the study.”

EthicsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedINADEQUATE

Per reviewer (2) — the votes behind the verdict

N/AReviewer 1· 90% conf

The study uses decision aids as interventions, which are not typical biological/chemical resources; no investigational drug or device is involved.

Evidence

“The patient decision aid was designed as an interactive, non-linear online tool”

MethodsFind in source

PASSReviewer 2· 85% conf

The investigational products (decision aids) are described, and software tools are identified.

Evidence

“The patient decision aid includes an explanation of atrial fibrillation and how it affects a patient’s life and features the CHA 2 DS 2 -VASc and HAS-BLED calculators”

MethodsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well described, with effect sizes and confidence intervals reported.

Evidence

“We did the co-primary statistical analyses for the OPTION12 scale and Decisional Conflict Scale by using separate analyses of linear mixed effects models”

MethodsFind in source

paraphrase[Results, Table 3]

“12.1 (8.0 to 16.2) ... P<0.001”

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well described, with effect sizes and confidence intervals reported.

Evidence

“We did the co-primary statistical analyses for the OPTION12 scale and Decisional Conflict Scale by using separate analyses of linear mixed effects models”

MethodsFind in source

paraphrase[Results, Table 3]

“12.1 (8.0 to 16.2) ... P<0.001”

absence[Methods]

Statistical software is not identified.

Sub-criteria

code sharingNOT REPORTED

accession numbersNOT REPORTED

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

Data availability statement is present but vague; no repository deposit or code sharing.

Evidence

“De-identified data will be posted to ClinicalTrials.gov according to our sponsors’ requirements and timeline. Additional data may be shared on reasonable request.”

Data availabilityFind in source

WARNReviewer 2· 80% conf

Data availability statement is present but vague, and no code is shared.

Evidence

“De-identified data will be posted to ClinicalTrials.gov according to our sponsors’ requirements and timeline. Additional data may be shared on reasonable request.”

Data availabilityFind in source

absence[Data availability statement]

No code sharing mentioned.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The manuscript is transparent with trial registration, CONSORT diagram, and limitations discussed.

Evidence

“Trial registration ClinicalTrials.gov NCT04357288”

AbstractFind in source

“Fig 2 CONSORT (Consolidated Standards of Reporting Trials) diagram.”

Figure 2Find in source

“Observers assessing the OPTION12 outcome measure on video recorded encounters cannot be blinded to allocation; their unblinded assessments could be biased in favor of decision aids”

LimitationsFind in source

PASSReviewer 2· 90% conf

The trial is registered, reporting guidelines are followed, and limitations are discussed.

Evidence

“Trial registration ClinicalTrials.gov NCT04357288”

AbstractFind in source

“Fig 2 CONSORT (Consolidated Standards of Reporting Trials) diagram.”

Figure 2Find in source

“Observers assessing the OPTION12 outcome measure on video recorded encounters cannot be blinded to allocation; their unblinded assessments could be biased in favor of decision aids”

LimitationsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 36 references by DOI: 31 verified — 5 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
In the Data availability statement, specify the exact timeline for posting de-identified data to ClinicalTrials.gov and the process for requesting additional data (e.g., contact email or data access committee).
The current statement is vague and does not meet common reproducibility standards.
2.
HIGHstatistics
In the Methods, Statistical analyses section, name the statistical software and version used (e.g., R 4.2, SAS 9.4).
Software identification is a standard reporting requirement and was flagged by both reviewers.
3.
HIGHdata code
Share analysis code in a public repository (e.g., GitHub) and link it in the Data availability statement.
Code sharing enhances reproducibility and was recommended by both reviewers.
4.
MEDIUMreporting
In the Methods, Randomization and blinding section, explicitly state whether outcome assessors were blinded (or not) and any measures taken to mitigate bias.
The copyedit pass and reviewers noted that assessor blinding is not clearly described.
5.
MEDIUMreporting
In the Introduction, add a sentence discussing limitations of prior research that this study addresses.
Both reviewers flagged that limitations of prior work are not explicitly discussed.
6.
MEDIUMcopyedit
In the Abstract, standardize p-value formatting (e.g., use 'P<0.001' consistently) and fix the author name formatting (e.g., 'Elissa M Ozanne, associate professor').
Minor copyedit issues affect professionalism and consistency.
7.
MEDIUMcopyedit
In Table 1, define 'limited reading ability' in a footnote.
The term is not defined and could be ambiguous to readers.
8.
MEDIUMcopyedit
In the Methods, Sample size section, clarify which outcome each minimum detectable effect size corresponds to.
The current text is ambiguous about which effect size is for which outcome.
9.
LOWcopyedit
In the Introduction, fix the grammar error: change 'an oral anticoagulants' to 'an oral anticoagulant'.
Subject-verb agreement error.
10.
LOWethics
In the Ethics statements, add an explicit statement of adherence to the Declaration of Helsinki or equivalent ethical framework.
One reviewer noted regulatory compliance is only implied; explicit statement strengthens the ethics section.

Full text (53,535 chars)Analyzed: Aug 15, 2026