Rigor Reviewed

Rigor-Reviewed Manuscript

One Dose versus Three Doses of Benzathine Penicillin G in Early Syphilis.

Name: Αlpha¹ Rigor Record — One Dose versus Three Doses of Benzathine Penicillin G in Early Syphilis.
Item: One Dose versus Three Doses of Benzathine Penicillin G in Early Syphilis.
Rating: 96
Author: Αlpha¹

Hook EW 3rd, Dionne JA, Workowski K, McNeil CJ, Taylor SN, Batteiger TA, Dombrowski JC, Mayer KH, Seña AC, Hamill MM, Wiesenfeld HC, Zhu C, Perlowski C, Mejia-Galvis JE, Newman LM

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 1.75★ (Critical), 0 critical, 6 high issues for “One Dose versus Three Doses of Benzathine Penicillin G in Early Syphilis.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

1.75 / 5

Critical — serious problems across many checks

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×4−2★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No reported statistical tests were found to recompute.
No data or code availability links were detected to verify.

Problems surfaced5 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted multicenter randomized non-inferiority trial with a clear premise, rigorous design, and transparent reporting. The main weaknesses are the lack of a data availability statement, missing trial registration number, and several minor reporting gaps (randomization method, statistical software, CONSORT statement). The copyedit pass identified numerous inconsistencies in Table 1 that need correction.

Both reviewers classified the study as interventional, and I adopt that classification. The evaluation covered the full text, including methods, results, and discussion. Non-applicable sub-criteria (e.g., animal-related, cell line authentication) were excluded. The statistics verification component checked 0 tests, so no independent statistical verification was possible; the integrity check flagged internal contradictions in Table 1 that are addressed in the action items.

5 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

4 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites historical context and prior studies on syphilis treatment, acknowledges ongoing controversy regarding optimal BPG duration, and clearly links the premise to the trial's objective. Limitations of prior research are implicitly addressed by the trial design, though not explicitly detailed.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedINADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with adequate citation of prior work and a logical rationale for the trial.

Evidence

paraphrase[Introduction, paragraphs 1-3]

“These data complement the study by Rolfs et al which showed that higher doses of penicillin do not improve response to therapy.”

direct quote[Introduction, paragraph 3]

“To address the continuing controversy regarding the optimal duration of BPG for early syphilis treatment, we conducted a multicenter randomized non-inferiority clinical trial (RCT) comparing single dose therapy with 2.4 million units (MU) of BPG to therapy with three doses of 2.4MU BPG administered at successive weekly intervals.”