Cefazolin for Methicillin-Susceptible Staphylococcus aureus Bacteremia.
Staphylococcus aureus Network Adaptive Platform (SNAP) Trial Group, Lee TC, Barina LA, Walls G, Goodman AL, Yahav D, Cheng MP, Bonten M, Bowen AC, Boyles T, Daneman N, Ekkelenkamp MB, Ghanem-Zoubi N, Hensgens MPM, Jager NGL, Kaasch AJ, Kouijzer IJE, Lewis RJ, Lumley T, Lye DC, McDonald EG, McKew G, McLean ARD, McMullan BJ, McQuilten ZK, Morpeth SC, Paterson DL, Roberts JA, Robinson JO, Saito H, Scarborough M, Ten Oever J, Turner RM, Tverring J, van Hal SJ, Webb SA, Whiteway LM, Arias CA, Henderson A, Heriot GS, Snelling TL, Afra K, Ali SS, Amit S, Anagnostou NA, Archuleta S, Aston SJ, Athan E, Baharav N, Bai AD, Barber BE, Baskaran A, Berkeley MMA, Best EJ, Bhilave NR, Bloomfield MG, Bond KA, Bostock J, Botheras CL, Boyd MA, Bradshaw SME, Briggs EJ, Britton PN, Campbell AJ, Carr BZ, Chancellor JA, Chen K, Cheong EY, Chew KL, Chia PY, Chomba R, Chong BSW, Clews CJN, Cohen JM, Commons RJ, Cutfield T, Daley P, Daniel DS, Davies J, De P, Denholm JT, Di Virgilio M, Dishon-Benattar Y, Dotel R, Duan EH, Easom N, Eliakim-Raz N, England MM, Fahmy M, Findlater AR, Flanagan KL, Foo EZJ, Foo H, Forster DP, Fralick M, Frazer JL, Gador-Whyte AP, Garnham K, German GJ, Ghosh N, Gisolf EH, Giulieri SG, Goulding SR, Grant JM, Gregson D, Grimwade KC, Grupper M, Guy SD, Gwee A, Hall VG, Hardy EJ, Harris DJ, Hatcher J, Hobbs MR, Holmes NE, Howden BP, Huggan PJ, Jennings ZA, Johnstone J, Juniper T, Kalimuddin S, Kamfose M, Kandel C, Kelly MJ, Kozak RA, Kümin M, Lamontagne F, Lau JSY, Lee IR, Lin RJ, Lindsay D, Llewelyn MJ, Longtin Y, Lother SA, Luey CE, MacFadden DR, Mahony AA, Malden C, Malhamé I, Manning LA, Marks M, Martin LJ, Matthews GV, McGann PH, McMahon JH, Melon A, Menon V, Mertz D, Meyer MP, Molton JS, Mora JM, Moran E, Mortimer LM, Motaganahalli S, Muller MP, Munro APS, Murray FA, Murthy S, Nagendra V, Nel H, New DWJ, Nguyen V, Norton G, Norton KM, Nourse CB, Nye CJS, O'Callaghan K, O'Sullivan MVN, Ong SWX, Otu AA, Owen M, Papenburg J, Parkes LO, Paul M, Perez-Patrigeon S, Petersiel N, Petrella L, Pett SL, Pham D, Piazzese CJ, Poulin S, Rehak R, Rennert-May E, Richards AJ, Rogers BA, Sahng E, Salada B, Scheuerman O, Schneider K, Schulz TR, Schwartz KL, Simos PA, Singh H, Sinkeler FS, Smith S, Smith BJ, Smith SW, Somayaji R, Sommerville C, Song RXJ, Sowden DC, Stark MJ, Stone NRH, Strunk T, Sud A, Swe KP, Symons CR, Tan YE, Ten Doesschate T, Thien SY, Thomas A, Trad MA, Tramontana AR, Tsang JLY, Ulett K, Underwood J, van Welzen BJ, Vazquez-Grande G, Velasquez Reyes DC, Verberk JDM, Voss LM, Ward D, Webb RH, Whitmore TJ, Wieder-Finesod A, Wilson HL, Wilson EW, Wong HM, Wong She K, Wuerz T, Yamamura DL, Yeoh A, Yow BLH, Dymock M, Mahar RK, McGlothlin A, Marsh JA, Davis JS, Tong SYC
- DOI
- 10.1056/NEJMoa2506905
- Record issued
- 2026-08-15
- Engine
- 7.39.0
- Exported
- 2026-09-22
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/b9f25c04-a7b4-4eca-b516-698b0d62431c is authoritative.
How this rating was calculated
- IntegrityIntegrity concern−0.5★
- StatisticsPrinted percentage does not match its own count (capped) ×6−0.25★
- ReportingData & code availability partially met−0.25★
- 01Printed percentage does not match its own count
14.5% does not match the reported count 94/671
“94/671 (14.5%)”
- 02Printed percentage does not match its own count
5% does not match the reported count 35/665
“35/665 (5.0%)”
- 03Printed percentage does not match its own count
14.5% does not match the reported count 94/671
“94/671 (14.5%)”
Primary Outcome - 90 Day Mortality, Ass…Find in source - 04Printed percentage does not match its own count
5% does not match the reported count 35/665
“35/665 (5.0%)”
Secondary Outcomes, Intravenous cathete…Find in source - 05Printed percentage does not match its own count
13.9% does not match the reported count 96/671
“96 (13.9)”
Table 1 - 06Printed percentage does not match its own count
14.3% does not match the reported count 93/670
“93 (14.3)”
Table 1
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted randomized clinical trial with a clear scientific premise, rigorous design, and transparent reporting. The main weakness is the vague data availability statement and lack of code sharing, which limits reproducibility. Minor copyedit issues and a minor internal date discrepancy do not affect the scientific integrity.
Both reviewers agreed on study type (interventional) and on all dimension statuses except minor checklist-level differences (power analysis, software identification) that do not change the overall status. The statistics verification component could not recompute any of the 6 tests (likely due to Bayesian credible intervals), so no statistical errors were confirmed; this is not a deficiency. The citation check found no retracted or non-existent references.
Numerical inconsistencies
2 findings · worst mediumValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Printed percentage does not match its own countRecomputed
- Internal contradictions in the reported numbersAssessed
6 printed percentages that do not match their own count.
- PERCENT14.5% does not match the reported count 94/671
“94/671 (14.5%)”
- PERCENT5% does not match the reported count 35/665
“35/665 (5.0%)”
- PERCENT14.5% does not match the reported count 94/671
“94/671 (14.5%)”
Primary Outcome - 90 Day Mortality, Ass…Find in source - PERCENT5% does not match the reported count 35/665
“35/665 (5.0%)”
Secondary Outcomes, Intravenous cathete…Find in source - PERCENT13.9% does not match the reported count 96/671
“96 (13.9)”
Table 1 - PERCENT14.3% does not match the reported count 93/670
“93 (14.3)”
Table 1
- lowinternal contradictionThe abstract states the trial was conducted between February 17, 2022, and August 7, 2024, while the methods state recruitment between February 17, 2022, and June 21, 2024. These are different end dates, but the abstract refers to the date of non-inferiority being met, not the recruitment end.
This trial domain was conducted between February 17, 2022, and August 7, 2024, at which time non-inferiority was met. ... Participants in this domain and silo were recruited between February 17, 2022, and June 21, 2024
Abstractreviewer’s wording
Overstated conclusions
1 finding · worst lowConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Conclusions only partially backed by the presented evidenceAssessed
5 major claims checked against the paper's own evidence: 3 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewers 1, 2Cefazolin may reduce mortality compared to (flu)cloxacillin.The probability of superiority is 89.8% for the primary outcome, which is suggestive but not conclusive; the authors appropriately use 'may'.Evidence: Probability of superiority 89.8% for primary outcome; higher probabilities at earlier time points.
“These data also suggest that cefazolin may reduce mortality, with an estimated probability of superiority of 94–99% at days 14, 28, and 42 which remained approximately 90% by day 90.”
DiscussionFind in source - partialReviewer 1The mortality and nephrotoxicity findings may apply to other antistaphylococcal penicillins.The authors extrapolate from flucloxacillin/cloxacillin to other penicillins based on similar structure and activity, but this is an inference not directly tested.Evidence: Discussion states other antistaphylococcal penicillins have similar antibacterial activity and chemical structures.
“Therefore, the mortality and nephrotoxicity findings reported here may apply to other antistaphylococcal penicillins other than (flu)cloxacillin.”
DiscussionFind in source - partialReviewer 2The findings may apply to other antistaphylococcal penicillins.The paper extrapolates from flucloxacillin/cloxacillin to other penicillins based on similar structure and activity, but this is an inference not directly tested.Evidence: Discussion states 'other antistaphylococcal penicillins have similar antibacterial activity and chemical structures'.
“While we used flucloxacillin and cloxacillin in this trial, other antistaphylococcal penicillins have similar antibacterial activity and chemical structures, and based on observational data are likely to confer a similar risk of nephrotoxicity or treatment discontinuation for adverse events when compared to cefazolin.”
DiscussionFind in source - supportedReviewers 1, 2Cefazolin was non-inferior to (flu)cloxacillin for 90-day mortality.The primary outcome analysis shows a posterior probability of non-inferiority of 99.2%, exceeding the pre-specified threshold.Evidence: Primary outcome: 97/645 (15.0%) vs 109/642 (17.0%), aOR 0.81 (95% CrI 0.59-1.12), probability of non-inferiority 99.2%.
“Death at 90 days amongst evaluable adults was 15.0% (97/645) for cefazolin and 17.0% (109/642) for (flu)cloxacillin (aOR 0.81; 95% Credible Interval [CrI], 0.59–1.12; probability of non-inferiority 99.2% and superiority 89.8%).”
AbstractFind in source - supportedReviewers 1, 2Cefazolin was associated with less acute kidney injury than (flu)cloxacillin.The secondary outcome shows a lower incidence of AKI with cefazolin, with a high posterior probability of superiority.Evidence: AKI occurred in 92/660 (13.9%) vs 127/648 (19.6%), aOR 0.67 (95% CrI 0.50-0.89), probability of superiority 99.7%.
“Acute kidney injury occurred in 92/660 (13.9%) patients in the cefazolin arm versus 127/648 (19.6%) in the (flu)cloxacillin arm (aOR 0.67, 95%CrI 0.50–0.89; probability of superiority 99.7%).”
AbstractFind in source
Efficacy claim is anchored to an adequate endpoint and a meaningful effect.
- ADEQUATESurrogate endpointThe primary outcome is 90-day all-cause mortality, a hard clinical outcome. The secondary outcome of acute kidney injury is also a clinical outcome, not a surrogate. Therefore, the efficacy claim is based on hard clinical outcomes.
“The primary outcome was 90-day all-cause mortality”
- ADEQUATEEffect sizeThe primary outcome shows a 15.0% mortality in cefazolin vs 17.0% in (flu)cloxacillin, with an adjusted odds ratio of 0.81 (95% CrI 0.59–1.12). The non-inferiority margin was pre-specified as an aOR <1.2, approximating a 2.5% absolute difference. The observed difference is within this margin, and the posterior probability of non-inferiority is 99.2%. The effect size is anchored to a clinically meaningful margin and is statistically supported.
“Death at 90 days amongst evaluable adults was 15.0% (97/645) for cefazolin and 17.0% (109/642) for (flu)cloxacillin (aOR 0.81; 95% Credible Interval [CrI], 0.59–1.12; probability of non-inferiority 99.2% and superiority 89.8%).”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
The introduction cites expert opinion favoring antistaphylococcal penicillins due to the cefazolin inoculum effect, and meta-analyses of observational studies suggesting cefazolin may be superior. The rationale for a randomized trial is clearly stated. Limitations of prior observational studies are acknowledged, and the trial design addresses them.
“Given observational analyses may be subject to multiple biases, a randomized clinical trial is the most reliable way to inform patient management.”
“However, meta-analyses of observational studies suggest that cefazolin could be superior in terms of 30-day mortality (odds ratio 0.73; 95%CI 0.62-0.85) with a more favorable adverse event profile when compared to antistaphylococcal penicillins.”
“Given observational analyses may be subject to multiple biases, a randomized clinical trial is the most reliable way to inform patient management.”
“Given observational analyses may be subject to multiple biases, a randomized clinical trial is the most reliable way to inform patient management.”
Randomization was 1:1 using a web-based system without stratification. The trial is open-label, which is acknowledged and justified. A power analysis is not explicitly reported, but the adaptive platform design with pre-specified stopping rules and simulations is described. Inclusion/exclusion criteria are detailed. The primary analysis uses intention-to-treat, and a protocol-adherent analysis is also performed. Missing data handling is described with complete case analysis and sensitivity analyses.
“All participants were randomized 1:1 within the MSSA silo at platform entry by simple randomization without stratification using a web-based interactive randomization system (Spiral Software, New Zealand).”
“For reasons of practicality and feasibility, this was an open-label trial; however, the primary outcome, all-cause mortality at 90 days, was objective and the decision criteria to stop the trial was based on pre-specified statistical rules.”
“Notable platform exclusions included enrollment beyond 72 hours from collection of the first positive blood culture, polymicrobial bacteremia, or patients not for active treatment.”
“All participants were randomized 1:1 within the MSSA silo at platform entry by simple randomization without stratification using a web-based interactive randomization system (Spiral Software, New Zealand).”
“For reasons of practicality and feasibility, this was an open-label trial; however, the primary outcome, all-cause mortality at 90 days, was objective and the decision criteria to stop the trial was based on pre-specified statistical rules.”
“Notable platform exclusions included enrollment beyond 72 hours from collection of the first positive blood culture, polymicrobial bacteremia, or patients not for active treatment. Key domain specific exclusions included an active history of penicillin or cefazolin allergy; current receipt of maintenance dialysis; and ongoing treatment with other systemic antibacterial agents with S. aureus activity.”
The paper reports sex, age, weight, and various comorbidities in Table 1. Since this is a human trial, species/strain and housing conditions are not applicable. Sex is reported for both groups, and both sexes are enrolled, so sex justification is not applicable.
“Female sex | 215 (32.0) | 206 (30.7)”
“Median age (IQR) | 66 (53−76) | 66 (52−77)”
“Diabetes mellitus | 231 (34.4) | 217 (32.4)”
“Median age (IQR) | 66 (53−76) | 66 (52−77) | | Female sex | 215 (32.0) | 206 (30.7) | | Median weight in kg (IQR) | 82.0 (69.0−96.8) | 80.0 (68.0−95.0)”
“Diabetes mellitus | 231 (34.4) | 217 (32.4) | | Chronic kidney disease , | 96 (13.9) | 93 (14.3)”
The paper states that ethics and regulatory approval were obtained at each participating center, and written or oral informed consent was obtained from all patients or surrogates. This satisfies the requirements for human research.
“Ethics and regulatory approval were obtained at each participating center.”
“Written or oral informed consent, in accordance with regional regulations, was obtained from all patients and/or their surrogates.”
“Ethics and regulatory approval were obtained at each participating center. Written or oral informed consent, in accordance with regional regulations, was obtained from all patients and/or their surrogates.”
Cefazolin and (flu)cloxacillin are named with dosing regimens. The randomization software (Spiral Software) is identified. Statistical software is not explicitly named, but the analysis team is described. Since this is a drug trial, bench resources are not applicable.
“using a web-based interactive randomization system (Spiral Software, New Zealand)”
“using a web-based interactive randomization system (Spiral Software, New Zealand)”
The primary analysis uses a hierarchical Bayesian logistic regression model, and the paper reports adjusted odds ratios with 95% credible intervals. No p-values are calculated, which is appropriate for the Bayesian framework. The paper reports effect sizes with credible intervals, satisfying the effect_sizes_ci criterion. Statistical software is not explicitly named, but the analysis team is described. Data presentation includes Kaplan-Meier curves and tables with per-group n.
“The adjusted odds ratio (aOR) for the primary outcome was calculated using a hierarchical Bayesian logistic regression model.”
“No P-values were calculated, and no adjustment for multiple analyses was pre-specified.”
“aOR 0.81; 95% CrI 0.59–1.12”
“The adjusted odds ratio (aOR) for the primary outcome was calculated using a hierarchical Bayesian logistic regression model.”
“aOR 0.81; 95% CrI 0.59–1.12”
“No P-values were calculated, and no adjustment for multiple analyses was pre-specified.”
The paper states that the master protocol and statistical analysis plan are available, but does not provide a clear data availability statement for the individual patient data. No repository deposit or accession numbers are provided. Custom code is not mentioned.
“The master protocol, statistical methods, domain specific appendix, and statistical analysis plan are available in the and the protocol at nejm.org (https://www.nejm.org/) .”
“The master protocol, statistical methods, domain specific appendix, and statistical analysis plan are available in the and the protocol at nejm.org (https://www.nejm.org/) .”
The trial is registered on ClinicalTrials.gov (NCT05137119). Methods are detailed enough for replication. Limitations are explicitly discussed, including open-label design and missing data. Conclusions are proportional to the evidence. Funding and conflicts of interest are disclosed.
“Clinicaltrials.gov NCT05137119”
“For reasons of practicality and feasibility, this was an open-label trial; however, the primary outcome, all-cause mortality at 90 days, was objective and the decision criteria to stop the trial was based on pre-specified statistical rules.”
“The SNAP trial was funded by the National Health and Medical Research Council (1184238, 2014900, 2032628) and Medical Research Future Fund (2017301) in Australia”
“Clinicaltrials.gov NCT05137119 (https://clinicaltrials.gov/study/NCT05137119)”
“For reasons of practicality and feasibility, this was an open-label trial; however, the primary outcome, all-cause mortality at 90 days, was objective and the decision criteria to stop the trial was based on pre-specified statistical rules.”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
None foundReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Checked — nothing surfaced.
Checked 19 references by DOI: 11 verified — 8 no DOI (shown, not verified).
- NO DOIStaphylococcus aureus bacteremia mortality: A systematic review and meta-analysisNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIInfective Endocarditis in Adults: Diagnosis, Antimicrobial Therapy, and Management of Complications: A Scientific Statement for Healthcare Professionals From the American Heart AssociationNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOI2023 ESC Guidelines for the management of endocarditis: Developed by the task force on the management of endocarditis of the European Society of Cardiology (ESC) Endorsed by the European Association for Cardio-Thoracic Surgery (EACTS) and the European Association of Nuclear Medicine (EANM)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIClinical implications of cefazolin inoculum effect and β-lactamase type on methicillin-susceptible Staphylococcus aureus bacteremiaNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOICefazolin versus Antistaphylococcal Penicillins for the Treatment of Methicillin-Susceptible Staphylococcus aureus Bacteremia: A Systematic Review and Meta-AnalysisNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIClinical practice guidelines by the Infectious Diseases Society of America for the treatment of methicillin-resistant Staphylococcus aureus infections in adults and children: executive summaryNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIRenal Failure and Interstitial Nephritis Due to Penicillin and MethicillinNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIThe New PenicillinsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
1 of 2 data/code links checked; 1 live; 1 not probed.
- datahttps://clinicaltrials.gov/study/NCT05137119LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://www.nejm.org/UNVERIFIEDHTTP 403Liveness indeterminate — content not checked.
Copyediting
5 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 5 minor suggestions below.
5 copyedit issues flagged: mostly consistency, clarity, typo.
- MINORtypoAbstract, Results“This trial domain was conducted between February 17, 2022, and August 7, 2024, at which time non-inferiority was met.”→ Consider rephrasing for clarity: 'This trial domain was conducted from February 17, 2022, to August 7, 2024, when non-inferiority was met.'Minor wording issue.
- MINORconsistencyMethods, Statistical Methods“No P-values were calculated”→ Ensure consistent capitalization of 'P-values' throughout the manuscript.Inconsistent capitalization of 'P'.
- MINORclarityDiscussion, Limitations“We donot believe post-randomization care would have been different”→ Change to 'We do not believe'.Missing space in 'donot'.
- MINORconsistencyMethods, Study Design and Setting“Participants in this domain and silo were recruited between February 17, 2022, and June 21, 2024, at 91 sites in 8 countries”→ Ensure consistent use of dates and site counts throughout.Date ranges differ between abstract and methods; verify consistency.
- MINORclarityMethods, Analyses“The primary analysis for the primary outcome excluded participants with missing 90-day mortality data (complete case analysis).”→ Clarify that this is a complete-case analysis and mention the proportion missing.The proportion missing is mentioned later; could be moved here for clarity.
The published work is robust and reliable for informing clinical practice, with minor reporting gaps that do not undermine the conclusions. An informed reader should weigh the open-label design and the lack of a detailed data availability statement, but these are not validity threats. No erratum is warranted for the minor date discrepancy, but the authors should consider clarifying the data access mechanism.
- 1.HIGHdata codeAdd a clear data availability statement in the Methods or a dedicated section specifying how individual patient data can be accessed, including any managed access process or data access committee.The current statement is vague and does not provide a mechanism for accessing de-identified data, which is a key reproducibility gap.
- 2.HIGHdata codeProvide accession numbers or repository links for the statistical analysis code and any de-identified datasets, if permissible, to enhance reproducibility.Sharing code and data in a public repository would allow independent verification of the Bayesian analyses.
- 3.MEDIUMstatisticsExplicitly name the statistical software and version used for the Bayesian analysis (e.g., R, Stan) in the Statistical Methods section.Identifying the software is part of standard reporting and aids reproducibility.
- 4.MEDIUMreportingMention adherence to a reporting guideline such as CONSORT in the Methods or as a supplementary file.Referencing CONSORT improves transparency and completeness of reporting for randomized trials.
- 5.MEDIUMreportingClarify the power analysis or sample size determination, even if based on simulations, to address the 'power_analysis' sub-criterion more fully.A clear statement of how the sample size was determined helps readers assess the trial's ability to detect meaningful differences.
- 6.MEDIUMcopyeditReconcile the date discrepancy between the abstract (August 7, 2024) and the methods (June 21, 2024) by clarifying that the abstract refers to the date non-inferiority was met, not the recruitment end.The current wording could confuse readers about the trial timeline.
- 7.LOWcopyeditFix the typo 'donot' to 'do not' in the Discussion, Limitations section.Correcting typos improves professionalism and readability.
- 8.LOWcopyeditEnsure consistent capitalization of 'P-values' throughout the manuscript.Consistency in terminology is a minor but expected standard in scientific writing.
- 9.LOWcopyeditRephrase the abstract sentence 'This trial domain was conducted between February 17, 2022, and August 7, 2024, at which time non-inferiority was met.' for clarity.The current phrasing is awkward and could be misinterpreted.
- 10.LOWcopyeditClarify in the Methods, Analyses section that the primary analysis is a complete-case analysis and mention the proportion of missing data.Moving the missing-data proportion to the methods improves clarity and transparency.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.