Oral Nirmatrelvir-Ritonavir as Postexposure Prophylaxis for Covid-19.
Hammond J, Yunis C, Fountaine RJ, Luscan G, Burr AM, Zhang W, Wisemandle W, Soares H, Baniecki ML, Hendrick VM, Kalfov V, Pypstra R, Rusnak JM
- DOI
- 10.1056/NEJMoa2309002
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-22
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/5f4a54fe-fb2d-4611-8d20-040c526b6da3 is authoritative.
How this rating was calculated
- IntegrityIntegrity concern−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- ReportingData & code availability partially met−0.25★
- CitationsUnresolved reference−0.25★
- 01Treatment effect not shown to be clinically meaningful
The primary endpoint was not met; the observed risk reductions were not statistically significant (29.8% and 35.5% with P=0.17 and P=0.12, respectively). The effect size is not anchored to a clinically meaningful threshold and is not statistically supported.
“In each nirmatrelvir–ritonavir group, the percentage of participants in whom symptomatic, confirmed SARS-CoV-2 infection developed did not differ significantly from that in the placebo group, with risk reductions relative to placebo of 29.8% (95% confidence…”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted phase 2-3 randomized controlled trial with rigorous design, clear reporting of demographics, and appropriate statistical methods. The main weaknesses are minor reporting gaps: the ethics approval details and informed consent are not fully described in the main text, and the data sharing statement is vague. A typographical error in Table 1 (543 (198) instead of 543 (19.8)) should be corrected.
This is an interventional clinical trial; both reviewers agreed on this classification. The evaluation covered all eight dimensions; species/strain, housing, and cell line criteria were not applicable. The statistics verification checked only 2 tests (both consistent), so the broader statistical analysis is not fully verified. The citation check found 1 reference not found in registry, which is a potential fabrication signal.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.
- CONSISTENTreported p = .170 · recomputed p = .117Reviewers 1, 2Primary endpoint risk reduction for 5-day group
“risk reductions relative to placebo of 29.8% (95% confidence interval [CI], –16.7 to 57.8; P=0.17)”
Taken as given: The risk reduction is 0.298 with 95% CI -0.167 to 0.578.; The CI is two-sided at 95%.; The p-value is two-tailed.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(0.298, -0.167, 0.578, 0) - CONSISTENTreported p = .120 · recomputed p = .061Reviewers 1, 2Primary endpoint risk reduction for 10-day group
“risk reductions relative to placebo of 35.5% (95% CI, –11.5 to 62.7; P=0.12)”
Taken as given: The risk reduction is 0.355 with 95% CI -0.115 to 0.627.; The CI is two-sided at 95%.; The p-value is two-tailed.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(0.355, -0.115, 0.627, 0)
- lowinternal contradictionIn Table 1, the total for cigarette smoking is reported as 543 (198), which appears to be a typographical error; the percentage should be 19.8%.
“Cigarette smoking | 178 (19.3) | 189 (20.6) | 176 (19.6) | 543 (198)”
Table 1Find in source
Overstated conclusions
1 finding · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Treatment effect not shown to be clinically meaningfulAssessed
3 major claims checked against the paper's own evidence: all adequately supported.
- supportedReviewers 1, 2Postexposure prophylaxis with nirmatrelvir-ritonavir for 5 or 10 days did not significantly reduce the risk of symptomatic SARS-CoV-2 infection.The primary endpoint analysis shows no significant difference between treatment groups and placebo, with p-values of 0.17 and 0.12.Evidence: Primary endpoint results: 2.6% vs 3.9% (5-day vs placebo), 2.4% vs 3.9% (10-day vs placebo), with risk reductions of 29.8% and 35.5% and p-values 0.17 and 0.12.
“postexposure prophylaxis with nirmatrelvir–ritonavir for 5 or 10 days did not significantly reduce the risk of symptomatic SARS-CoV-2 infection.”
AbstractFind in source - supportedReviewers 1, 2The incidence of adverse events was similar across the trial groups.Adverse event rates were 23.9%, 23.3%, and 21.7% across groups, which are similar.Evidence: Table 3 shows adverse event rates of 23.9%, 23.3%, and 21.7% for the 5-day, 10-day, and placebo groups, respectively.
“The incidence of adverse events during the trial period was similar in the 5-day and 10-day nirmatrelvir–ritonavir groups and the placebo group (21.7 to 23.9% across trial groups)”
ResultsFind in source - supportedReviewers 1, 2The trial was powered to detect a 70% reduction in risk.The paper states this in the Discussion, and the observed risk reductions were smaller, explaining the lack of significance.Evidence: Discussion states: 'The trial was powered to detect a 70% reduction in the risk of development of symptomatic, RT-PCR– or rapid antigen test–confirmed SARS-CoV-2 infection through day 14 relative to placebo.'
“The trial was powered to detect a 70% reduction in the risk of development of symptomatic, RT-PCR– or rapid antigen test–confirmed SARS-CoV-2 infection through day 14 relative to placebo”
DiscussionFind in source
Premise concern: effect size not shown to be clinically meaningful.
- N/ASurrogate endpointThe primary endpoint is a hard clinical outcome: development of symptomatic, RT-PCR- or rapid antigen test-confirmed SARS-CoV-2 infection through day 14. This is a clinical event, not a surrogate.
“The primary end point was the development of symptomatic SARS-CoV-2 infection, confirmed on reverse-transcriptase–polymerase-chain-reaction (RT-PCR) or rapid antigen testing, through day 14”
- INADEQUATEEffect sizeThe primary endpoint was not met; the observed risk reductions were not statistically significant (29.8% and 35.5% with P=0.17 and P=0.12, respectively). The effect size is not anchored to a clinically meaningful threshold and is not statistically supported.
“In each nirmatrelvir–ritonavir group, the percentage of participants in whom symptomatic, confirmed SARS-CoV-2 infection developed did not differ significantly from that in the placebo group, with risk reductions relative to placebo of 29.8% (95% confidence interval [CI], –16.7 to 57.8; P=0.17) in the 5-day nirmatrelvir–ritonavir group and 35.5% (95% CI, –11.5 to 62.7; P=0.12) in the 10-day nirmatrelvir–ritonavir group.”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
The introduction cites prior studies on household transmission rates, the ineffectiveness of existing prophylactic measures, and the failure of previous trials (e.g., molnupiravir) to show benefit. It also references the EPIC-HR trial for nirmatrelvir's efficacy in treatment. The rationale for the study is logically derived from these gaps. Limitations of prior research are implicitly addressed by the trial's design, though not explicitly discussed in the introduction.
“To date, clinical trials of Covid-19 treatments, including a phase 3 trial of molnupiravir, have not shown a significant benefit of postexposure prophylaxis.”
“To date, clinical trials of Covid-19 treatments, including a phase 3 trial of molnupiravir, have not shown a significant benefit of postexposure prophylaxis.”
Randomization method is described as 1:1:1 ratio with stratification by risk factors and geographic region. Blinding is double-blind with matching placebo. The primary efficacy population is clearly defined. Power analysis is mentioned but details are relegated to the supplementary appendix. Inclusion/exclusion criteria are described. Outlier handling is not explicitly discussed, but the analysis population and missing data imputation for viral load are specified.
“Randomization was stratified according to the presence of risk factors associated with severe Covid-19 and geographic region”
“This phase 2–3, double-blind, randomized, placebo-controlled trial”
“Randomization was stratified according to the presence of risk factors associated with severe Covid-19 and geographic region”
“This phase 2–3, double-blind, randomized, placebo-controlled trial”
Sex is reported for all participants. Age is reported as mean and median with ranges. Demographics include race/ethnicity and geographic region. Health status is captured via risk factors and serology status. Species/strain and housing conditions are not applicable for a human trial.
The trial is registered at ClinicalTrials.gov (NCT05047601). The paper mentions ethical trial conduct in the supplementary appendix but does not name the approving ethics committee in the main text. Informed consent is implied but not explicitly described. Regulatory compliance is not explicitly stated in the main text.
“ClinicalTrials.gov number, NCT05047601”
“ethical trial conduct”
“ClinicalTrials.gov number, NCT05047601”
The drug is named with manufacturer (Pfizer) and dose (300 mg nirmatrelvir and 100 mg ritonavir). The placebo is described as matching capsules. Statistical software is not explicitly named in the main text, but the statistical methods are described. No antibodies, cell lines, or other biological reagents are used.
“receive 300 mg of nirmatrelvir and 100 mg of ritonavir for 5 days”
“receive 300 mg of nirmatrelvir and 100 mg of ritonavir for 5 days”
“matching placebo capsules (consisting of inactive filler ingredients)”
The primary analysis uses a generalized estimating equation with compound symmetry to account for clustering. Risk reductions are reported with 95% CIs and exact p-values. The Hochberg method is used for multiplicity adjustment. Assumptions are not explicitly verified but the methods are standard. Data presentation includes per-group n and percentages. Mathematical plausibility checks are not applicable due to large N and continuous outcomes.
“A generalized estimating equation with compound symmetry variance–covariance structure was used to account for clustering.”
“risk reductions relative to placebo of 29.8% (95% confidence interval [CI], –16.7 to 57.8; P=0.17)”
“A generalized estimating equation with compound symmetry variance–covariance structure was used to account for clustering.”
“risk reductions relative to placebo of 29.8% (95% confidence interval [CI], –16.7 to 57.8; P=0.17)”
The paper mentions a 'Data Sharing Statement' but does not provide details in the main text. No repository deposit or accession numbers are given. Code sharing is not applicable as no custom code is described.
“Data Sharing Statement A provided by the authors is available with the full text of this article at NEJM.org.”
“Data Sharing Statement A provided by the authors is available with the full text of this article at NEJM.org.”
The trial is registered (NCT05047601). Methods are detailed enough for replication. All outcomes are reported, including negative results. Limitations are discussed in the Discussion. Conclusions are proportional to the evidence. Funding and conflicts of interest are disclosed.
“ClinicalTrials.gov number, NCT05047601”
“Given the distinctive taste of nirmatrelvir–ritonavir, participants may have suspected that they were receiving active medication, which may have limited the effectiveness of the blinding.”
“ClinicalTrials.gov number, NCT05047601”
“Given the distinctive taste of nirmatrelvir–ritonavir, participants may have suspected that they were receiving active medication, which may have limited the effectiveness of the blinding.”
Registered (4 IDs: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
1 finding · worst lowReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
- References not resolvable to a published paperRecomputed
Checked 31 references by DOI: 7 verified — 1 DOI unresolved, 23 no DOI (shown, not verified).
- UNRESOLVED10.1016/s2214-109x(20Concerns about bivalent COVID-19 vaccine and reasons for non-vaccination among adults who completed a primary series — Omnibus survey, March 10–April 30, 2023 & Household Pulse Survey, March 1–April 10, 2023Cited DOI does not resolve to any Crossref record.
- NO DOIContact settings and risk for transmission in 3410 close contacts of patients with Covid-19 in Guangzhou, China: a prospective cohort studyNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIContact tracing during coronavirus disease outbreak, South Korea, 2020No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIRisk factors associated with COVID-19 infection: a retrospective cohort study based on contacts tracingNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOISARS-CoV-2 B.1.617.2 (delta) variant COVID-19 outbreak associated with a gymnastics facility — Oklahoma, April–May 2021No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIHousehold secondary attack rates of SARS-CoV-2 by variant and vaccination status: an updated systematic review and meta-analysisNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOISARS-CoV-2 secondary attack rates in vaccinated and unvaccinated household contacts during replacement of delta with omicron variant, SpainNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFeasibility of controlling COVID-19 outbreaks by isolation of cases and contactsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOISafety and efficacy of the BNT162b2 mRNA Covid-19 vaccine through 6 monthsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOImRNA-1273 COVID-19 vaccine effectiveness against the B.1.1.7 and B.1.351 variants and severe COVID-19 disease in QatarNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOICOVID-19 booster dose vaccination coverage and factors associated with booster vaccination among adults, United States, March 2022No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIResponse to additional COVID-19 vaccine doses in people who are immunocompromised: a rapid reviewNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIUpdate on community-acquired bacterial meningitis: guidance and challengesNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIClinical practice guidelines by the Infectious Diseases Society of America: 2018 update on diagnosis, treatment, chemoprophylaxis, and institutional outbreak management of seasonal influenzaNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIAn oral SARS-CoV-2 M pro inhibitor clinical candidate for the treatment of COVID-19No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA briefing document: drug name: nirmatrelvir tablets and ritonavir tablets copackaged for oral useNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOINirmatrelvir for vaccinated or unvaccinated adult outpatients with Covid-19No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIA systematic review and meta-analysis of geographic differences in comorbidities and associated severity and mortality among individuals with COVID-19No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIControlling the false discovery rate: a practical and powerful approach to multiple testingNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOICoronavirus disease 2019 (COVID-19) treatment guidelinesNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA announces bebtelovimab is not currently authorized in any US regionNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA announces Evusheld is not currently authorized for emergency use in the U.S.No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIUpdated US infection- and vaccine-induced SARS-CoV-2 seroprevalence estimates based on blood donations, July 2020–December 2021No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIA study to learn about the medicine called nirmatrelvir used in combination with ritonavir in people with weakened immune systems or at increased risk for poor outcomes who are hospitalized due to severe COVID-19 (EPIC-HOS)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
4 data/code links checked; 4 live.
- datahttp://clinicaltrials.gov/show/NCT05047601LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttp://clinicaltrials.gov/show/NCT05011513LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttp://clinicaltrials.gov/show/NCT04960202LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://www.clinicaltrials.gov/ct2/show/NCT05545319LIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
5 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 5 minor suggestions below.
5 copyedit issues flagged: mostly consistency, grammar, clarity.
- MINORconsistencyTable 1, footnote“543 (198)”→ 543 (19.8)Percentage appears to be missing a decimal point.
- MINORclarityMethods, Statistical Analysis“A generalized estimating equation with compound symmetry variance–covariance structure was used to account for clustering.”→ Clarify what clustering variable was used (e.g., household).The clustering variable is not explicitly stated.
- MINORgrammarDiscussion“It is also important to consider whether the design of postexposure prophylaxis trials should address whether the treatment of the index patient reduces the incidence of household transmission.”→ Consider rephrasing for clarity.The sentence is awkwardly constructed.
- MINORconsistencyTable 1, footnote“Cigarette smoking | 178 (19.3) | 189 (20.6) | 176 (19.6) | 543 (198)”→ The total percentage appears to be a typo; should be 19.8% (543/2736).The percentage for the total column is likely a typographical error.
- MINORgrammarDiscussion“A particular strength of this trial is that it included participants from diverse age groups and geographical locations, a factor that enables broad generalizability of the results.”→ Consider rephrasing to avoid a dangling modifier.The sentence structure could be improved for clarity.
The published work is methodologically robust, but an informed reader should weigh the minor reporting gaps in ethics and data sharing, and the typographical error in Table 1. The unresolved reference in the bibliography warrants verification. No major validity threats were identified, but a correction or erratum for the Table 1 typo and a clarification of the data sharing mechanism would strengthen the record.
- 1.HIGHcopyeditCorrect the typographical error in Table 1 footnote: change '543 (198)' to '543 (19.8)' for the cigarette smoking total percentage.The percentage is mathematically impossible as written and could be misread as a data error.
- 2.HIGHethicsIn the Methods section, explicitly name the institutional review board or ethics committee that approved the trial and include the approval/protocol number.The main text currently only mentions ethical conduct in the supplementary appendix, which is insufficient for transparency.
- 3.HIGHethicsIn the Methods section, explicitly describe the informed consent process (e.g., written informed consent obtained from all participants).Informed consent is a fundamental ethical requirement and is not currently described in the main text.
- 4.HIGHdata codeIn the Data Availability section, provide a concrete data access mechanism, such as a managed-access platform or data-sharing committee, with conditions and timeframe.The current statement is vague and does not allow readers to know how to request data.
- 5.HIGHotherVerify or correct the reference 'Concerns about bivalent COVID-19 vaccine and reasons for non-vaccination among adults who completed a primary series — Omnibus survey, March 10–April 30, 2023 & Household Pulse Survey, March 1–April 10, 2023' (DOI 10.1016/s2214-109x(20) which was not found in the registry.A reference that cannot be found in any registry may be fabricated or contain an incorrect DOI, which is a serious integrity concern.
- 6.MEDIUMstatisticsIn the Methods, Statistical Analysis section, explicitly state the clustering variable used in the GEE (e.g., household).The copyedit flagged that the clustering variable is not stated, which is important for understanding the analysis.
- 7.MEDIUMstatisticsIn the Methods, identify the statistical software used (e.g., SAS version 9.4) to improve reproducibility.Naming the software is a standard reproducibility requirement and is currently missing.
- 8.MEDIUMreportingIn the Methods, provide the full sample-size calculation details, including assumed event rates, power, and alpha, in the main text or clearly reference the supplementary appendix.Readers need these details to assess the trial's sensitivity and power.
- 9.MEDIUMreportingIn the Discussion, explicitly state adherence to CONSORT reporting guidelines.Explicitly referencing the guideline enhances transparency and demonstrates compliance.
- 10.MEDIUMreportingIn the Methods, describe the blinding procedures in more detail, including who was blinded and how allocation concealment was maintained.The current description is brief and could be strengthened for reproducibility.
- 11.MEDIUMreportingIn the Methods, explicitly state how outliers were handled in the analysis, or note that no outliers were excluded.Outlier handling is a common reviewer concern and is currently not addressed.
- 12.LOWcopyeditRephrase the awkward sentence in the Discussion: 'It is also important to consider whether the design of postexposure prophylaxis trials should address whether the treatment of the index patient reduces the incidence of household transmission.'The sentence is grammatically awkward and could be clearer.
- 13.LOWcopyeditRephrase the sentence in the Discussion to avoid a dangling modifier: 'A particular strength of this trial is that it included participants from diverse age groups and geographical locations, a factor that enables broad generalizability of the results.'The sentence structure could be improved for clarity.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.