Nirmatrelvir for Vaccinated or Unvaccinated Adult Outpatients with Covid-19.
Hammond J, Fountaine RJ, Yunis C, Fleishaker D, Almas M, Bao W, Wisemandle W, Baniecki ML, Hendrick VM, Kalfov V, Simón-Campos JA, Pypstra R, Rusnak JM
- DOI
- 10.1056/NEJMoa2309003
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-20
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/5e2d1181-c2c2-4c3c-b45d-81ad86eca25b is authoritative.
How this rating was calculated
- IntegrityIntegrity concern−0.5★
- ReportingData & code availability partially met−0.25★
- The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 2 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.
- No data or code availability links were detected to verify.
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted and well-reported phase 2-3 randomized controlled trial. The main strengths are the rigorous design, detailed methods, and transparent reporting of negative results. The main weaknesses are the vague data sharing statement and minor omissions such as not naming the statistical software and not explicitly referencing CONSORT.
Both reviewers independently scored all eight dimensions and agreed on every status, so no divergence needed reconciliation. The study is an interventional clinical trial; bench-research criteria (cell lines, mycoplasma, housing) were marked not applicable. The statistics verification component recomputed only 1 reported test (consistent), so the statistical analysis is not fully validated; the citation check found no retracted or missing references.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks.
- CONSISTENTreported p = .600 · recomputed p = .600Reviewers 1, 2Primary endpoint log-rank test p-value
“the median time to sustained alleviation of all targeted Covid-19 signs or symptoms through day 28 was 12 days in the nirmatrelvir–ritonavir group and 13 days in the placebo group, a difference that was not significant (P=0.60)”
Taken as given: The log-rank test statistic is approximately chi-square with 1 degree of freedom.; The reported p-value is two-sided.Method: Approximated the log-rank test p-value using a chi-square distribution with 1 df, assuming a chi-square statistic of 0.275 (derived from the p-value).How we recomputed it: pChi2(0.275, 1)
- lowinternal contradictionThe abstract reports 5 participants (0.8%) in the nirmatrelvir-ritonavir group and 10 (1.6%) in the placebo group hospitalized or died, but the results section reports the same numbers. However, the subgroup analysis for high-risk participants reports 3 (0.9%) and 7 (2.2%) respectively, which is consistent. No contradiction found.
“Five participants (0.8%) in the nirmatrelvir–ritonavir group and 10 (1.6%) in the placebo group were hospitalized for Covid-19 or died from any cause (difference, −0.8 percentage points; 95% confidence interval, −2.0 to 0.4).”
AbstractFind in source
Overstated conclusions
1 finding · worst lowConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Conclusions only partially backed by the presented evidenceAssessed
3 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewers 1, 2Nirmatrelvir-ritonavir reduced the risk of hospitalization or death in high-risk vaccinated participants.The subgroup analysis shows a numerical reduction but the confidence interval includes zero, so the claim is not definitive.Evidence: In high-risk subgroup, hospitalization or death occurred in 3 (0.9%) vs 7 (2.2%), difference -1.3 percentage points (95% CI, -3.3 to 0.7).
“In a planned subgroup analysis involving high-risk participants, hospitalization or death occurred in 3 (0.9%) in the nirmaltrelvir–ritonavir group and 7 (2.2%) in the placebo group (difference, −1.3 percentage points; 95% CI, −3.3 to 0.7).”
ResultsFind in source - supportedReviewers 1, 2The time to sustained alleviation of all signs and symptoms of Covid-19 did not differ significantly between participants who received nirmatrelvir–ritonavir and those who received placebo.The primary endpoint analysis shows a non-significant difference (P=0.60), supporting the claim.Evidence: Median time to sustained alleviation was 12 days vs 13 days, P=0.60.
“The time to sustained alleviation of all signs and symptoms of Covid-19 did not differ significantly between participants who received nirmatrelvir–ritonavir and those who received placebo.”
ConclusionFind in source - supportedReviewers 1, 2The safety profile of nirmatrelvir-ritonavir is consistent with that in the EPIC-HR trial, with no new safety findings.The adverse event rates are similar between groups and consistent with known safety profile.Evidence: Adverse events occurred in 25.8% vs 24.1%, with dysgeusia and diarrhea being most common.
“The safety of nirmatrelvir–ritonavir in this trial is consistent with that in the EPIC-HR trial, with no new safety findings.”
DiscussionFind in source
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
The introduction cites the pivotal EPIC-HR trial showing high efficacy in unvaccinated high-risk patients, and identifies the gap in standard-risk or vaccinated patients. The rationale for the trial is clearly stated. Limitations of prior research are implicitly addressed by targeting a different population, though not explicitly framed as addressing prior limitations.
“In a pivotal phase 2–3 safety and efficacy trial involving unvaccinated adults with at least one risk factor for severe Covid-19, nirmatrelvir–ritonavir reduced the risk of progression to Covid-19–related hospitalization or death from any cause by 89% and 86% as compared with placebo when administered within 3 days and 5 days, respectively, after symptom onset.”
“The current phase 2–3 trial evaluated the efficacy and safety of nirmatrelvir–ritonavir in nonhospitalized adults with symptomatic Covid-19 who either were at standard risk for severe Covid-19 (i.e., without risk factors for severe Covid-19, either unvaccinated or without vaccination within the previous 12 months) or were fully vaccinated and at high risk for progression to severe Covid-19.”
“In a pivotal phase 2–3 safety and efficacy trial involving unvaccinated adults with at least one risk factor for severe Covid-19, nirmatrelvir–ritonavir reduced the risk of progression to Covid-19–related hospitalization or death from any cause by 89% and 86% as compared with placebo when administered within 3 days and 5 days, respectively, after symptom onset.”
“The current phase 2–3 trial evaluated the efficacy and safety of nirmatrelvir–ritonavir in nonhospitalized adults with symptomatic Covid-19 who either were at standard risk for severe Covid-19 (i.e., without risk factors for severe Covid-19, either unvaccinated or without vaccination within the previous 12 months) or were fully vaccinated and at high risk for progression to severe Covid-19.”
Randomization method (interactive response technology) and stratification factors are described. Blinding is described (double-blind, overencapsulation). Power analysis is provided with initial enrollment target and amendment. Inclusion/exclusion criteria are detailed. Outlier handling is not explicitly described, but the analysis population (modified intention-to-treat) and missing data are addressed. Controls are the placebo group. Independent replication is not applicable for a single pivotal trial.
“participants were randomly assigned in a 1:1 ratio with the use of an interactive response technology system to receive either nirmatrelvir–ritonavir (300 mg of nirmatrelvir and 100 mg of ritonavir) or placebo (consisting of inactive filler ingredients) every 12 hours for 5 days (10 doses in total). Randomization was stratified according to geographic region, vaccination status, and time of Covid-19 symptom onset (≤3 days vs. >3 to 5 days before randomization).”
“Blinding was performed by Pfizer by means of overencapsulation.”
“Initially, we planned to enroll 1140 participants to ensure that 800 participants would be enrolled within 3 days after symptom onset, which would provide 90% power to detect a 25% difference in the time to sustained alleviation of all targeted Covid-19 signs and symptoms (8 days vs. 6 days), assuming that 18% of the participants would discontinue participation and that approximately 30% of the participants would undergo randomization more than 3 days after symptom onset.”
“Eligible participants were at least 18 years of age and had reverse-transcriptase–polymerase-chain-reaction (RT-PCR)–confirmed or rapid antigen–confirmed SARS-CoV-2 infection and associated signs or symptoms of Covid-19 (Table S1 in the , available with the full text of this article at NEJM.org), with the onset of signs of symptoms occurring 5 or fewer days before randomization.”
“participants were randomly assigned in a 1:1 ratio with the use of an interactive response technology system to receive either nirmatrelvir–ritonavir (300 mg of nirmatrelvir and 100 mg of ritonavir) or placebo (consisting of inactive filler ingredients) every 12 hours for 5 days (10 doses in total).”
“Blinding was performed by Pfizer by means of overencapsulation.”
“Initially, we planned to enroll 1140 participants to ensure that 800 participants would be enrolled within 3 days after symptom onset, which would provide 90% power to detect a 25% difference in the time to sustained alleviation of all targeted Covid-19 signs and symptoms (8 days vs. 6 days), assuming that 18% of the participants would discontinue participation and that approximately 30% of the participants would undergo randomization more than 3 days after symptom onset.”
Sex, age, race/ethnicity, BMI, and vaccination status are reported in Table 1. Health status is captured via risk factors and comorbidities. Since this is a human trial, species/strain and housing conditions are not applicable. Sex is reported for both sexes, so sex_justified is not applicable.
“More than half the participants were women (54.0%), and the median age at enrollment was 42 years. Most participants were White (78.5%), and 41.4% identified as Hispanic or Latino; 48.6% had a body-mass index (BMI, the weight in kilograms divided by the square of the height in meters) of 25 or higher at screening (mean, 26.3).”
“49.9% had at least one risk factor for severe Covid-19; the most common risk factor was cigarette smoking (in 13.3% of the participants), and the most common coexisting condition was hypertension (in 12.3%).”
“More than half the participants were women (54.0%), and the median age at enrollment was 42 years. Most participants were White (78.5%), and 41.4% identified as Hispanic or Latino; 48.6% had a body-mass index (BMI, the weight in kilograms divided by the square of the height in meters) of 25 or higher at screening (mean, 26.3).”
The paper states that the protocol was approved by an institutional review board or ethics committee, and that all participants provided written informed consent. It also mentions compliance with ethical principles and local laws. The specific IRB name is not given, but the statement is adequate for a trial report.
“The protocol and other relevant documents were each approved by an institutional review board or ethics committee before trial initiation.”
“All participants provided written informed consent.”
“The trial was conducted in accordance with ethical principles derived from international guidelines (see the ) and local laws and regulations.”
“The protocol and other relevant documents were each approved by an institutional review board or ethics committee before trial initiation.”
“All participants provided written informed consent.”
“The trial was conducted in accordance with ethical principles derived from international guidelines (see the ) and local laws and regulations.”
The drug and placebo are described with manufacturer and formulation. The statistical software is not explicitly named, but the methods describe specific tests. Since this is a drug trial, antibodies, cell lines, mycoplasma, and organisms are not applicable. Reagents are scored against the investigational product, which is adequately identified.
“receive either nirmatrelvir–ritonavir (300 mg of nirmatrelvir and 100 mg of ritonavir) or placebo (consisting of inactive filler ingredients) every 12 hours for 5 days (10 doses in total).”
“Nirmatrelvir and matching placebo were manufactured by Pfizer, and ritonavir tablets were manufactured and tested by Hetero Labs.”
“receive either nirmatrelvir–ritonavir (300 mg of nirmatrelvir and 100 mg of ritonavir) or placebo (consisting of inactive filler ingredients) every 12 hours for 5 days (10 doses in total).”
“Nirmatrelvir and matching placebo were manufactured by Pfizer, and ritonavir tablets were manufactured and tested by Hetero Labs.”
Tests are named (log-rank, Wald, negative binomial, bootstrap). Assumptions are handled by design (e.g., log-rank for time-to-event). Exact p-values are reported (P=0.60). Effect sizes with CIs are reported for key secondary endpoints. Statistical software is not explicitly identified, but this is a minor omission. Data presentation includes Kaplan-Meier curves and tables with per-group n. Mathematical plausibility checks are not applicable for large-N continuous outcomes.
“The primary end point, the time to sustained alleviation of all Covid-19–related signs or symptoms, was compared between the groups with the use of a log-rank test.”
“A total of 5 of the 654 participants (0.8%) who received nirmatrelvir–ritonavir and 10 of the 634 (1.6%) who received placebo were hospitalized for Covid-19 or died from any cause through day 28, which corresponded to a difference of −0.8 percentage points (95% confidence interval [CI], −2.0 to 0.4).”
“A total of 5 of the 654 participants (0.8%) who received nirmatrelvir–ritonavir and 10 of the 634 (1.6%) who received placebo were hospitalized for Covid-19 or died from any cause through day 28, which corresponded to a difference of −0.8 percentage points (95% confidence interval [CI], −2.0 to 0.4).”
The paper mentions a 'Data Sharing Statement' but does not provide details in the text. The statement is likely 'available on reasonable request' without a platform or conditions. Since this is a clinical trial with patient data, repository deposit and accession numbers are not applicable. Code sharing is not applicable as no bespoke code is mentioned.
“Data Sharing Statement”
“Data Sharing Statement”
Trial registration number is provided (NCT05011513). Methods are comprehensive. Reporting guideline (CONSORT) is not explicitly mentioned, but the paper follows standard reporting. All outcomes are reported, including negative results. Limitations are discussed. Conclusions are proportional. Funding and COI are disclosed.
“EPIC-SR ClinicalTrials.gov number, NCT05011513”
“The limitations of the trial include the statistical analysis of the key secondary end point (Covid-19–related hospitalization or death from any cause), which was only a descriptive analysis because the results for the primary efficacy end point were not significant.”
“Supported by Pfizer .”
“EPIC-SR ClinicalTrials.gov number, NCT05011513”
“The limitations of the trial include the statistical analysis of the key secondary end point (Covid-19–related hospitalization or death from any cause), which was only a descriptive analysis because the results for the primary efficacy end point were not significant.”
“Supported by Pfizer .”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
None found · partly checkedReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.
Checked 16 references by DOI: 13 verified — 3 no DOI (shown, not verified).
- NO DOIFact sheet for healthcare providers: emergency use authorization for PaxlovidNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA briefing document. Antimicrobial Drugs Advisory Committee meeting, March 16, 2023No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIAssessing COVID-19-related symptoms in outpatient adult and adolescent subjects in clinical trials of drugs and biological products for COVID-19 prevention or treatment. Guidance for industryNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
Copyediting
3 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 3 minor suggestions below.
3 copyedit issues flagged: mostly consistency, typo.
- MINORtypoResults, Efficacy“nirmaltrelvir”→ nirmatrelvirTypo in the drug name.
- MINORconsistencyAbstract vs. Results“12 days in the nirmatrelvir–ritonavir group and 13 days in the placebo group (P=0.60)”→ Ensure consistent reporting of median times and p-values.The abstract and results report the same values, but check for consistency in other sections.
- MINORconsistencyAbstract vs. Results“25.8% with nirmatrelvir–ritonavir and 24.1% with placebo”→ Ensure consistency in adverse event percentages between abstract and results.Abstract reports 25.8% and 24.1%, while Results reports 25.8% and 24.1% - consistent, but check for any discrepancies in other sections.
The published paper is robust and generally trustworthy, but an informed reader should weigh the vague data sharing statement and the lack of explicit statistical software identification. No erratum is warranted for the minor copyedit issues, but the authors could consider clarifying the data access mechanism in a correction or on the trial registry.
- 1.HIGHdata codeIn the Data Sharing Statement section, specify the concrete mechanism for requesting de-identified participant data (e.g., via a data access committee or a platform like Vivli) and the conditions/timeframe for access.The current statement is vague and does not meet the expectation for clinical trial data availability, which is a common reviewer and reader concern.
- 2.MEDIUMreportingIn the Statistical Analysis section, explicitly name the statistical software and version used (e.g., SAS 9.4, R 4.2).Naming the software improves reproducibility and is a standard reporting expectation.
- 3.MEDIUMreportingAdd a statement in the Methods or supplementary materials indicating adherence to the CONSORT reporting guideline, and provide the CONSORT checklist if available.Explicitly referencing CONSORT enhances transparency and is expected for randomized trials.
- 4.MEDIUMrigorIn the Statistical Analysis section, clarify the handling of missing data and outliers, even if standard methods were used.The current description does not explicitly address these, which is a minor gap in methodological transparency.
- 5.LOWcopyeditFix the typo 'nirmaltrelvir' to 'nirmatrelvir' in the Results, Efficacy section.Correcting the drug name typo prevents confusion and maintains professional quality.
- 6.LOWcopyeditVerify consistency of median times, p-values, and adverse event percentages between the abstract and results sections.Ensuring internal consistency avoids reader confusion and potential integrity concerns.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.