Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.
Gallagher KE, Lucinde R, Bottomley C, Kaniu M, Suaad B, Mutahi M, Mwalekwa L, Ragab S, Twi-Yeboah L, Berkley JA, Hamaluba M, Karani A, Shangala J, Otiende M, Gardiner E, Mugo D, Smith PG, Tabu C, Were F, Goldblatt D, Scott JAG
- DOI
- 10.1056/NEJMoa2314620
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-20
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/08c648f9-24cb-48f7-aaa4-79af31396762 is authoritative.
How this rating was calculated
- IntegrityIntegrity concern ×2−1★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- ReportingData & code availability partially met−0.25★
- LinksDead data/code link−0.25★
- Statistics were not checked: no recomputable values were found in this text — no test statistic reported with its degrees of freedom, no effect estimate printed with both a 95% CI and a p-value, and no percentage printed with both its count and its denominator.
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary efficacy claim is based on immunogenicity (serotype-specific IgG concentrations and responder proportions) as a surrogate for protection against pneumococcal disease. The paper acknowledges that the endpoints were serologic, not clinical, and that it is unclear whether the lower immunogenicity of 40% PCV13 would influence protection against carriage or disease. While the paper cites a threshold of protection (≥0.35 mcg/ml) established from efficacy trials, it does not provide validated evidence linking the specific non-inferiority margins (GMC ratio >0.5, responder difference >-10%) to clinical outcomes. Target engagement at the tested dose is not demonstrated beyond immunogenicity itself.
“However, the endpoints were serologic, not clinical, endpoints. ... It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
- 02Treatment effect not shown to be clinically meaningful
The primary reported effect is non-inferiority of immunogenicity for 40% PCV13, but the magnitude of the immune response relative to a clinically meaningful threshold is not anchored. The paper does not report the actual GMC values or responder proportions for the 40% PCV13 arm, only that non-inferiority criteria were met. The non-inferiority margins (GMC ratio >0.5, responder difference >-10%) are statistical thresholds, not established minimal clinically important differences. The paper itself notes uncertainty about whether the lower immunogenicity would affect clinical protection.
“It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
- 03Declared data/code link does not resolve
Dead link — nothing to verify.
“http://www.vaccine.uab.edu/ELISA%20Protocol.pdf”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted randomized non-inferiority trial with rigorous design, clear ethical approvals, and transparent reporting. The main weakness is the vague data availability statement and lack of code sharing, which limits reproducibility. Minor copyedit issues and a dead link in the reproducibility check are also noted.
Both reviewers classified the study as interventional, and no divergence was noted. The evaluation covered the full text, with verification components checking citations (43 references, none flagged), statistics (0 tests recomputable), reproducibility (1 dead link), and preregistration (ClinicalTrials.gov). Non-applicable sub-criteria (e.g., animal housing, cell lines) were excluded.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
- lowinternal contradictionThe abstract states '2100 healthy infants were enrolled and randomised into seven equal-sized trial arms', but the results mention that 673 (32%) were enrolled by March 2020 and 1427 between October 2020 and November 2021, which sums to 2100. This is consistent.
2100 healthy infants were enrolled and randomised into seven equal-sized trial arms. ... 673 (32%) participants were enrolled by March 2020 ... 1427 infants were enrolled between October 2020 and November 2021.
Abstractreviewer’s wording - lowinternal contradictionThe per-protocol analysis at 18 weeks includes 1572 participants (75%), but the post-boost analysis includes 1131 (63%) of the 1797 allocated to 2p+1 arms. These are different denominators and are explained by the design (only arms A-F receive booster).
1572 participants out of 2100 (75%) were included in the per-protocol analysis at 18 weeks of age. For the post-boost immunogenicity analysis, 1131 (63%) participants of the 1797 who were allocated to 2p+1 arms were included in the per-protocol analysis.
Results ¶1reviewer’s wording
Overstated conclusions
3 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
- Conclusions only partially backed by the presented evidenceAssessed
6 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewer 1A 2p+1 schedule of 40% PCV13 is a less costly alternative to a full dose PCV programme.The cost analysis is based on current vaccine prices and assumes no wastage, but the long-term impact on immunity and carriage is unknown, so the claim is partially supported.Evidence: Discussion: 'Off-label use of a 3-dose schedule of 40%-PCV13 (US$ 1.1 per dose) represents a more affordable option currently and could reduce the annual cost of purchasing PCV for an annual birth cohort of 1.5 million children, from 9 to 5 million USD (at the current costs, assuming no vaccine wastage).'
“Off-label use of a 3-dose schedule of 40%-PCV13 (US$ 1.1 per dose) represents a more affordable option currently and could reduce the annual cost of purchasing PCV for an annual birth cohort of 1.5 million children, from 9 to 5 million USD (at the current costs, assuming no vaccine wastage).”
Discussion ¶4Find in source - supportedReviewers 1, 2A 3-dose schedule of 40% PCV13 was non-inferior to full dose PCV13 after boosting for all included serotypes.The paper reports that 40% PCV13 met non-inferiority criteria for 13/13 serotypes post-boost, directly supporting the claim.Evidence: Results section: 'the post-boost non-inferiority criterion was met for 13 of the 13 serotypes in the 40% PCV13 recipients'.
“A 3-dose schedule of using 40% of the standard dose of PCV13 was non-inferior to the standard dose after boosting for all included serotypes”
ConclusionFind in source - supportedReviewers 1, 2Lower doses of PCV13 and PCV10 were not non-inferior.The paper reports that 20% PCV13 and both fractional PCV10 arms failed to meet non-inferiority criteria, supporting the claim.Evidence: Results: 'The 20%-PCV13, 40%-PCV10 and 20%-PCV10 arms elicited inferior immunogenicity to the full dose comparators.'
“The 20%-PCV13, 40%-PCV10 and 20%-PCV10 arms elicited inferior immunogenicity to the full dose comparators.”
AbstractFind in source - supportedReviewers 1, 2Vaccine-type carriage prevalence was similar across the PCV13 arms at 9 and 18 months of age.The paper reports carriage prevalence data in Table 2 showing overlapping CIs across PCV13 arms, supporting the claim.Evidence: Table 2 shows PCV13 VT carriage prevalence at 9 months: 17.9%, 23.3%, 20.9% for full, 40%, 20% doses; at 18 months: 17.6%, 18.9%, 16.2%.
“Vaccine-type carriage prevalence was similar across the PCV13 arms at 9 and 18 months of age.”
AbstractFind in source - supportedReviewer 2A 2p+1 schedule of 40% doses of PCV13 elicited non-inferior IgG responses after both the primary series and the booster dose.The results show 12/13 serotypes met non-inferiority post-prime and 13/13 post-boost, supporting the claim.Evidence: Results: 'the non-inferiority criterion was met for 12 of the 13 serotypes in the 40% PCV13 recipients' (post-prime) and '13 of the 13 serotypes' (post-boost).
“A 2p+1 schedule of 40% doses of PCV13 elicited non-inferior IgG responses after both the primary series and the booster dose, when compared to a full dose 2p+1 schedule at peak immune response time points.”
Discussion ¶1Find in source - supportedReviewer 2A schedule of 2 full primary doses of PCV10 elicited non-inferior immunogenicity to 3 full primary doses of PCV10 among 6 of the 7 ST-specific responses.The results state that 6 of 7 serotypes met the non-inferiority criterion, supporting the claim.Evidence: Results: 'A primary series of 2 PCV10 doses was non-inferior to a primary series of 3 PCV10 doses for 6 of the 7 serotypes assayed.'
“A schedule of 2 full primary doses of PCV10 elicited non-inferior immunogenicity to 3 full primary doses of PCV10 among 6 of the 7 ST-specific responses that were assayed (all except ST23F) at 18 weeks of age.”
Discussion ¶3Find in source
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary efficacy claim is based on immunogenicity (serotype-specific IgG concentrations and responder proportions) as a surrogate for protection against pneumococcal disease. The paper acknowledges that the endpoints were serologic, not clinical, and that it is unclear whether the lower immunogenicity of 40% PCV13 would influence protection against carriage or disease. While the paper cites a threshold of protection (≥0.35 mcg/ml) established from efficacy trials, it does not provide validated evidence linking the specific non-inferiority margins (GMC ratio >0.5, responder difference >-10%) to clinical outcomes. Target engagement at the tested dose is not demonstrated beyond immunogenicity itself.
“However, the endpoints were serologic, not clinical, endpoints. ... It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
- INADEQUATEEffect sizeThe primary reported effect is non-inferiority of immunogenicity for 40% PCV13, but the magnitude of the immune response relative to a clinically meaningful threshold is not anchored. The paper does not report the actual GMC values or responder proportions for the 40% PCV13 arm, only that non-inferiority criteria were met. The non-inferiority margins (GMC ratio >0.5, responder difference >-10%) are statistical thresholds, not established minimal clinically important differences. The paper itself notes uncertainty about whether the lower immunogenicity would affect clinical protection.
“It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
The introduction cites prior trials of fractional doses for other vaccines and a systematic review of a pentavalent PCV, and acknowledges the cost burden of PCVs in LMICs. The rationale linking the premise to the study objectives is explicit. Limitations of prior research are addressed by noting the need for a dedicated trial of fractional PCV doses.
“We aimed to assess whether the serotype-specific immunogenicity of fractional doses (20% or 40%) of PCV10 or PCV13, administered in a 2p+1 schedule, was non-inferior to the immunogenicity of full doses.”
“A systematic review identified one early trial of a pentavalent PCV that documented serotype-specific immune responses that reached the threshold of protection (≥0.35 mcg/ml; established following later efficacy trials) after a dose of just 0.5 mcg of antigen, without an adjuvant.”
“Fractional doses of antigen have been shown to induce non-inferior immune responses to full doses in trials of vaccines against Haemophilus influenzae type b (Hib) – , Neisseria meningitidis , Yellow Fever – and Polio – .”
“We aimed to assess whether the serotype-specific immunogenicity of fractional doses (20% or 40%) of PCV10 or PCV13, administered in a 2p+1 schedule, was non-inferior to the immunogenicity of full doses.”
“A systematic review identified one early trial of a pentavalent PCV that documented serotype-specific immune responses that reached the threshold of protection (≥0.35 mcg/ml; established following later efficacy trials) after a dose of just 0.5 mcg of antigen, without an adjuvant.”
Randomization used computer-generated codes with block sizes of 14, and allocation was concealed via sequentially numbered sealed envelopes. Blinding was implemented for participants and study personnel, with a clear rationale for the unblinded arm G. A priori power analysis was performed for both post-prime and post-boost analyses. Inclusion/exclusion criteria were pre-specified, and the per-protocol population was defined. Outlier handling is addressed through the per-protocol analysis and missing-data notes. Controls are inherent in the full-dose comparator arms. Independent replication is not applicable for a single pivotal trial.
“Each infant was randomly allocated to one of the seven trial arms with equal probability using sequentially numbered, sealed envelopes. Computer-generated randomisation codes were prepared in advance by an independent statistician using block sizes of 14.”
“Parents of participants in arms A-F were blinded to the dose allocated. Other than the team administering vaccine, all other study personnel were blinded to allocation of participants until the end of the study. Blinding of arm G, was not possible.”
“To declare non-inferiority at the post-prime timepoint with 90% power, we estimated that we would need to enrol 300 infants per arm, assuming serotype-specific response rates – and 5% loss to follow up.”
“Each infant was randomly allocated to one of the seven trial arms with equal probability using sequentially numbered, sealed envelopes. Computer-generated randomisation codes were prepared in advance by an independent statistician using block sizes of 14.”
“Parents of participants in arms A-F were blinded to the dose allocated. Other than the team administering vaccine, all other study personnel were blinded to allocation of participants until the end of the study. Blinding of arm G, was not possible.”
“To declare non-inferiority at the post-prime timepoint with 90% power, we estimated that we would need to enrol 300 infants per arm, assuming serotype-specific response rates – and 5% loss to follow up.”
Sex is reported and balanced across arms. Age (6-8 weeks at enrolment) and weight at enrolment are reported. Health status is defined by inclusion criteria (healthy infants). Demographics (sex, ethnic group) are described for the per-protocol population. Species/strain and housing conditions are not applicable for a human trial.
“We recruited any healthy infant (i.e. no acute febrile illness on the day of enrolment) aged 6-8 weeks, who was eligible for vaccination in the routine immunisation programme but had not yet received their first dose of PCV.”
“The characteristics of participants in the per-protocol analysis were balanced across the arms with respect to sex, HIV exposure (maternal HIV status), infant weight at enrolment, breastfeeding at 10 months of age and the timing of their boost dose ().”
“We recruited any healthy infant (i.e. no acute febrile illness on the day of enrolment) aged 6-8 weeks, who was eligible for vaccination in the routine immunisation programme but had not yet received their first dose of PCV.”
“The per-protocol population at 10-months of age comprised a representative distribution of infants by sex and ethnic group, compared to the Kilifi population , ().”
The paper states approvals from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the LSHTM Ethics Committee, and that written informed consent was obtained from at least one caregiver. Regulatory compliance is implied through adherence to ICH-GCP for adverse event reporting.
“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”
“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”
“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”
“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”
“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”
“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”
The vaccines are named with manufacturers (GSK and Pfizer) and dose volumes are specified. The ELISA and MOPA protocols are referenced by URL. The serotype-specific saccharide doses are tabulated. No other key biological resources (antibodies, cell lines) are used.
“A research nurse prepared 0.5ml as a full dose, 0.2ml as a 40% dose or 0.1ml as a 20% dose and administered the vaccine in a masked syringe, intramuscularly in the right anterolateral thigh muscle.”
“Sera were assayed for IgG to vaccine-type capsular polysaccharides using an ELISA ( http://www.vaccine.uab.edu/ELISA%20Protocol.pdf ) and, on a subset (n=50, 1-month post-boost), for functional antibody using the Multiplexed Opsonophagocytic Assay (MOPA; http://www.vaccine.uab.edu/UAB-MOPA.pdf ) .”
“Arm A) Full dose PCV13 B) 40%-dose PCV13 C) 20%-dose PCV13 D) Full dose PCV10 E) 40%-dose PCV10 F) 20%-dose PCV10.”
“sera were assayed for IgG to vaccine-type capsular polysaccharides using an ELISA ( http://www.vaccine.uab.edu/ELISA%20Protocol.pdf ) and, on a subset (n=50, 1-month post-boost), for functional antibody using the Multiplexed Opsonophagocytic Assay (MOPA; http://www.vaccine.uab.edu/UAB-MOPA.pdf ) .”
The statistical analysis plan is described, including non-inferiority margins and per-protocol population. Tests are named (non-inferiority using confidence intervals). Exact p-values are not reported, but the analysis uses estimation with confidence intervals, which is appropriate for non-inferiority trials. Effect sizes (differences in proportions, GMC ratios) are reported with 95% CIs. Software is not explicitly named, but this is a minor omission. Data presentation includes per-group Ns and confidence intervals.
“At 4-weeks post-boost, non-inferiority was declared if the lower limit of the 95% CI for the ratio of the geometric mean concentration (GMC) of IgG (fractional/full dose arms) was more than 0.5.”
“The difference in the proportion of responders (full dose-fractional dose, 95%CI) at 4-weeks post primary series (18 weeks of age)”
“At 4-weeks post-boost, non-inferiority was declared if the lower limit of the 95% CI for the ratio of the geometric mean concentration (GMC) of IgG (fractional/full dose arms) was more than 0.5.”
“Compared to 2 full doses of PCV13, the non-inferiority criterion was met for 12 of the 13 serotypes in the 40% PCV13 recipients, but for only 7 of the 13 serotypes in the 20% PCV13 recipients.”
The paper mentions that the protocol and SAP are available at nejm.org, but does not provide a clear data availability statement for the trial data. No repository deposit or accession numbers are given. No custom code is mentioned.
“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”
“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”
The trial is registered with ClinicalTrials.gov and PACTR. Methods are detailed enough for replication. Limitations are explicitly discussed, including the smaller per-protocol population and the serologic endpoints. Conclusions are appropriately cautious. Funding and COI are disclosed.
“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”
“The per-protocol populations for the non-inferiority analyses were smaller than planned, which is likely to have reduced the precision with which we could estimate the ratios of the proportion of responders and of GMCs.”
“The Bill & Melinda Gates Foundation (INV007838; PI Anthony Scott), The National Institute of Health Research (NIHR) Global Health Research Unit on Mucosal Pathogens (MPRU) small grant (PI Katherine Gallagher). Anthony Scott was supported by a Senior Research Fellowship (214320) from The Wellcome Trust.”
“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”
“The per-protocol populations for the non-inferiority analyses were smaller than planned, which is likely to have reduced the precision with which we could estimate the ratios of the proportion of responders and of GMCs.”
“The Bill & Melinda Gates Foundation (INV007838; PI Anthony Scott), The National Institute of Health Research (NIHR) Global Health Research Unit on Mucosal Pathogens (MPRU) small grant (PI Katherine Gallagher). Anthony Scott was supported by a Senior Research Fellowship (214320) from The Wellcome Trust.”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
1 finding · worst mediumReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
- Dead data/code linksRecomputed
Checked 43 references by DOI: 35 verified — 8 no DOI (shown, not verified).
- NO DOIGavi’s pneumococcal supportNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIPneumococcal vaccines WHO position paper--2019No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIYellow fever vaccination: the potential of dose-sparing to increase vaccine supply and availabilityNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIPRODUCT MONOGRAPH: SYNFLORIX Pneumococcal conjugate vaccine (Non-Typeable Haemophilis influenzae proteinD, diphtheria or tetanus toxoid conjugates) adsorbedNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIPRODUCT MONOGRAPH: Prevnar 13 Pneumococcal 13-valent Conjugate Vaccine (Diphtheria CRM197 Protein)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIPneumococcal Conjugate Vaccine Impact Study PCVISNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIWHO vaccine-preventable diseases: monitoring system. 2016 Global SummaryNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIMultiple Endpoints in Clinical Trials. Guidance for IndustryNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
2 of 3 data/code links checked; 1 live, 1 dead; 1 not probed.
- datahttp://nejm.orgUNVERIFIEDHTTP 403Liveness indeterminate — content not checked.
- datahttp://www.vaccine.uab.edu/ELISA%20Protocol.pdfDEADHTTP 404Dead link — nothing to verify.
- datahttp://www.vaccine.uab.edu/UAB-MOPA.pdfLIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
7 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 7 minor suggestions below.
7 copyedit issues flagged: mostly consistency, clarity, typo.
- MINORtypoMethods, Laboratory methods“Samples were analysed for IgG to vaccine-typess, except for samples from the routine immunisation arm (PCV10 3p+0) which were assayed for 7 vaccine-typess due to funding constraints.”→ Change 'vaccine-typess' to 'vaccine serotypes'.Typo: 'typess' should be 'serotypes'.
- MINORconsistencyResults, Immunogenicity post-primary series“Compared to 2 full doses of PCV10, the non-inferiority criterion was met for 7 of the 10 serotypes in the 40% PCV10 recipients, and only 7 of the 10 STs in the 20% PCV10 recipients.”→ Use 'serotypes' consistently instead of 'STs'.Inconsistent abbreviation 'STs' used.
- MINORclarityMethods, Statistical analyses“The analyses presented in this paper use more-stringent, 2-sided 95%CIs in conformity with the non-inferiority analyses used to licence PCV13 , .”→ Clarify the reference to the licensing analyses.The sentence is slightly unclear due to missing citation details.
- MINORconsistencyAbstract, Methods“2100 healthy infants were enrolled and randomised into seven equal-sized trial arms.”→ Consider specifying the randomization ratio (1:1:1:1:1:1:1) for clarity.The phrase 'equal-sized' is clear but could be more explicit.
- MINORclarityMethods, Study procedures“A research nurse prepared 0.5ml as a full dose, 0.2ml as a 40% dose or 0.1ml as a 20% dose and administered the vaccine in a masked syringe, intramuscularly in the right anterolateral thigh muscle.”→ Add a comma after '0.1ml as a 20% dose' for readability.Minor punctuation.
- MINORconsistencyResults, paragraph 1“1572 participants out of 2100 (75%) were included in the per-protocol analysis at 18 weeks of age.”→ Ensure the percentage is consistent with the numbers (1572/2100 = 74.86%, rounds to 75%).The percentage is correct.
- MINORclarityDiscussion, paragraph 3“Off-label use of a 3-dose schedule of 40%-PCV13 (US$ 1.1 per dose) represents a more affordable option currently and could reduce the annual cost of purchasing PCV for an annual birth cohort of 1.5 million children, from 9 to 5 million USD (at the current costs, assuming no vaccine wastage).”→ Consider rephrasing for clarity: '...could reduce the annual cost from 9 to 5 million USD...'The sentence is slightly awkward.
The published work is robust and methodologically sound, with only minor reporting gaps. An informed reader should weigh the vague data availability and the dead link to the protocol/SAP, which could warrant a correction or clarification from the authors. The statistical analysis is appropriate, though only a subset of tests could be independently verified.
- 1.HIGHdata codeAdd a clear data availability statement in the Methods or a dedicated section, specifying how to access de-identified participant data (e.g., via a data access committee or repository) and any conditions.The current statement is vague and does not meet funder or journal expectations for data sharing, which is a key reproducibility gap.
- 2.HIGHdata codeFix the dead link to the protocol/SAP (http://nejm.org) by providing a direct, working URL or DOI, and consider depositing the protocol and SAP in a public repository.The reproducibility check found 1 dead link among 3 checked, undermining access to the study design details.
- 3.MEDIUMstatisticsIdentify the statistical software and version used for analyses (e.g., Stata, R) in the Statistical analyses section.Both reviewers noted the omission, which is a minor but easily fixed transparency issue.
- 4.MEDIUMreportingMention adherence to a reporting guideline such as CONSORT in the Methods or a footnote.The paper does not reference any reporting guideline, which is a common expectation for clinical trials.
- 5.MEDIUMcopyeditFix the typo 'vaccine-typess' to 'vaccine serotypes' in Methods, Laboratory methods.Typographical errors detract from professionalism and clarity.
- 6.MEDIUMcopyeditUse 'serotypes' consistently instead of 'STs' in Results, Immunogenicity post-primary series.Inconsistent abbreviation can confuse readers.
- 7.LOWcopyeditClarify the sentence in Methods, Statistical analyses about 'more-stringent, 2-sided 95%CIs' by adding the missing citation details.The sentence is slightly unclear due to missing references.
- 8.LOWcopyeditAdd a comma after '0.1ml as a 20% dose' in Methods, Study procedures for readability.Minor punctuation improvement.
- 9.LOWcopyeditRephrase the sentence in Discussion, paragraph 3 about cost reduction for clarity.The sentence is slightly awkward and could be more direct.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.