Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.

Name: Kaimen Rigor review — Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.
Item: Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.
Rating: 96
Author: Alpha1

Gallagher KE, Lucinde R, Bottomley C, Kaniu M, Suaad B, Mutahi M, Mwalekwa L, Ragab S, Twi-Yeboah L, Berkley JA, Hamaluba M, Karani A, Shangala J, Otiende M, Gardiner E, Mugo D, Smith PG, Tabu C, Were F, Goldblatt D, Scott JAG

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.5★ (Weak), 0 critical, 2 high issues for “Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.

Read full text (PMC)

DOI

10.1056/NEJMoa2314620

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/08c648f9-24cb-48f7-aaa4-79af31396762" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/08c648f9-24cb-48f7-aaa4-79af31396762/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 2 high issues for “Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

43728ca079405a5cd327ac7cc7f46c6b6a6316f1e0c7693d30d5804b79493d28

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.

Paper source

Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

Statistics were not checked: no recomputable values were found in this text — no test statistic reported with its degrees of freedom, no effect estimate printed with both a 95% CI and a p-value, and no percentage printed with both its count and its denominator.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on immunogenicity (serotype-specific IgG concentrations and responder proportions) as a surrogate for protection against pneumococcal disease. The paper acknowledges that the endpoints were serologic, not clinical, and that it is unclear whether the lower immunogenicity of 40% PCV13 would influence protection against carriage or disease. While the paper cites a threshold of protection (≥0.35 mcg/ml) established from efficacy trials, it does not provide validated evidence linking the specific non-inferiority margins (GMC ratio >0.5, responder difference >-10%) to clinical outcomes. Target engagement at the tested dose is not demonstrated beyond immunogenicity itself.
“However, the endpoints were serologic, not clinical, endpoints. ... It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is non-inferiority of immunogenicity for 40% PCV13, but the magnitude of the immune response relative to a clinically meaningful threshold is not anchored. The paper does not report the actual GMC values or responder proportions for the 40% PCV13 arm, only that non-inferiority criteria were met. The non-inferiority margins (GMC ratio >0.5, responder difference >-10%) are statistical thresholds, not established minimal clinically important differences. The paper itself notes uncertainty about whether the lower immunogenicity would affect clinical protection.
“It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
Find in source
03Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“http://www.vaccine.uab.edu/ELISA%20Protocol.pdf”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit7 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted randomized non-inferiority trial with rigorous design, clear ethical approvals, and transparent reporting. The main weakness is the vague data availability statement and lack of code sharing, which limits reproducibility. Minor copyedit issues and a dead link in the reproducibility check are also noted.

Both reviewers classified the study as interventional, and no divergence was noted. The evaluation covered the full text, with verification components checking citations (43 references, none flagged), statistics (0 tests recomputable), reproducibility (1 dead link), and preregistration (ClinicalTrials.gov). Non-applicable sub-criteria (e.g., animal housing, cell lines) were excluded.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites prior trials of fractional doses for other vaccines and a systematic review of a pentavalent PCV, and acknowledges the cost burden of PCVs in LMICs. The rationale linking the premise to the study objectives is explicit. Limitations of prior research are addressed by noting the need for a dedicated trial of fractional PCV doses.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work and a logical rationale for testing fractional doses of PCV.

Evidence

paraphrase[Introduction, paragraph 2]

“Fractional doses of antigen have been shown to induce non-inferior immune responses to full doses in trials of vaccines against Haemophilus influenzae type b (Hib), Neisseria meningitidis, Yellow Fever and Polio.”

“We aimed to assess whether the serotype-specific immunogenicity of fractional doses (20% or 40%) of PCV10 or PCV13, administered in a 2p+1 schedule, was non-inferior to the immunogenicity of full doses.”

Introduction ¶3Find in source

“A systematic review identified one early trial of a pentavalent PCV that documented serotype-specific immune responses that reached the threshold of protection (≥0.35 mcg/ml; established following later efficacy trials) after a dose of just 0.5 mcg of antigen, without an adjuvant.”

Introduction ¶2Find in source

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise by citing prior research on fractional dosing and the need for cost reduction, and logically links this to the trial objectives.

Evidence

“Fractional doses of antigen have been shown to induce non-inferior immune responses to full doses in trials of vaccines against Haemophilus influenzae type b (Hib) – , Neisseria meningitidis , Yellow Fever – and Polio – .”

Introduction ¶2Find in source

Introduction ¶3Find in source

Introduction ¶2Find in source

Randomization used computer-generated codes with block sizes of 14, and allocation was concealed via sequentially numbered sealed envelopes. Blinding was implemented for participants and study personnel, with a clear rationale for the unblinded arm G. A priori power analysis was performed for both post-prime and post-boost analyses. Inclusion/exclusion criteria were pre-specified, and the per-protocol population was defined. Outlier handling is addressed through the per-protocol analysis and missing-data notes. Controls are inherent in the full-dose comparator arms. Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified analysis populations.

Evidence

“Each infant was randomly allocated to one of the seven trial arms with equal probability using sequentially numbered, sealed envelopes. Computer-generated randomisation codes were prepared in advance by an independent statistician using block sizes of 14.”

MethodsFind in source

“Parents of participants in arms A-F were blinded to the dose allocated. Other than the team administering vaccine, all other study personnel were blinded to allocation of participants until the end of the study. Blinding of arm G, was not possible.”

MethodsFind in source

“To declare non-inferiority at the post-prime timepoint with 90% power, we estimated that we would need to enrol 300 infants per arm, assuming serotype-specific response rates – and 5% loss to follow up.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

Statistical analysisFind in source

Sex is reported and balanced across arms. Age (6-8 weeks at enrolment) and weight at enrolment are reported. Health status is defined by inclusion criteria (healthy infants). Demographics (sex, ethnic group) are described for the per-protocol population. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Key biological variables (sex, age, weight, HIV exposure) are reported and balanced across arms.

Evidence

paraphrase[Results, paragraph 1]

“The characteristics of participants in the per-protocol analysis were balanced across the arms with respect to sex, HIV exposure (maternal HIV status), infant weight at enrolment, breastfeeding at 10 months of age and the timing of their boost dose.”

“We recruited any healthy infant (i.e. no acute febrile illness on the day of enrolment) aged 6-8 weeks, who was eligible for vaccination in the routine immunisation programme but had not yet received their first dose of PCV.”

MethodsFind in source

paraphrase[Results, paragraph 1]

“The per-protocol population at 10-months of age comprised a representative distribution of infants by sex and ethnic group, compared to the Kilifi population.”

PASSReviewer 2· 90% conf

Key biological variables (sex, age, weight, health status) are reported, and demographics are described for the per-protocol population.

Evidence

Results ¶1Find in source

MethodsFind in source

“The per-protocol population at 10-months of age comprised a representative distribution of infants by sex and ethnic group, compared to the Kilifi population , ().”

Results ¶1Find in source

The paper states approvals from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the LSHTM Ethics Committee, and that written informed consent was obtained from at least one caregiver. Regulatory compliance is implied through adherence to ICH-GCP for adverse event reporting.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals from named committees and informed consent are clearly documented.

Evidence

“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”

Statistical analysisFind in source

“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”

Statistical analysisFind in source

“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals from named committees and informed consent are clearly reported.

Evidence

“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”

Statistical analysisFind in source

“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”

Statistical analysisFind in source

“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”

MethodsFind in source

The vaccines are named with manufacturers (GSK and Pfizer) and dose volumes are specified. The ELISA and MOPA protocols are referenced by URL. The serotype-specific saccharide doses are tabulated. No other key biological resources (antibodies, cell lines) are used.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedNOT REPORTED

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational products (PCV10 and PCV13) are identified with manufacturer and dose, and laboratory methods are referenced.

Evidence

paraphrase[Abstract, Background]

“We assessed whether immunogenicity was non-inferior after fractional doses of PCV10 (GlaxoSmithKline plc.) or PCV13 (Pfizer Inc.), when compared to full doses.”

“A research nurse prepared 0.5ml as a full dose, 0.2ml as a 40% dose or 0.1ml as a 20% dose and administered the vaccine in a masked syringe, intramuscularly in the right anterolateral thigh muscle.”

MethodsFind in source

“Sera were assayed for IgG to vaccine-type capsular polysaccharides using an ELISA ( http://www.vaccine.uab.edu/ELISA%20Protocol.pdf ) and, on a subset (n=50, 1-month post-boost), for functional antibody using the Multiplexed Opsonophagocytic Assay (MOPA; http://www.vaccine.uab.edu/UAB-MOPA.pdf ) .”

MethodsFind in source

PASSReviewer 2· 90% conf

The investigational products (PCV10 and PCV13) are identified with manufacturer and dose, and laboratory methods are described.

Evidence

“Arm A) Full dose PCV13 B) 40%-dose PCV13 C) 20%-dose PCV13 D) Full dose PCV10 E) 40%-dose PCV10 F) 20%-dose PCV10.”

MethodsFind in source

“sera were assayed for IgG to vaccine-type capsular polysaccharides using an ELISA ( http://www.vaccine.uab.edu/ELISA%20Protocol.pdf ) and, on a subset (n=50, 1-month post-boost), for functional antibody using the Multiplexed Opsonophagocytic Assay (MOPA; http://www.vaccine.uab.edu/UAB-MOPA.pdf ) .”

MethodsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

The statistical analysis plan is described, including non-inferiority margins and per-protocol population. Tests are named (non-inferiority using confidence intervals). Exact p-values are not reported, but the analysis uses estimation with confidence intervals, which is appropriate for non-inferiority trials. Effect sizes (differences in proportions, GMC ratios) are reported with 95% CIs. Software is not explicitly named, but this is a minor omission. Data presentation includes per-group Ns and confidence intervals.

Sub-criteria

tests namedADEQUATE

exact p valuesN/A

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedINADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well-described, with non-inferiority margins and confidence intervals reported.

Evidence

“At 4-weeks post-boost, non-inferiority was declared if the lower limit of the 95% CI for the ratio of the geometric mean concentration (GMC) of IgG (fractional/full dose arms) was more than 0.5.”

Statistical analysisFind in source

“The difference in the proportion of responders (full dose-fractional dose, 95%CI) at 4-weeks post primary series (18 weeks of age)”

Figure 2Find in source

absence[Methods, Statistical analyses]

Statistical software is not identified.

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with non-inferiority criteria pre-specified and effect sizes reported with confidence intervals.

Evidence

Statistical analysisFind in source

“Compared to 2 full doses of PCV13, the non-inferiority criterion was met for 12 of the 13 serotypes in the 40% PCV13 recipients, but for only 7 of the 13 serotypes in the 20% PCV13 recipients.”

ResultsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

The paper mentions that the protocol and SAP are available at nejm.org, but does not provide a clear data availability statement for the trial data. No repository deposit or accession numbers are given. No custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”

MethodsFind in source

absence[Whole paper]

No data availability statement for the trial data.

WARNReviewer 2· 80% conf

A data availability statement is present but vague, and no data repository or code sharing is mentioned.

Evidence

“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”

MethodsFind in source

absence[Whole paper]

No repository deposit is mentioned.

The trial is registered with ClinicalTrials.gov and PACTR. Methods are detailed enough for replication. Limitations are explicitly discussed, including the smaller per-protocol population and the serologic endpoints. Conclusions are appropriately cautious. Funding and COI are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and conclusions are proportional.

Evidence

“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”

ConclusionFind in source

“The per-protocol populations for the non-inferiority analyses were smaller than planned, which is likely to have reduced the precision with which we could estimate the ratios of the proportion of responders and of GMCs.”

Discussion ¶2Find in source

“The Bill & Melinda Gates Foundation (INV007838; PI Anthony Scott), The National Institute of Health Research (NIHR) Global Health Research Unit on Mucosal Pathogens (MPRU) small grant (PI Katherine Gallagher). Anthony Scott was supported by a Senior Research Fellowship (214320) from The Wellcome Trust.”

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent with trial registration, discussion of limitations, and proportional conclusions.

Evidence

“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”

AbstractFind in source

Discussion ¶2Find in source

FundingFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 43 references by DOI: 35 verified — 8 no DOI (shown, not verified).

2 of 3 data/code links checked; 1 live, 1 dead; 1 not probed.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and methodologically sound, with only minor reporting gaps. An informed reader should weigh the vague data availability and the dead link to the protocol/SAP, which could warrant a correction or clarification from the authors. The statistical analysis is appropriate, though only a subset of tests could be independently verified.

1.
HIGHdata code
Add a clear data availability statement in the Methods or a dedicated section, specifying how to access de-identified participant data (e.g., via a data access committee or repository) and any conditions.
The current statement is vague and does not meet funder or journal expectations for data sharing, which is a key reproducibility gap.
2.
HIGHdata code
Fix the dead link to the protocol/SAP (http://nejm.org) by providing a direct, working URL or DOI, and consider depositing the protocol and SAP in a public repository.
The reproducibility check found 1 dead link among 3 checked, undermining access to the study design details.
3.
MEDIUMstatistics
Identify the statistical software and version used for analyses (e.g., Stata, R) in the Statistical analyses section.
Both reviewers noted the omission, which is a minor but easily fixed transparency issue.
4.
MEDIUMreporting
Mention adherence to a reporting guideline such as CONSORT in the Methods or a footnote.
The paper does not reference any reporting guideline, which is a common expectation for clinical trials.
5.
MEDIUMcopyedit
Fix the typo 'vaccine-typess' to 'vaccine serotypes' in Methods, Laboratory methods.
Typographical errors detract from professionalism and clarity.
6.
MEDIUMcopyedit
Use 'serotypes' consistently instead of 'STs' in Results, Immunogenicity post-primary series.
Inconsistent abbreviation can confuse readers.
7.
LOWcopyedit
Clarify the sentence in Methods, Statistical analyses about 'more-stringent, 2-sided 95%CIs' by adding the missing citation details.
The sentence is slightly unclear due to missing references.
8.
LOWcopyedit
Add a comma after '0.1ml as a 20% dose' in Methods, Study procedures for readability.
Minor punctuation improvement.
9.
LOWcopyedit
Rephrase the sentence in Discussion, paragraph 3 about cost reduction for clarity.
The sentence is slightly awkward and could be more direct.

Full text (26,171 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.

Read full text (PMC)

DOI

10.1056/NEJMoa2314620

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/08c648f9-24cb-48f7-aaa4-79af31396762" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/08c648f9-24cb-48f7-aaa4-79af31396762/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 2 high issues for “Fractional Doses of Pneumococcal Conjugate Vaccine - A Noninferiority Trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

43728ca079405a5cd327ac7cc7f46c6b6a6316f1e0c7693d30d5804b79493d28

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

Statistics were not checked: no recomputable values were found in this text — no test statistic reported with its degrees of freedom, no effect estimate printed with both a 95% CI and a p-value, and no percentage printed with both its count and its denominator.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on immunogenicity (serotype-specific IgG concentrations and responder proportions) as a surrogate for protection against pneumococcal disease. The paper acknowledges that the endpoints were serologic, not clinical, and that it is unclear whether the lower immunogenicity of 40% PCV13 would influence protection against carriage or disease. While the paper cites a threshold of protection (≥0.35 mcg/ml) established from efficacy trials, it does not provide validated evidence linking the specific non-inferiority margins (GMC ratio >0.5, responder difference >-10%) to clinical outcomes. Target engagement at the tested dose is not demonstrated beyond immunogenicity itself.
“However, the endpoints were serologic, not clinical, endpoints. ... It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is non-inferiority of immunogenicity for 40% PCV13, but the magnitude of the immune response relative to a clinically meaningful threshold is not anchored. The paper does not report the actual GMC values or responder proportions for the 40% PCV13 arm, only that non-inferiority criteria were met. The non-inferiority margins (GMC ratio >0.5, responder difference >-10%) are statistical thresholds, not established minimal clinically important differences. The paper itself notes uncertainty about whether the lower immunogenicity would affect clinical protection.
“It is unclear whether the lower, albeit non-inferior, immunogenicity of 40% PCV13, would influence protection against carriage acquisition or against pneumococcal disease.”
Find in source
03Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“http://www.vaccine.uab.edu/ELISA%20Protocol.pdf”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit7 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

6 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with prior work and a logical rationale for testing fractional doses of PCV.

Evidence

paraphrase[Introduction, paragraph 2]

Introduction ¶3Find in source

Introduction ¶2Find in source

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise by citing prior research on fractional dosing and the need for cost reduction, and logically links this to the trial objectives.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

Introduction ¶2Find in source

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified analysis populations.

Evidence

MethodsFind in source

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with adequate randomization, blinding, power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Key biological variables (sex, age, weight, HIV exposure) are reported and balanced across arms.

Evidence

paraphrase[Results, paragraph 1]

MethodsFind in source

paraphrase[Results, paragraph 1]

“The per-protocol population at 10-months of age comprised a representative distribution of infants by sex and ethnic group, compared to the Kilifi population.”

PASSReviewer 2· 90% conf

Key biological variables (sex, age, weight, health status) are reported, and demographics are described for the per-protocol population.

Evidence

Results ¶1Find in source

MethodsFind in source

“The per-protocol population at 10-months of age comprised a representative distribution of infants by sex and ethnic group, compared to the Kilifi population , ().”

Results ¶1Find in source

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals from named committees and informed consent are clearly documented.

Evidence

“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”

Statistical analysisFind in source

“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”

Statistical analysisFind in source

“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals from named committees and informed consent are clearly reported.

Evidence

“Approvals were obtained from the Kenyan Medical Research Institute Scientific & Ethics Review Unit (SERU) and the London School of Hygiene & Tropical Medicine (LSHTM) Ethics Committee.”

Statistical analysisFind in source

“Written informed consent was obtained from at least one caregiver of all infants enrolled in the study.”

Statistical analysisFind in source

“Adverse events (AEs) and serious adverse events (SAEs) were defined in accordance with the International Conference on Harmonization (ICH) Guidelines for Good Clinical Practice.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedNOT REPORTED

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational products (PCV10 and PCV13) are identified with manufacturer and dose, and laboratory methods are referenced.

Evidence

paraphrase[Abstract, Background]

“We assessed whether immunogenicity was non-inferior after fractional doses of PCV10 (GlaxoSmithKline plc.) or PCV13 (Pfizer Inc.), when compared to full doses.”

MethodsFind in source

PASSReviewer 2· 90% conf

The investigational products (PCV10 and PCV13) are identified with manufacturer and dose, and laboratory methods are described.

Evidence

“Arm A) Full dose PCV13 B) 40%-dose PCV13 C) 20%-dose PCV13 D) Full dose PCV10 E) 40%-dose PCV10 F) 20%-dose PCV10.”

MethodsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

Sub-criteria

tests namedADEQUATE

exact p valuesN/A

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedINADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well-described, with non-inferiority margins and confidence intervals reported.

Evidence

Statistical analysisFind in source

“The difference in the proportion of responders (full dose-fractional dose, 95%CI) at 4-weeks post primary series (18 weeks of age)”

Figure 2Find in source

absence[Methods, Statistical analyses]

Statistical software is not identified.

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described, with non-inferiority criteria pre-specified and effect sizes reported with confidence intervals.

Evidence

Statistical analysisFind in source

“Compared to 2 full doses of PCV13, the non-inferiority criterion was met for 12 of the 13 serotypes in the 40% PCV13 recipients, but for only 7 of the 13 serotypes in the 20% PCV13 recipients.”

ResultsFind in source

absence[Methods, Statistical analyses]

Statistical software is not explicitly named.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositNOT REPORTED

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement is present but vague, and no code is shared.

Evidence

“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”

MethodsFind in source

absence[Whole paper]

No data availability statement for the trial data.

WARNReviewer 2· 80% conf

A data availability statement is present but vague, and no data repository or code sharing is mentioned.

Evidence

“Details of the study design can be found in the protocol and SAP at nejm.org (http://nejm.org) .”

MethodsFind in source

absence[Whole paper]

No repository deposit is mentioned.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and conclusions are proportional.

Evidence

“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”

ConclusionFind in source

Discussion ¶2Find in source

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent with trial registration, discussion of limitations, and proportional conclusions.

Evidence

“Trial Registration: ClinicalTrials.gov (https://ClinicalTrials.gov) ID: NCT03489018 ; Pan African Clinical Trial Registry ID: PACTR202104717648755.”

AbstractFind in source

Discussion ¶2Find in source

FundingFind in source

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 43 references by DOI: 35 verified — 8 no DOI (shown, not verified).

2 of 3 data/code links checked; 1 live, 1 dead; 1 not probed.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Add a clear data availability statement in the Methods or a dedicated section, specifying how to access de-identified participant data (e.g., via a data access committee or repository) and any conditions.
The current statement is vague and does not meet funder or journal expectations for data sharing, which is a key reproducibility gap.
2.
HIGHdata code
Fix the dead link to the protocol/SAP (http://nejm.org) by providing a direct, working URL or DOI, and consider depositing the protocol and SAP in a public repository.
The reproducibility check found 1 dead link among 3 checked, undermining access to the study design details.
3.
MEDIUMstatistics
Identify the statistical software and version used for analyses (e.g., Stata, R) in the Statistical analyses section.
Both reviewers noted the omission, which is a minor but easily fixed transparency issue.
4.
MEDIUMreporting
Mention adherence to a reporting guideline such as CONSORT in the Methods or a footnote.
The paper does not reference any reporting guideline, which is a common expectation for clinical trials.
5.
MEDIUMcopyedit
Fix the typo 'vaccine-typess' to 'vaccine serotypes' in Methods, Laboratory methods.
Typographical errors detract from professionalism and clarity.
6.
MEDIUMcopyedit
Use 'serotypes' consistently instead of 'STs' in Results, Immunogenicity post-primary series.
Inconsistent abbreviation can confuse readers.
7.
LOWcopyedit
Clarify the sentence in Methods, Statistical analyses about 'more-stringent, 2-sided 95%CIs' by adding the missing citation details.
The sentence is slightly unclear due to missing references.
8.
LOWcopyedit
Add a comma after '0.1ml as a 20% dose' in Methods, Study procedures for readability.
Minor punctuation improvement.
9.
LOWcopyedit
Rephrase the sentence in Discussion, paragraph 3 about cost reduction for clarity.
The sentence is slightly awkward and could be more direct.

Full text (26,171 chars)Analyzed: Aug 16, 2026