An Omicron-specific, self-amplifying mRNA booster vaccine for COVID-19: a phase 2/3 randomized trial.
Saraf A, Gurjar R, Kaviraj S, Kulkarni A, Kumar D, Kulkarni R, Virkar R, Krishnan J, Yadav A, Baranwal E, Singh A, Raghuwanshi A, Agarwal P, Savergave L, Singh S, GEMCOVAC-OM Study Investigators
- DOI
- 10.1038/s41591-024-02955-2
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-22
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/b06afde3-0131-41d7-89a3-30485cad7f59 is authoritative.
How this rating was calculated
- IntegrityIntegrity concern ×3−1.5★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- CitationsUnresolved reference−0.25★
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary efficacy claim is based on immunogenicity endpoints (neutralizing antibody titers, anti-spike IgG, seroconversion, and cellular responses) as surrogates for clinical protection against COVID-19. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking these specific surrogate markers to clinical outcomes in this context. The authors acknowledge that an efficacy study was not possible and an immunobridging approach was used.
“An efficacy study was not possible and, hence, an immunobridging approach was used.”
- 02Treatment effect not shown to be clinically meaningful
The primary effect size is a 1.76-fold rise in neutralizing antibody titers from baseline (GMT 623.9 to 1099.9) and a 1.58-fold higher titer compared to ChAdOx1 nCoV-19. While statistically significant, the magnitude is modest and not anchored to a clinically meaningful threshold or minimal clinically important difference. The paper does not provide evidence that this magnitude of immune response translates into clinical benefit.
“GEMCOVAC-OM showed a 1.76-fold increase in neutralizing antibody titers against Omicron BA.1, while no significant change in the neutralization titers was observed with ChAdOx1 nCoV-19”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted phase 2/3 randomized open-label trial with strong reporting of ethics, randomization, sample size, and key resources. The main weaknesses are minor: lack of blinding (acknowledged), threshold p-values, missing cell line authentication/mycoplasma testing, and a few copyedit issues.
Both reviewers classified the study as interventional, and I adopt that. The evaluation covered all eight dimensions; several sub-criteria were not applicable (e.g., animal housing, IACUC, independent replication). The reviewers diverged slightly on demographics and controls, but the evidence supports adequate reporting. The statistics verification recomputed 4 tests consistently, but coverage is limited; threshold p-values were not machine-verified.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 4 tests: 4 consistent, 0 inconsistent; 4 via agent-written checks.
- CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Check p-value for LSGMR of neutralizing antibodies at day 29 in phase 3 (GEMCOVAC-OM vs ChAdOx1 nCoV-19).
“LSGMR (GEMCOVAC-OM/ChAdOx1 nCoV-19) 95% CI d | 1.58 (1.36–1.84) | | P value d | <0.0001”
Taken as given: The LSGMR is a ratio estimate with a 95% CI.; The p-value is two-sided.; The CI is a 95% confidence interval.Method: Recomputed p-value from the reported LSGMR and 95% CI using the pCI function for a log-scale ratio.How we recomputed it: pCI(1.58, 1.36, 1.84, 1) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 1Check p-value for difference in seroconversion at day 29 in phase 3.
“The seroresponse rate difference between GEMCOVAC-OM and ChAdOx1 nCoV-19 was 19.93 (95% CI 10.57–28.43), which was statistically significant ( P < 0.0001).”
Taken as given: The difference is an absolute difference in percentages.; The p-value is two-sided.; The CI is a 95% confidence interval.Method: Recomputed p-value from the reported difference and 95% CI using the pCI function for a linear scale.How we recomputed it: pCI(19.93, 10.57, 28.43, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 2P-value for the difference in seroconversion at day 29 (GEMCOVAC-OM vs ChAdOx1 nCoV-19) reported as <0.0001.
“The seroresponse rate difference between GEMCOVAC-OM and ChAdOx1 nCoV-19 was 19.93 (95% CI 10.57–28.43), which was statistically significant ( P < 0.0001).”
Taken as given: The difference is an absolute percentage difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the pCI function for a linear scale.How we recomputed it: pCI(19.93, 10.57, 28.43, 0) - CONSISTENTreported p = .149 · recomputed p = .150Reviewer 2P-value for the change in neutralizing antibody titers from baseline to day 29 in the ChAdOx1 nCoV-19 arm reported as 0.1490.
“In contrast, no significant change in the GMT of neutralizing antibodies was observed with ChAdOx1 nCoV-19 from baseline (775.3, 95% CI 620.2–969.2) to day 29 (754.9, 95% CI 631.5–902.5, P = 0.1490; Fig. ).”
Taken as given: The test used is a paired t-test or Wilcoxon signed-rank test.; The p-value is two-sided.; The reported p-value corresponds to a z-score of approximately 1.44.Method: Approximated p-value from a z-score of 1.44 using the normal distribution.How we recomputed it: pZ(1.44)
- lowinternal contradictionThe number of participants in the phase 3 safety cohort is reported as 3,140, but the sum of the GEMCOVAC-OM (3,000) and ChAdOx1 nCoV-19 (140) arms equals 3,140, which is consistent. However, the text states '3,000 and 140 participants were enrolled in the GEMCOVAC-OM and the ChAdOx1 nCoV-19 arms, respectively' and later 'The day 29 visit was completed by 3,119 participants of which 404 (271 in the GEMCOVAC-OM arm and 133 in ChAdOx1 nCoV-19 arm) were included in the primary immunogenicity endpoint.' The sum of 271 and 133 is 404, which is consistent. No contradiction found.
“In phase 3, a total of 3,140 participants were enrolled from 15 November 2022 to 24 November 2022; 3,000 and 140 participants were enrolled in the GEMCOVAC-OM and the ChAdOx1 nCoV-19 arms, respectively.”
ResultsFind in source - lowinternal contradictionThe paper reports that 14 participants were excluded due to prior booster, but the numbers in the CONSORT diagram may not exactly match the text. The text says '14 participants (9 in GEMCOVAC-OM arm and 5 in ChAdOx1 nCoV-19 arm) had already received a booster vaccine' and these were excluded. The CONSORT diagram is not fully visible in the text, but the numbers seem consistent.
“After vaccination on day 1, it was found that 14 participants (9 in GEMCOVAC-OM arm and 5 in ChAdOx1 nCoV-19 arm) had already received a booster vaccine for COVID-19.”
ResultsFind in source
Overstated conclusions
2 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
7 major claims checked against the paper's own evidence: all adequately supported.
- supportedReviewer 1GEMCOVAC-OM is safe and well tolerated as a booster dose.The safety data presented (AEs, SAEs) support the claim of safety, with no related serious adverse events.Evidence: Safety results show no related SAEs and most AEs were mild.
“GEMCOVAC-OM was well tolerated with no related serious adverse events in both phase 2 and phase 3.”
AbstractFind in source - supportedReviewers 1, 2GEMCOVAC-OM induces significantly higher anti-spike IgG antibodies compared to GEMCOVAC-19 in phase 2.The reported LSGMR and p-value support the claim.Evidence: LSGMR of anti-spike IgG antibodies (GEMCOVAC-OM/GEMCOVAC-19) was 3.40 (95% CI 2.79–4.13, P < 0.0001).
“The LSGMR of anti-spike IgG antibodies (GEMCOVAC-OM/GEMCOVAC-19) calculated using analysis of covariance (ANCOVA) was 3.40 (95% CI 2.79–4.13, P < 0.0001).”
ResultsFind in source - supportedReviewer 1GEMCOVAC-OM is noninferior and superior to ChAdOx1 nCoV-19 in terms of neutralizing antibody titers and seroconversion rate.The primary endpoint criteria for noninferiority and superiority were met based on the reported LSGMR and seroconversion difference.Evidence: LSGMR at day 29 was 1.58 (95% CI 1.36–1.84), lower bound >0.67; seroconversion difference 19.93 (95% CI 10.57–28.43), lower bound >-10% and >0%.
“GEMCOVAC-OM was noninferior (primary endpoint) and superior to ChAdOx1 nCoV-19 in terms of neutralizing antibody titers and seroconversion rate (lower bound 95% confidence interval of least square geometric mean ratio >1 and difference in seroconversion >0% for superiority).”
AbstractFind in source - supportedReviewers 1, 2GEMCOVAC-OM boosts immune responses against the B.1.1.529 variant.The immunogenicity data show significant increases in neutralizing and binding antibodies, supporting the claim.Evidence: Neutralizing antibody titers increased significantly from baseline to day 29 (P < 0.0001) in the GEMCOVAC-OM arm.
“These results demonstrate that GEMCOVAC-OM is safe and boosts immune responses against the B.1.1.529 variant.”
AbstractFind in source - supportedReviewers 1, 2GEMCOVAC-OM is the first samRNA vaccine to receive Emergency Use Authorization.The paper states this as a fact, and it is plausible given the context, but it is not independently verified.Evidence: The paper states 'GEMCOVAC-OM is thermostable and the first samRNA vaccine to receive an Emergency Use Authorization.'
“GEMCOVAC-OM is thermostable and the first samRNA vaccine to receive an Emergency Use Authorization.”
DiscussionFind in source - supportedReviewer 2GEMCOVAC-OM is safe and well tolerated with no related serious adverse events.The paper reports safety data showing no related serious AEs and a comparable AE profile to comparators.Evidence: Safety results in phase 2 and 3, including AE rates and serious AEs.
“GEMCOVAC-OM was well tolerated with no related serious adverse events in both phase 2 and phase 3.”
AbstractFind in source - supportedReviewer 2GEMCOVAC-OM is noninferior and superior to ChAdOx1 nCoV-19 in terms of neutralizing antibody titers and seroconversion.The primary endpoint of noninferiority was met, and superiority was also demonstrated based on the lower bounds of the 95% CIs.Evidence: Phase 3 results: LSGMR 1.58 (95% CI 1.36–1.84), lower bound >0.67; seroconversion difference 19.93 (95% CI 10.57–28.43), lower bound >0.
The lower bound 95% CI of LSGMR was above the prespecified criteria of noninferiority (>0.67). ... Moreover, the lower bound 95% CI for LSGMR and the lower bound 95% CI of difference in seroconversion were above the superiority criteria of >1 and >0%, respectively.
Resultsreviewer’s wording
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary efficacy claim is based on immunogenicity endpoints (neutralizing antibody titers, anti-spike IgG, seroconversion, and cellular responses) as surrogates for clinical protection against COVID-19. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking these specific surrogate markers to clinical outcomes in this context. The authors acknowledge that an efficacy study was not possible and an immunobridging approach was used.
“An efficacy study was not possible and, hence, an immunobridging approach was used.”
- INADEQUATEEffect sizeThe primary effect size is a 1.76-fold rise in neutralizing antibody titers from baseline (GMT 623.9 to 1099.9) and a 1.58-fold higher titer compared to ChAdOx1 nCoV-19. While statistically significant, the magnitude is modest and not anchored to a clinically meaningful threshold or minimal clinically important difference. The paper does not provide evidence that this magnitude of immune response translates into clinical benefit.
“GEMCOVAC-OM showed a 1.76-fold increase in neutralizing antibody titers against Omicron BA.1, while no significant change in the neutralization titers was observed with ChAdOx1 nCoV-19”
Data authenticity concerns
1 finding · worst lowAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
- Other integrity concernAssessed
3 integrity concerns flagged (0 high).
- lowotherThe paper reports that in phase 3, the GEMCOVAC-OM arm had 2,990 participants in Table 1, but the text states 3,000 were enrolled and 9 were excluded due to prior booster, leaving 2,991. The table shows N=2,990, which is off by one. This could be due to a participant who withdrew consent or was lost to follow-up, but the discrepancy is not explicitly explained.
“Phase 3 | GEMCOVAC-OM ( N = 2,990) | ChAdOx1 nCoV-19 ( N = 133)”
Table 1Find in source
Reporting gaps
None foundRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
Checked — nothing surfaced.
The introduction cites the global COVID-19 burden, the limitations of existing vaccines (cold chain, access), and the emergence of Omicron, justifying the development of GEMCOVAC-OM. It acknowledges the strengths of mRNA vaccines and the specific advantages of the samRNA platform. The rationale for the study is logically linked to the unmet need for an Omicron-specific booster, and the study objectives follow from this premise. Limitations of prior research (e.g., immune imprinting with bivalent vaccines) are discussed, and the study design addresses them by using a monovalent Omicron-specific vaccine.
“Vaccines designed for SARS-CoV-2 have been effective in mitigating the COVID-19 pandemic . Various platforms have been used to develop COVID-19 vaccines.”
“To cater to this unmet need, we developed GEMCOVAC-OM, a monovalent, Omicron-specific (BA.1) booster mRNA vaccine for COVID-19 (ref. ).”
“However, the benefit of adding the Wuhan-specific mRNA was limited due to immune imprinting (antigenic sin) .”
“Vaccines designed for SARS-CoV-2 have been effective in mitigating the COVID-19 pandemic . Various platforms have been used to develop COVID-19 vaccines.”
“However, the benefit of adding the Wuhan-specific mRNA was limited due to immune imprinting (antigenic sin) .”
Randomization was performed using an interactive web response system (IWRS) with stratified block randomization in phase 3, and randomization codes were generated by an independent biostatistician. The unit of randomization is the individual participant. Blinding was not performed (open-label) due to different delivery mechanisms, which is stated as a limitation. A priori sample size calculations were provided for phase 3 primary endpoints, with specified effect sizes, alpha, and power. Inclusion/exclusion criteria are described, and the analysis population (full analysis set) is defined. Outlier handling is not explicitly described, but the analysis population and protocol deviations are reported. Controls are the comparator vaccines (GEMCOVAC-19 and ChAdOx1 nCoV-19). Independent replication is not applicable for a single pivotal trial.
“Participants who met the inclusion criteria and successfully completed all screening procedures were randomized in the study by using the interactive web response system (IWRS).”
“A sample size of 420 (280 in GEMCOVAC-OM and 140 in ChAdOx1 nCoV-19) was found adequate for assessing noninferiority of neutralizing antibody titers if the lower limit of the two-sided 95% CI of the LSGMR (GMT GEMCOVAC-OM /GMT ChAdOx1 nCoV-19 ) was >0.67 considering a standard deviation of 1.82, alpha error of 5%, power of 90% and dropout rate of 20%.”
“Blinding of participants in the study was not possible due to the different mechanisms of delivery, which has the potential to introduce a bias in the safety assessment.”
“Participants who met the inclusion criteria and successfully completed all screening procedures were randomized in the study by using the interactive web response system (IWRS).”
“A sample size of 420 (280 in GEMCOVAC-OM and 140 in ChAdOx1 nCoV-19) was found adequate for assessing noninferiority of neutralizing antibody titers if the lower limit of the two-sided 95% CI of the LSGMR (GMT GEMCOVAC-OM /GMT ChAdOx1 nCoV-19 ) was >0.67 considering a standard deviation of 1.82, alpha error of 5%, power of 90% and dropout rate of 20%.”
“Blinding of participants in the study was not possible due to the different mechanisms of delivery, which has the potential to introduce a bias in the safety assessment.”
Sex is reported for both phases, with a predominance of males. Age, weight, and BMI are reported in Table 1. Demographics are reported, including age and sex, but race/ethnicity and comorbidities are not detailed. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.
“Of note, there were considerably more men in both phase 2 (87.1% in GEMCOVAC-OM and 91.4% in GEMCOVAC-19) and phase 3 (68.2% in GEMCOVAC-OM and 79.7% in ChAdOx1 nCoV-19).”
“Age, median years (range) | 32 (20–49) | 30 (20–45) | | Gender | | Female | 9 (12.9%) | 6 (8.6%) | | Male | 61 (87.1%) | 64 (91.4%) | | Weight, mean in kg (s.d.) | 64.8 (5.07) | 63.7 (5.17) | | Body mass index in kg m −2 , mean (s.d.) | 23.2 (1.67) | 23.0 (1.54)”
“Age, median years (range) | 32 (20–49) | 30 (20–45) | | Gender | | Female | 9 (12.9%) | 6 (8.6%) | | Male | 61 (87.1%) | 64 (91.4%) | | Weight, mean in kg (s.d.) | 64.8 (5.07) | 63.7 (5.17)”
“We conducted a subgroup analysis of the humoral immunogenicity data based on primary vaccination in both phase 2 and phase 3 and observed that the differences in immune responses between GEMCOVAC-OM and the comparators were consistent.”
The study protocol was approved by the local ethics committee at each study site and the Central Drugs Standard Control Organisation, the central licensing authority in India. Informed consent was obtained from participants, as stated in the Methods. Regulatory compliance with the Declaration of Helsinki and ICH-GCP is stated. The trial is registered with CTRI.
“The study protocol was approved by the local ethics committee at each study site and Central Drugs Standard Control Organisation, the central licensing authority in India.”
“Eligible participants provided signed informed consent forms at enrollment.”
“The phase 3 study was conducted at 20 hospitals in 13 cities across India in compliance with the principles defined in the Declaration of Helsinki, International Conference for Harmonisation Good Clinical Practice Guideline.”
“The study protocol was approved by the local ethics committee at each study site and Central Drugs Standard Control Organisation, the central licensing authority in India.”
“Eligible participants provided signed informed consent forms at enrollment.”
“The phase 3 study was conducted at 20 hospitals in 13 cities across India in compliance with the principles defined in the Declaration of Helsinki, International Conference for Harmonisation Good Clinical Practice Guideline.”
The investigational products (GEMCOVAC-OM, GEMCOVAC-19, ChAdOx1 nCoV-19) are identified with composition, dose, and administration route. Antibodies used in assays are identified with vendor and catalog numbers (e.g., BD 557851). Software tools are identified with versions (e.g., SAS 9.4, FlowJo 10.8.1). Cell lines (Vero E6) are mentioned but not authenticated; mycoplasma testing is not reported. Since this is a clinical trial with wet-lab assays, these criteria are applicable.
“CD3 PE-Cy7 (BD 557851, clone SK7, 1:20), CD4 BV480 (BD 566104, clone SK3, 1:20), CD8 FITC (BD 555366, clone RPA-T8, 1:5), IFNγ PE (BD 559327, clone B27, 1:5), TNF APC (BD 551384, clone MAb11, 1:5), IL-2 BV421 (BD 562914, clone 5344.111, 1:20)”
“GEMCOVAC-OM, 10 µg in 0.1 ml, was administered intradermally using a Tropis needle-free injection system (PharmaJet).”
“Statistical analysis for humoral immunogenicity was performed using Statistical software SAS version 9.4 (SAS Institute). Figures were generated using GraphPad Prism (Version 9.5.1).”
“GEMCOVAC-OM, 10 µg in 0.1 ml, was administered intradermally using a Tropis needle-free injection system (PharmaJet).”
“CD3 PE-Cy7 (BD 557851, clone SK7, 1:20), CD4 BV480 (BD 566104, clone SK3, 1:20), CD8 FITC (BD 555366, clone RPA-T8, 1:5), IFNγ PE (BD 559327, clone B27, 1:5), TNF APC (BD 551384, clone MAb11, 1:5), IL-2 BV421 (BD 562914, clone 5344.111, 1:20)”
“Statistical analysis for humoral immunogenicity was performed using Statistical software SAS version 9.4 (SAS Institute).”
Statistical tests are named (e.g., ANCOVA, paired t-test, Wilcoxon signed-rank test, Miettinen-Nurminen method). Assumptions are addressed via normality testing (Shapiro-Wilk) and use of non-parametric tests when needed. Exact p-values are reported for many comparisons, but some are reported as '<0.0001' which is a threshold, not exact. Effect sizes with confidence intervals are reported (e.g., LSGMR with 95% CI). Statistical software is identified. Data presentation includes geometric means with 95% CIs and per-group n. Mathematical plausibility checks were not performed due to lack of raw data; however, no obvious inconsistencies were noted.
“The LSGMR of neutralizing antibody titers in both the arms at day 29 from the PRNT 50 (BA.1 strain of SARS-CoV-2) assay was calculated using ANCOVA with baseline titers as covariates.”
“LSGMR (GEMCOVAC-OM/ChAdOx1 nCoV-19) 95% CI d | 1.58 (1.36–1.84)”
“The rise in neutralizing antibody titers from baseline to day 29 was compared using a paired t -test. The LSGMR of neutralizing antibody titers in both the arms at day 29 from the PRNT 50 (BA.1 strain of SARS-CoV-2) assay was calculated using ANCOVA with baseline titers as covariates.”
“LSGMR of the neutralizing antibodies for the treatment groups (GEMCOVAC-OM/ChAdOx1 nCoV-19) at day 29 was 1.58 (95% CI 1.36–1.84; Table ).”
The data availability statement provides a concrete route for accessing individual participant data: requests must be approved by an ethics committee, directed to the corresponding author, and a data access agreement signed; data will be shared through a secure online platform within 2 months. This is reported_and_adequate. Repository deposit and accession numbers are not applicable for patient-level data, but DDBJ accession numbers for the vaccine sequences are provided. Code sharing is not applicable as no custom code was used.
“Individual participant data will be made available for meta-analysis when the trial is complete. The request should be approved by an ethics committee or the institutional review board of the institution to which the person requesting the information belongs. If approved, it should be directed to the corresponding author at sanjay.singh@gennova.co.in. The requester will need to sign a data access agreement. Data will be shared through a secure online platform within 2 months from the signing of the access agreement.”
“DDBJ datasets were used to design GEMCOVAC-19 (accession no. LC776732.1 ) and GEMCOVAC-OM (accession no. LC769018 ).”
“No custom code or mathematical algorithms were used in this study.”
“Individual participant data will be made available for meta-analysis when the trial is complete. The request should be approved by an ethics committee or the institutional review board of the institution to which the person requesting the information belongs. If approved, it should be directed to the corresponding author at sanjay.singh@gennova.co.in. The requester will need to sign a data access agreement. Data will be shared through a secure online platform within 2 months from the signing of the access agreement.”
“DDBJ datasets were used to design GEMCOVAC-19 (accession no. LC776732.1 ) and GEMCOVAC-OM (accession no. LC769018 ).”
“No custom code or mathematical algorithms were used in this study.”
The trial is registered with CTRI (CTRI/2022/10/046475). A CONSORT diagram is included (Fig. 1). The paper does not explicitly mention a reporting guideline checklist, but the CONSORT diagram and reporting summary are present. All pre-specified outcomes are reported, including negative results (e.g., no significant change in ChAdOx1 nCoV-19 arm). Limitations are explicitly discussed. Conclusions are proportional to the evidence, with appropriate caveats. Funding sources and competing interests are disclosed.
“Clinical Trial Registry India identifier: CTRI/2022/10/046475”
“The study has several limitations. (1) The study participants were predominantly male, and as such, the results may be more representatives of men than women.”
“This study was partially funded through grants from the Department of Biotechnology (DBT), Government of India under the Ind CEPI project (BT/COVID0041/01/20) and the Mission COVID Suraksha, which is the Indian COVID-19 Vaccine Development Mission, managed by the Biotechnology Industry Research Assistance Council (BIRAC) and DBT (BT/CS0002/CS/01/20).”
“Clinical Trial Registry India identifier: CTRI/2022/10/046475”
“The study has several limitations. (1) The study participants were predominantly male, and as such, the results may be more representatives of men than women.”
“This study was partially funded through grants from the Department of Biotechnology (DBT), Government of India under the Ind CEPI project (BT/COVID0041/01/20) and the Mission COVID Suraksha, which is the Indian COVID-19 Vaccine Development Mission, managed by the Biotechnology Industry Research Assistance Council (BIRAC) and DBT (BT/CS0002/CS/01/20).”
Registered (1 ID: Clinical Trials Registry – India). Reporting guideline cited: CONSORT.
Broken references and links
1 finding · worst lowReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
- References not resolvable to a published paperRecomputed
Checked 50 references by DOI: 45 verified — 1 DOI unresolved, 4 no DOI (shown, not verified).
- UNRESOLVED10.1046/j.0306-5251.2001.01397-3.xPoints to consider on switching between superiority and non-inferiorityCited DOI does not resolve to any Crossref record.
- NO DOICOVID-19 dashboardNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIStatement on the antigen composition of COVID-19 vaccinesNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIDAIDS adverse event grading tablesNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIConsiderations for the assessment of COVID-19 vaccines for listing by WHONo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
2 of 3 data/code links checked; 2 live; 1 not probed.
- datahttps://ctri.nic.in/Clinicaltrials/pmaindet2.php?EncHid=NjY5MDM=&Enc=&userName=gemcovacLIVEHTTP 200Resolved page looks like data.
- datahttps://rsc.niaid.nih.gov/clinical-research-sites/daids-adverse-event-grading-tablesUNVERIFIEDLiveness indeterminate — content not checked.
- datahttps://www.who.int/publications/m/item/considerations-for-the-assessment-of-covid-19-vaccines-for-listing-by-whoLIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
7 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 7 minor suggestions below.
7 copyedit issues flagged: mostly consistency, typo, clarity.
- MINORconsistencyResults, Humoral Immunogenicity“P < 0.0001”→ Consider reporting exact p-values where possible, e.g., 'P = 1.2e-7'.Threshold p-values are common in large trials but exact values are preferred.
- MINORtypoDiscussion, Limitations“the results may be more representatives of men than women”→ Change to 'the results may be more representative of men than women'.Grammatical error.
- MINORconsistencyMethods, Statistical analysis“Meitinen–Nurminen method”→ Correct to 'Miettinen–Nurminen method'.Spelling inconsistency; elsewhere spelled correctly.
- MINORclarityResults, Safety“A total 1.40% of participants”→ Change to 'A total of 1.40% of participants'.Missing word 'of'.
- MINORconsistencyResults, Humoral Immunogenicity“The seroresponse rate difference (secondary endpoint) calculated using the Miettinen–Nurminen method was 35.71 (95% CI 22.35–48.52, P < 0.0001).”→ Ensure consistent use of 'seroresponse' vs 'seroconversion' throughout the manuscript.The paper uses both terms; consider standardizing.
- MINORtypoMethods, Statistical analysis“The difference in seroconversion was determined using the Meitinen–Nurminen method.”→ Correct spelling to 'Miettinen–Nurminen'.Typo in the method name.
- MINORclarityResults, Safety“A total 1.40% of participants in GEMCOVAC-OM and 2.26% in ChAdOx1 nCoV-19 reported unsolicited events until day 180.”→ Add 'of' after 'total' for grammatical correctness.Minor grammatical issue.
The published work is robust and well-reported; an informed reader should weigh the open-label design and the minor reporting gaps (threshold p-values, cell line authentication) as limitations, but none warrant an erratum. The paper is suitable for citation with appropriate caveats.
- 1.HIGHreportingIn the Methods, explicitly state that the CONSORT reporting guideline was followed and provide the CONSORT checklist as supplementary material.The paper includes a CONSORT diagram but does not explicitly reference the guideline, which is a standard transparency requirement for clinical trials.
- 2.HIGHstatisticsIn the Results, report exact p-values instead of thresholds (e.g., 'P < 0.0001' could be reported as 'P = 1.2e-7') or state that values below 0.0001 are reported as such.Exact p-values improve precision and allow readers to assess the strength of evidence more accurately.
- 3.HIGHrigorIn the Methods, add a statement about mycoplasma testing for the Vero E6 cells used in the PRNT assay, or clarify that it was not performed.Mycoplasma contamination can affect assay results; reporting its absence or testing status is important for reproducibility.
- 4.HIGHrigorIn the Methods, provide authentication details for the Vero E6 cell line (e.g., STR profiling) or state that it was not authenticated.Cell line authentication is a standard requirement to ensure the validity of results obtained with the cell line.
- 5.HIGHreportingVerify the reference 'Points to consider on switching between superiority and non-inferiority' (DOI 10.1046/j.0306-5251.2001.01397-3.x) as it was not found in the registry; correct or replace it if it is fabricated.A reference that cannot be found in any registry may be fabricated, which is a serious integrity concern.
- 6.MEDIUMreportingIn the Methods, clarify the handling of outliers in the immunogenicity analysis, if any.Outlier handling is not explicitly described, which could affect the robustness of the results.
- 7.MEDIUMreportingIn the Results, include a breakdown of demographics by race/ethnicity and comorbidities to improve generalizability.The current demographics lack these variables, which limits the assessment of generalizability to broader populations.
- 8.MEDIUMreportingIn the Discussion, expand on the potential impact of the lack of blinding on immunogenicity outcomes, not just safety.The current limitation statement only mentions safety bias; immunogenicity outcomes could also be affected by knowledge of treatment assignment.
- 9.MEDIUMreportingIn the Methods, specify the exact version of the statistical analysis plan and protocol used for the final analysis.This improves transparency and reproducibility by clarifying which version of the plan was followed.
- 10.MEDIUMdata codeIn the Data Availability, consider depositing aggregated data in a public repository to increase transparency, while maintaining patient privacy.Aggregated data would allow independent verification of the main findings without compromising patient confidentiality.
- 11.MEDIUMreportingIn the Methods, clarify the handling of missing data for the day 90 and day 180 visits in the statistical analysis section.Missing data handling is not described, which could affect the validity of the long-term immunogenicity results.
- 12.MEDIUMreportingIn the Methods, provide the full inclusion and exclusion criteria in the main text or as a supplement to improve reproducibility.The current description may be incomplete, and full criteria are needed for replication.
- 13.MEDIUMrigorIn the Methods, add a note on the validation of the in-house ELISA and PRNT assays, including any reference standards used.Assay validation is critical for the reliability of the immunogenicity endpoints.
- 14.MEDIUMreportingIn the Discussion, address the potential for confounding due to prior infection status, which was not accurately captured.Prior infection can affect immune responses; not accounting for it may bias the results.
- 15.LOWcopyeditIn the Discussion, Limitations, correct the typo: 'more representatives of men' to 'more representative of men'.Grammatical error that should be fixed for clarity.
- 16.LOWcopyeditIn the Methods, Statistical analysis, correct the spelling of 'Meitinen–Nurminen' to 'Miettinen–Nurminen'.Spelling inconsistency in the method name.
- 17.LOWcopyeditIn the Results, Safety, add the missing word 'of' in 'A total 1.40% of participants'.Grammatical error that should be fixed.
- 18.LOWcopyeditIn the Results, Humoral Immunogenicity, standardize the use of 'seroresponse' vs 'seroconversion' throughout the manuscript.Inconsistent terminology may confuse readers.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.