Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.

Name: Kaimen Rigor review — A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.
Item: A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.
Rating: 59
Author: Alpha1

Lucinde RK, Gathuri H, Mwaniki P, Orindi B, Otieno EO, Mwakio S, Mulemi L, Isaaka L, Shangala J, Saisi M, Isinde E, Oginga IN, Wachira AW, Manuthu E, Kariuki H, Asaava P, Nyikuli J, Wekesa C, Otedo A, Bosire H, Okoth SB, Ongalo W, Mukabi DM, Lusamba W, Muthui B, Adembesa I, Mithi C, Sood M, Aliyan NA, Gituma B, Matiko MG, Omondi CA, Ombajo LA, Kirui N, Ochola L, Abdi AI, Kagucia EW, English M, Hamaluba M, Ochola-Oyier I, Kamuya D, Bejon P, Barasa E, Agweyu A, Akech S, Etyang AO

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 1.5★ (Critical), 0 critical, 6 high issues for “A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 10, 2026

Read alongside

A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.

Read full text (PMC)

DOI

10.1056/NEJMoa2507100

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/e36aeff9-38ef-481a-9744-64b7e55e4482" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/e36aeff9-38ef-481a-9744-64b7e55e4482/badge" alt="Kaimen Rigor review — 1.5★ (Critical), 0 critical, 6 high issues for “A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

75dc9f64348e8bf78a9a701eee50280c497d185ff4449eee7bc4214af788af65

Verify via API

Issued Aug 10, 2026Engine 7.29.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.

Paper source

A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 10, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

1.5 / 5

Critical — serious problems across many checks

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×4−2★
ReportingKey resources not met−0.5★
ReportingData & code availability not met−0.5★
ReportingEthical approvals partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.29.0Source: full text

Biggest issues

01Key resources not identified
highDisclosurereviewer-assessedFull detail
The investigational glucocorticoids are named with doses but not with manufacturer/source; statistical software is not identified. This fails the resource identification criteria.
02Data and code not shared
highDisclosurereviewer-assessedFull detail
No data availability statement, repository deposit, or code sharing is provided; the paper only mentions that the protocol is available at NEJM.org.
03Internal contradictions in the reported numbers
mediumArithmeticreviewer-assessedFull detail
Table 1 shows notable imbalances in several baseline characteristics (hypertension, diabetes, congestive heart failure, pulse rate) between the two arms, yet the text claims 'The characteristics of participants at enrollment... were similar between the trial arms.' This requires explanation.
The characteristics of participants at enrollment... were similar between the trial arms. ... Hypertension: 47 (4.3) [control], 143 (13.1) [intervention]; Diabetes mellitus: 157 (14.4) [control], 50 (4.6) [intervention]
Table 1reviewer’s wording
04Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“https://www.pactr.org/PACTR202111481740832”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 02OverreachNone found 103AuthenticityData authenticity concerns 304DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit7 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This pragmatic open-label RCT of adjunctive glucocorticoids for CAP in Kenya is well-designed (central randomization, pre-specified power, verified statistical analyses) and transparent in most reporting dimensions. Its main weaknesses are the absence of a data-availability statement, incomplete identification of key resources (drug manufacturers, statistical software), and a missing explicit regulatory-compliance statement, plus an unreconciled baseline imbalance claim versus Table 1.

Two independent reviewer runs (same model) converged on all eight dimension statuses and the overall score; minor divergence on the open-label justification and the chronic-illness table consistency did not change any status. The statistics verification recomputed only 2 of the paper's tests (limited coverage); the citation check found no retracted or unlocatable references (29 checked).

Numerical inconsistencies

1 finding · worst medium

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 1 via agent-written checks.

Overstated conclusions

None found

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Checked — nothing surfaced.

6 major claims checked against the paper's own evidence: all adequately supported.

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

Data authenticity concerns

1 finding · worst low

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Data look implausibly cleanAssessed

4 integrity concerns flagged (0 high).

Reporting gaps

3 findings · worst high

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data and code not sharedAssessed
Key resources not identifiedAssessed
Ethics/consent reporting incompleteAssessed

Eight Dimensions5 pass · 1 warn · 2 fail

The background cites prior trials and systematic reviews on glucocorticoids for CAP, notes the higher mortality in sub-Saharan Africa, and identifies gaps such as exclusion of HIV/TB patients, older age, and ICU focus. The rationale for the trial is logically linked to these gaps.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper clearly establishes the scientific premise by citing prior studies, acknowledging their limitations, and providing a rationale for the trial in low-resource settings.

Evidence

“Data from two recently published trials and systematic reviews of adjunctive hydrocortisone in CAP requiring intensive care unit (ICU) admission – , indicate reduced mortality among these patients.”

Introduction ¶2Find in source

paraphrase[Background, paragraph 2]

“The paper notes that previous trials excluded patients with comorbidities common in sub-Saharan Africa, were conducted in older populations, and were mostly in ICU settings.”

“We conducted a pragmatic randomized controlled trial to evaluate the effectiveness and safety of adjunctive low-dose glucocorticoids among adult patients hospitalized with CAP in Kenya.”

IntroductionFind in source

PASSReviewer 2· 95% conf

The paper clearly establishes the scientific foundation by citing relevant prior trials, systematic reviews, and guidelines, and identifies gaps in evidence for low-resource settings.

Evidence

Introduction ¶2Find in source

“First, previous trials were conducted among significantly older patients than those in sSA, excluding patients with comorbidities that are common among CAP patients in sSA such as human immunodeficiency virus (HIV) infection and pulmonary tuberculosis.”

Introduction ¶3Find in source

paraphrase[Background, paragraph 3]

“Finally, most of the evidence showing mortality reduction with use of adjunctive glucocorticoids is derived from studies conducted in critical care units, non-ICU based studies did not have mortality as a primary endpoint.”

Randomization was performed centrally by an independent statistician using sealed opaque envelopes. The unit of randomization is the individual patient. The trial is open-label, which is acknowledged and justified by the pragmatic nature. An a priori power calculation (85% power, 25% relative reduction) is provided. Inclusion and exclusion criteria are explicitly defined. Missing data are handled under a missing-at-random assumption with sensitivity analyses. For a human RCT, all applicable criteria are met.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study design is adequately described with randomization, power analysis, inclusion/exclusion criteria, and missing data handling. The open-label design is stated but without explicit rationale in methods, which is a minor limitation.

Evidence

“A randomization list was prepared centrally by an independent trial statistician prior to recruitment, who sealed randomization cards in opaque envelopes.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“We estimated that enrollment of 2180 patients would provide 85% power to detect a 25% relative reduction in mortality at day 30, assuming 20% mortality in the control arm and 15% in the glucocorticoid arm while allowing for 5% loss to follow-up.”

paraphrase[Methods, Trial procedures]

“Participants in this open label trial were randomly assigned...”

PASSReviewer 2· 95% conf

The trial design is rigorous, with central randomization, pre-specified power analysis, clear inclusion/exclusion criteria, and appropriate handling of missing data.

Evidence

“A randomization list was prepared centrally by an independent trial statistician prior to recruitment, who sealed randomization cards in opaque envelopes.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Eligible patients were adults (aged 18 years or older) with a diagnosis of CAP who did not have a clear indication for glucocorticoids to be included as part of their treatment.”

MethodsFind in source

Table 1 reports sex, age, BMI, comorbidities, and other clinical characteristics. Race/ethnicity is not reported, though the population is from Kenya.

Sub-criteria

demographicsINADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Sex, age, and health status are reported, but race/ethnicity is not explicitly stated, which is a minor omission.

Evidence

paraphrase[Table 1]

“Sex, no. (%) ... Male 593 (54.4) ... Female 498 (45.6)”

paraphrase[Results and Table 1]

“Median age was 53.0 years (IQR 38–72 years) ... Body mass index, kg/m2: 24.0±7.6”

absence[Table 1]

Race/ethnicity not reported.

PASSReviewer 2· 80% conf

Sex, age, weight, and health status are reported, but race/ethnicity is not explicitly stated, leaving a minor gap in demographics.

Evidence

paraphrase[Results, Table 1]

“Sex, no. (%) – Male: 593 (54.4) [control], 578 (53.1) [intervention]; Female: 498 (45.6) [control], 511 (46.9) [intervention]”

paraphrase[Results, first paragraph]

“The median age was 53.0 years (IQR 38–72 years)... and 808 (37.1%) had low oxygen saturation (SpO2 < 90%) at admission.”

absence[Results, Table 1 and entire text]

Race/ethnicity is not reported.

The paper lists ethical approval from KEMRI SERU, Pharmacy and Poisons Board, and Oxford Tropical Research Ethics Committee with protocol numbers. Written informed consent was obtained. However, no explicit statement of compliance with the Declaration of Helsinki or ICH-GCP is provided.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 85% conf

Ethical approvals from named bodies and informed consent are reported, but explicit adherence to a regulatory framework (e.g., Declaration of Helsinki) is not stated.

Evidence

“We obtained ethical approval from the Kenyan Medical Research Institute Scientific and Ethics Review Unit (SERU 4319), the Kenya Pharmacy and Poisons Board (ECCT/21/11/02), and the University of Oxford’s Tropical Research Ethics Committee (OxTREC 4–22).”

MethodsFind in source

“Written informed consent was obtained from participants and/or their legally acceptable representative.”

MethodsFind in source

absence[Methods, Trial Oversight]

No explicit regulatory compliance statement (e.g., Declaration of Helsinki).

WARNReviewer 2· 85% conf

Ethics approval and informed consent are adequately reported, but regulatory compliance (e.g., Declaration of Helsinki) is not explicitly stated.

Evidence

MethodsFind in source

“Written informed consent was obtained from participants and/or their legally acceptable representative.”

MethodsFind in source

absence[Methods, Trial Oversight]

Regulatory compliance statement is absent.

The paper lists the glucocorticoids and doses (dexamethasone 6mg, etc.) but does not provide manufacturer or source. Standard care antibiotics are not specified with manufacturer. No statistical software is mentioned. Therefore, all applicable criteria are inadequate.

Sub-criteria

mycoplasma testingN/A

reagents identifiedINADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedNOT REPORTED

Per reviewer (2) — the votes behind the verdict

FAILReviewer 1· 90% conf

The investigational glucocorticoids are named with doses but not with manufacturer/source; statistical software is not identified. This fails the resource identification criteria.

Evidence

paraphrase[Methods, Trial procedures]

“a single daily dose of one of five locally available glucocorticoids in bioequivalent doses for a total of 10 days. These were dexamethasone 6mg, hydrocortisone 160mg, methylprednisolone 30mg, prednisolone 50mg or prednisone 50mg.”

absence[Methods, Statistical analysis]

Statistical software not identified.

FAILReviewer 2· 90% conf

The investigational drugs (glucocorticoids) are named but not fully identified (manufacturer/source missing), and the statistical software used is not reported.

Evidence

paraphrase[Methods, Trial procedures and follow-up]

“Those assigned to the intervention arm were further randomized to receive a single daily dose of one of five locally available glucocorticoids in bioequivalent doses for a total of 10 days... These were dexamethasone 6mg, hydrocortisone 160mg, methylprednisolone 30mg, prednisolone 50mg or prednisone 50mg.”

absence[Methods, Statistical analysis]

Statistical software is not identified.

Cox regression and log-rank test are named. Proportional hazards assumption assessed. Exact p=0.021 and 0.049 reported. HR with 95% CI given. Software not identified. The chronic illness subcategories sum to less than the total chronic illness count, which is a minor inconsistency but not a demonstrable error.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedADEQUATE

mathematical plausibilityWARN

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical tests are named, assumptions are verified, exact p-values and effect sizes with CIs are reported. However, statistical software is not identified, and there is a minor discrepancy in the chronic illness subcategories.

Evidence

paraphrase[Methods, Statistical analysis]

“A Cox regression model incorporating study site as a stratification variable was used to estimate the hazard ratio ... The proportional hazards assumption was assessed by plotting Schoenfeld residuals and confirmed to be valid.”

“Hazard Ratio, 0.84; 95% confidence interval (CI), 0.73 to 0.97, P=0.021.”

AbstractFind in source

paraphrase[Table 1]

“Chronic illness , no. (%) | 398 (36.0) | 390 (35.8) ... Hypertension | 47 (4.3) | 143 (13.1) ... Others | 10 (0.9) | 42 (3.9)”

PASSReviewer 2· 85% conf

Statistical methods are well-described, assumptions verified, exact p-values and effect sizes with CIs reported, and data presentation is appropriate for a large trial. The only gap is the omission of software identification.

Evidence

paraphrase[Methods, Statistical analysis]

“A Cox regression model incorporating study site as a stratification variable was used to estimate the hazard ratio (HR) for mortality and its associated 95% confidence interval. The proportional hazards assumption was assessed by plotting Schoenfeld residuals and confirmed to be valid.”

“hazard ratio 0.84 [95% CI, 0.73–0.97]; P=0.021”

ResultsFind in source

absence[Methods, Statistical analysis]

Statistical software not reported.

The paper does not include a statement about where the data or analysis code can be accessed. The only mention of data access is that the first and last authors vouch for the data, which does not constitute a data availability statement. For a clinical trial, a data-sharing plan is expected. All applicable sub-criteria are not reported, resulting in a fail.

Sub-criteria

code sharingNOT REPORTED

accession numbersN/A

repository depositNOT REPORTED

data availability statementNOT REPORTED

Per reviewer (2) — the votes behind the verdict

FAILReviewer 1· 90% conf

No data availability statement is provided; only that the authors vouch for data accuracy. Trial registration numbers are given but not a data access statement.

Evidence

paraphrase[Methods, Trial Oversight]

“The first and the last authors had access to all study data and vouch for the accuracy and completeness of the data and the analyses, and for adherence of the trial to the protocol (available at nejm.org).”

absence[Entire paper]

No code sharing mentioned.

FAILReviewer 2· 95% conf

No data availability statement, repository deposit, or code sharing is provided; the paper only mentions that the protocol is available at NEJM.org.

Evidence

absence[Entire text]

No data availability statement is present.

absence[Entire text]

No repository deposit is mentioned.

absence[Entire text]

No code sharing is mentioned.

Trial registration numbers are provided. The methods are adequately detailed. Limitations are discussed in the discussion. The conclusion is proportional to the evidence. However, the paper does not state adherence to a reporting guideline, and a pre-specified secondary outcome (immune response) is not reported in this paper.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedINADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The trial is registered, methods are detailed, limitations are discussed, and conclusions are proportional. However, no explicit CONSORT checklist is referenced, and one pre-specified secondary outcome is deferred to a future report.

Evidence

paraphrase[Abstract]

“PACTR number PACTR202111481740832 ... ISRCTN number ISRCTN36138594”

“Our main limitation lies in the heterogenous patient population that we enrolled in the trial due to limited diagnostic and treatment capabilities.”

DiscussionFind in source

“Results of an additional pre-specified secondary outcome examining immune responses by study arm will be reported later.”

MethodsFind in source

PASSReviewer 2· 85% conf

Methods are detailed, trial is registered, limitations are discussed, and conclusions are proportional. However, a reporting guideline is not referenced, and one pre-specified secondary outcome is deferred to a future report.

Evidence

paraphrase[Abstract]

“PACTR number PACTR202111481740832, ISRCTN number ISRCTN36138594”

“Results of an additional pre-specified secondary outcome examining immune responses by study arm will be reported later.”

MethodsFind in source

“Our main limitation lies in the heterogenous patient population that we enrolled in the trial due to limited diagnostic and treatment capabilities.”

Discussion ¶4Find in source

Registered (1 ID: ISRCTN). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 29 references by DOI: 23 verified — 6 no DOI (shown, not verified).

4 data/code links checked; 1 live, 1 dead.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, punctuation.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published trial is robust in design and primary analysis (recomputed tests consistent), but readers should weigh the absence of IPD access, the missing drug-manufacturer/software identification, the unaddressed baseline imbalances in Table 1, and the mid-trial restriction of two glucocorticoid arms. These are reporting gaps that warrant a clarifying correction/erratum rather than invalidating the primary result.

1.
HIGHdata code
Add a data availability statement (e.g., in Methods/Trial Oversight) specifying where de-identified individual patient data and analysis code can be accessed (managed-access platform) or why sharing is not possible.
Absence of a data-sharing statement on a large publicly funded trial is a major reproducibility gap that readers will weigh.
2.
HIGHrigor
Reconcile the text claim that baseline characteristics were 'similar between the trial arms' with the notable Table 1 imbalances (hypertension 4.3% vs 13.1%; diabetes 14.4% vs 4.6%; pulse-rate categories) — add a note or amend the text.
The internal contradiction between the text and Table 1 is a transparency/validity concern that readers must weigh.
3.
HIGHrigor
Clarify whether discontinuation of the hydrocortisone and prednisone arms after the second month of recruitment was pre-specified or post-hoc, and discuss its potential bias.
Mid-trial restriction of intervention arms could bias the comparison and should be transparently explained.
4.
HIGHother
Provide manufacturer/source (and lot numbers where available) for the five glucocorticoids and name the statistical software with version.
Key resources are not fully identified, hindering replication and resource-identification standards.
5.
HIGHreporting
Report the pre-specified secondary outcome on immune responses or provide a firm publication timeline.
Deferring a pre-specified outcome raises selective-reporting concerns for readers.
6.
HIGHdata code
Fix the dead link identified in the reproducibility check of the paper's cited/published links.
A stated data/code link that fails to resolve undercuts any data-availability claim and reproducibility expectations.
7.
MEDIUMethics
Add an explicit statement of regulatory compliance (e.g., conducted in accordance with the Declaration of Helsinki / ICH-GCP) to the Trial Oversight section.
The missing compliance statement is a fixable reporting gap that contributed to the ethics warn.
8.
MEDIUMreporting
Reference the CONSORT 2010 checklist (or applicable extension) and provide the completed checklist as supplementary material.
Referencing a reporting guideline strengthens transparency for a pragmatic trial.
9.
MEDIUMstatistics
Clarify Table 1 so that the sum of chronic-illness subcategories reconciles with the total chronic-illness count (add a note or breakdown).
The current presentation is internally inconsistent and could mislead readers interpreting baseline comorbidity burden.
10.
MEDIUMreporting
State the race/ethnicity of participants (e.g., Black African) to complete the demographics reporting.
Demographics reporting is incomplete without race/ethnicity, a minor but relevant omission.
11.
LOWcopyedit
Apply copyedit fixes: hyphenate 'open-label' and 'follow-up', add colon after 'Methods', and clean up Table 1 footnote punctuation.
Minor consistency improvements that polish the manuscript.
12.
LOWcopyedit
Acknowledge the baseline pulse-rate imbalance (e.g., ≥125/min: 10.0% control vs 14.1% intervention) in the text or table footnote.
The notable imbalance is currently unaddressed and should be surfaced for readers.

Full text (29,626 chars)Analyzed: Aug 10, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.

Read full text (PMC)

DOI

10.1056/NEJMoa2507100

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/e36aeff9-38ef-481a-9744-64b7e55e4482" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/e36aeff9-38ef-481a-9744-64b7e55e4482/badge" alt="Kaimen Rigor review — 1.5★ (Critical), 0 critical, 6 high issues for “A Pragmatic Trial of Glucocorticoids for Community-Acquired Pneumonia.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

75dc9f64348e8bf78a9a701eee50280c497d185ff4449eee7bc4214af788af65

Verify via API

Issued Aug 10, 2026Engine 7.29.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

1.5 / 5

Critical — serious problems across many checks

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×4−2★
ReportingKey resources not met−0.5★
ReportingData & code availability not met−0.5★
ReportingEthical approvals partially met−0.25★
LinksDead data/code link−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.29.0Source: full text

Biggest issues

01Key resources not identified
highDisclosurereviewer-assessedFull detail
The investigational glucocorticoids are named with doses but not with manufacturer/source; statistical software is not identified. This fails the resource identification criteria.
02Data and code not shared
highDisclosurereviewer-assessedFull detail
No data availability statement, repository deposit, or code sharing is provided; the paper only mentions that the protocol is available at NEJM.org.
03Internal contradictions in the reported numbers
mediumArithmeticreviewer-assessedFull detail
Table 1 shows notable imbalances in several baseline characteristics (hypertension, diabetes, congestive heart failure, pulse rate) between the two arms, yet the text claims 'The characteristics of participants at enrollment... were similar between the trial arms.' This requires explanation.
The characteristics of participants at enrollment... were similar between the trial arms. ... Hypertension: 47 (4.3) [control], 143 (13.1) [intervention]; Diabetes mellitus: 157 (14.4) [control], 50 (4.6) [intervention]
Table 1reviewer’s wording
04Declared data/code link does not resolve
mediumAvailabilityrecomputedFull detail
Dead link — nothing to verify.
“https://www.pactr.org/PACTR202111481740832”
Find in source

Findings by category

Numerical inconsistencies

1 finding · worst medium

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 1 via agent-written checks.

Overstated conclusions

None found

Checked — nothing surfaced.

6 major claims checked against the paper's own evidence: all adequately supported.

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

Data authenticity concerns

1 finding · worst low

Data look implausibly cleanAssessed

4 integrity concerns flagged (0 high).

Reporting gaps

3 findings · worst high

Data and code not sharedAssessed
Key resources not identifiedAssessed
Ethics/consent reporting incompleteAssessed

Eight Dimensions5 pass · 1 warn · 2 fail

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper clearly establishes the scientific premise by citing prior studies, acknowledging their limitations, and providing a rationale for the trial in low-resource settings.

Evidence

Introduction ¶2Find in source

paraphrase[Background, paragraph 2]

“The paper notes that previous trials excluded patients with comorbidities common in sub-Saharan Africa, were conducted in older populations, and were mostly in ICU settings.”

“We conducted a pragmatic randomized controlled trial to evaluate the effectiveness and safety of adjunctive low-dose glucocorticoids among adult patients hospitalized with CAP in Kenya.”

IntroductionFind in source

PASSReviewer 2· 95% conf

The paper clearly establishes the scientific foundation by citing relevant prior trials, systematic reviews, and guidelines, and identifies gaps in evidence for low-resource settings.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

paraphrase[Background, paragraph 3]

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Evidence

“A randomization list was prepared centrally by an independent trial statistician prior to recruitment, who sealed randomization cards in opaque envelopes.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

paraphrase[Methods, Trial procedures]

“Participants in this open label trial were randomly assigned...”

PASSReviewer 2· 95% conf

The trial design is rigorous, with central randomization, pre-specified power analysis, clear inclusion/exclusion criteria, and appropriate handling of missing data.

Evidence

“A randomization list was prepared centrally by an independent trial statistician prior to recruitment, who sealed randomization cards in opaque envelopes.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Eligible patients were adults (aged 18 years or older) with a diagnosis of CAP who did not have a clear indication for glucocorticoids to be included as part of their treatment.”

MethodsFind in source

Table 1 reports sex, age, BMI, comorbidities, and other clinical characteristics. Race/ethnicity is not reported, though the population is from Kenya.

Sub-criteria

demographicsINADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 80% conf

Sex, age, and health status are reported, but race/ethnicity is not explicitly stated, which is a minor omission.

Evidence

paraphrase[Table 1]

“Sex, no. (%) ... Male 593 (54.4) ... Female 498 (45.6)”

paraphrase[Results and Table 1]

“Median age was 53.0 years (IQR 38–72 years) ... Body mass index, kg/m2: 24.0±7.6”

absence[Table 1]

Race/ethnicity not reported.

PASSReviewer 2· 80% conf

Sex, age, weight, and health status are reported, but race/ethnicity is not explicitly stated, leaving a minor gap in demographics.

Evidence

paraphrase[Results, Table 1]

“Sex, no. (%) – Male: 593 (54.4) [control], 578 (53.1) [intervention]; Female: 498 (45.6) [control], 511 (46.9) [intervention]”

paraphrase[Results, first paragraph]

“The median age was 53.0 years (IQR 38–72 years)... and 808 (37.1%) had low oxygen saturation (SpO2 < 90%) at admission.”

absence[Results, Table 1 and entire text]

Race/ethnicity is not reported.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 85% conf

Ethical approvals from named bodies and informed consent are reported, but explicit adherence to a regulatory framework (e.g., Declaration of Helsinki) is not stated.

Evidence

MethodsFind in source

“Written informed consent was obtained from participants and/or their legally acceptable representative.”

MethodsFind in source

absence[Methods, Trial Oversight]

No explicit regulatory compliance statement (e.g., Declaration of Helsinki).

WARNReviewer 2· 85% conf

Ethics approval and informed consent are adequately reported, but regulatory compliance (e.g., Declaration of Helsinki) is not explicitly stated.

Evidence

MethodsFind in source

“Written informed consent was obtained from participants and/or their legally acceptable representative.”

MethodsFind in source

absence[Methods, Trial Oversight]

Regulatory compliance statement is absent.

Sub-criteria

mycoplasma testingN/A

reagents identifiedINADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedNOT REPORTED

Per reviewer (2) — the votes behind the verdict

FAILReviewer 1· 90% conf

The investigational glucocorticoids are named with doses but not with manufacturer/source; statistical software is not identified. This fails the resource identification criteria.

Evidence

paraphrase[Methods, Trial procedures]

absence[Methods, Statistical analysis]

Statistical software not identified.

FAILReviewer 2· 90% conf

The investigational drugs (glucocorticoids) are named but not fully identified (manufacturer/source missing), and the statistical software used is not reported.

Evidence

paraphrase[Methods, Trial procedures and follow-up]

absence[Methods, Statistical analysis]

Statistical software is not identified.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedADEQUATE

mathematical plausibilityWARN

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Evidence

paraphrase[Methods, Statistical analysis]

“Hazard Ratio, 0.84; 95% confidence interval (CI), 0.73 to 0.97, P=0.021.”

AbstractFind in source

paraphrase[Table 1]

“Chronic illness , no. (%) | 398 (36.0) | 390 (35.8) ... Hypertension | 47 (4.3) | 143 (13.1) ... Others | 10 (0.9) | 42 (3.9)”

PASSReviewer 2· 85% conf

Evidence

paraphrase[Methods, Statistical analysis]

“hazard ratio 0.84 [95% CI, 0.73–0.97]; P=0.021”

ResultsFind in source

absence[Methods, Statistical analysis]

Statistical software not reported.

Sub-criteria

code sharingNOT REPORTED

accession numbersN/A

repository depositNOT REPORTED

data availability statementNOT REPORTED

Per reviewer (2) — the votes behind the verdict

FAILReviewer 1· 90% conf

No data availability statement is provided; only that the authors vouch for data accuracy. Trial registration numbers are given but not a data access statement.

Evidence

paraphrase[Methods, Trial Oversight]

absence[Entire paper]

No code sharing mentioned.

FAILReviewer 2· 95% conf

No data availability statement, repository deposit, or code sharing is provided; the paper only mentions that the protocol is available at NEJM.org.

Evidence

absence[Entire text]

No data availability statement is present.

absence[Entire text]

No repository deposit is mentioned.

absence[Entire text]

No code sharing is mentioned.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedINADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Evidence

paraphrase[Abstract]

“PACTR number PACTR202111481740832 ... ISRCTN number ISRCTN36138594”

“Our main limitation lies in the heterogenous patient population that we enrolled in the trial due to limited diagnostic and treatment capabilities.”

DiscussionFind in source

“Results of an additional pre-specified secondary outcome examining immune responses by study arm will be reported later.”

MethodsFind in source

PASSReviewer 2· 85% conf

Evidence

paraphrase[Abstract]

“PACTR number PACTR202111481740832, ISRCTN number ISRCTN36138594”

“Results of an additional pre-specified secondary outcome examining immune responses by study arm will be reported later.”

MethodsFind in source

“Our main limitation lies in the heterogenous patient population that we enrolled in the trial due to limited diagnostic and treatment capabilities.”

Discussion ¶4Find in source

Registered (1 ID: ISRCTN). No reporting guideline cited.

Broken references and links

1 finding · worst medium

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Dead data/code linksRecomputed

Checked 29 references by DOI: 23 verified — 6 no DOI (shown, not verified).

4 data/code links checked; 1 live, 1 dead.

Copyediting

7 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 7 minor suggestions below.

7 copyedit issues flagged: mostly consistency, clarity, punctuation.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Add a data availability statement (e.g., in Methods/Trial Oversight) specifying where de-identified individual patient data and analysis code can be accessed (managed-access platform) or why sharing is not possible.
Absence of a data-sharing statement on a large publicly funded trial is a major reproducibility gap that readers will weigh.
2.
HIGHrigor
Reconcile the text claim that baseline characteristics were 'similar between the trial arms' with the notable Table 1 imbalances (hypertension 4.3% vs 13.1%; diabetes 14.4% vs 4.6%; pulse-rate categories) — add a note or amend the text.
The internal contradiction between the text and Table 1 is a transparency/validity concern that readers must weigh.
3.
HIGHrigor
Clarify whether discontinuation of the hydrocortisone and prednisone arms after the second month of recruitment was pre-specified or post-hoc, and discuss its potential bias.
Mid-trial restriction of intervention arms could bias the comparison and should be transparently explained.
4.
HIGHother
Provide manufacturer/source (and lot numbers where available) for the five glucocorticoids and name the statistical software with version.
Key resources are not fully identified, hindering replication and resource-identification standards.
5.
HIGHreporting
Report the pre-specified secondary outcome on immune responses or provide a firm publication timeline.
Deferring a pre-specified outcome raises selective-reporting concerns for readers.
6.
HIGHdata code
Fix the dead link identified in the reproducibility check of the paper's cited/published links.
A stated data/code link that fails to resolve undercuts any data-availability claim and reproducibility expectations.
7.
MEDIUMethics
Add an explicit statement of regulatory compliance (e.g., conducted in accordance with the Declaration of Helsinki / ICH-GCP) to the Trial Oversight section.
The missing compliance statement is a fixable reporting gap that contributed to the ethics warn.
8.
MEDIUMreporting
Reference the CONSORT 2010 checklist (or applicable extension) and provide the completed checklist as supplementary material.
Referencing a reporting guideline strengthens transparency for a pragmatic trial.
9.
MEDIUMstatistics
Clarify Table 1 so that the sum of chronic-illness subcategories reconciles with the total chronic-illness count (add a note or breakdown).
The current presentation is internally inconsistent and could mislead readers interpreting baseline comorbidity burden.
10.
MEDIUMreporting
State the race/ethnicity of participants (e.g., Black African) to complete the demographics reporting.
Demographics reporting is incomplete without race/ethnicity, a minor but relevant omission.
11.
LOWcopyedit
Apply copyedit fixes: hyphenate 'open-label' and 'follow-up', add colon after 'Methods', and clean up Table 1 footnote punctuation.
Minor consistency improvements that polish the manuscript.
12.
LOWcopyedit
Acknowledge the baseline pulse-rate imbalance (e.g., ≥125/min: 10.0% control vs 14.1% intervention) in the text or table footnote.
The notable imbalance is currently unaddressed and should be surfaced for readers.

Full text (29,626 chars)Analyzed: Aug 10, 2026