Alpha¹ by KaimenConfidential

Kaimen Rigor review

Permethrin-Treated Baby Wraps for the Prevention of Malaria.

Boyce RM, Shook-Sa BE, Ndizeye R, Baguma E, Giandomenico D, Cassidy CA, Eshun S, Siedner MJ, Staedke SG, Ntaro M, Juliano JJ, Reyes R, Mulogo EM

DOI: 10.1056/NEJMoa2501628
Record issued: 2026-08-10
Engine: 7.29.0
Exported: 2026-09-20

Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/0a7187f8-a894-4c39-8614-78df4ff526f2 is authoritative.

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ReportingEthical approvals partially met−0.25★
ReportingKey resources partially met−0.25★
ReportingStatistical analysis partially met−0.25★

Model-reported confidence: highReviewer agreement: moderateEngine: 7.29.0Source: full text

Findings by category

101ArithmeticNumerical inconsistencies 102OverreachOverstated conclusions 03AuthenticityNone found 304DisclosureReporting gaps 05AvailabilityNone found 06Copyedit10 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper reports a well-conducted RCT with thorough design and transparent reporting, but contains several reporting gaps that reduce reproducibility: missing regulatory compliance statement, missing statistical software identification, unspecified statistical model, and a lack of exact p-values. Minor numerical inconsistencies in baseline tables should be corrected.

All three reviewer runs (from the same model) converged on most dimensions; the two disagreements (ethical approvals, key resources, statistical analysis) were resolved by weighing the checklist-level evidence. The statistics component checked only 2 tests (both consistent); the remaining inferential statistics are unverified. No retracted or fabricated citations were found.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 2 tests: 2 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 1 via agent-written checks.

Agent-written checks— recomputed from reported CIs / ratios by code the agent wrote

CONSISTENTreported p < .001 · recomputed p = <.001
Recomputed incidence rate ratio 0.34 (95% CI 0.23–0.51), reported p<0.001
“incidence rate ratio 0.34, 95% CI 0.23–0.51, p<0.001”
Find in source
Taken as given: 0.23–0.51 is a two-sided 95% confidence interval for the incidence rate ratio of 0.34, not a range, an IQR, or a different interval level; the incidence rate ratio is a RATIO measure, so the interval is symmetric on the log scale; p<0.001 is the p for THIS estimate, not for another comparison in the same sentence
Method: back the two-tailed p out of the log-scale CI width and compare it against the printed p
How we recomputed it: pCI(0.34, 0.23, 0.51, 1)
CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 1
Two-tailed p-value for the primary IRR derived from the reported point estimate and 95% CI
“Clinical malaria incidence was 2.14 (95% CI 1.73–2.62) and 0.73 (95% CI 0.51–1.02) per 100 person weeks in the sham-treated and permethrin-treated arms, respectively (incidence rate ratio 0.34, 95% CI 0.23–0.51, p<0.001).”
Find in source
Taken as given: The printed 0.34 is the incidence rate ratio on the ratio scale; The printed 0.23–0.51 is the two-sided 95% confidence interval for that ratio; The paper computed the p-value for the same IRR contrast
Method: Two-tailed p reconstructed from a ratio estimate and its 95% CI assuming a normal/log scale (pCI with log=1).
How we recomputed it: pCI(0.34, 0.23, 0.51, 1)

lowinternal contradiction
In Table 1, the permethrin-arm MUAC category percentages (37 (19.0%) and 163 (82.0%)) sum to 101% and do not equal the exact values (18.5% and 81.5%); this is a minor rounding error.
“Moderate acute malnutrition | 30 (15.0) | 37 (19.0) | | Adequately nourished | 170 (85.0) | 163 (82.0)”
Table 1Find in source
lowinternal contradiction
The in-text baseline mRDT-positive percentages (10.7% and 10.1%) do not match Table 1's values (10.5% and 10.0%); 21/200 = 10.5% and 20/200 = 10.0%, so the text is slightly wrong.
“A total of 41 (10.3%) children tested positive for malaria during the baseline household visit and received treatment with artemether-lumefantrine, including 21 (10.7%) in the sham- and 20 (10.1%) in the permethrin-treated arm.”
Table 1Find in source

Overstated conclusions

1 finding · worst low

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: all adequately supported.

partialReviewer 1
The repellent effect may also provide some protection to those in the immediate area, including the mother and other household members.
This is a clearly hedged hypothesis ('may') with no direct evidence in the paper; maternal outcomes are still being analyzed.
Evidence: None presented; maternal outcomes reported as ongoing and to be reported separately.
“The repellent effect may also provide some protection to those in the immediate area, including the mother and other household members.”
DiscussionFind in source
partialReviewer 2
The magnitude of the effect suggests that a substantial proportion of malaria risk is occurring during times when children are not under LLINs.
The inference is logical given the high LLIN use and the large effect, but the study did not directly measure outdoor biting or LLIN adherence, and the claim is based on indirect evidence.
Evidence: Discussion states that the effect size highlights gaps in LLIN-focused strategies, but entomological endpoints were not included.
“the magnitude of the effect found in our study, especially given the reported LLIN use among participants, suggests that a substantial proportion of malaria risk is occurring during these times.”
DiscussionFind in source
partialReviewer 3
Treated wraps could provide an additional level of protection against malaria.
The trial shows efficacy in a single setting, but generalizability to other settings and long-term use is not yet proven. The paper acknowledges this limitation.
Evidence: Primary outcome results and discussion of limitations (single site, need for further research).
“Given alignment with existing cultural practices, treated wraps could provide an additional level of protection against malaria.”
DiscussionFind in source
partialReviewer 3
The magnitude of the effect suggests that a substantial proportion of malaria risk is occurring during times when the child is not under a LLIN.
This is an interpretation based on the observed effect, but the paper notes that no entomological endpoints were included, so the mechanism is not confirmed. The claim is plausible but not directly supported by the study data.
Evidence: Discussion: 'Yet, the magnitude of the effect found in our study, especially given the reported LLIN use among participants, suggests that a substantial proportion of malaria risk is occurring during these times.'
“Yet, the magnitude of the effect found in our study, especially given the reported LLIN use among participants, suggests that a substantial proportion of malaria risk is occurring during these times.”
DiscussionFind in source
supportedReviewers 1, 2, 3
Use of permethrin-treated baby wraps significantly reduced clinical malaria incidence among young children with access to bednets.
The primary-outcome evidence directly supports this headline claim.
Evidence: IRR 0.34 (95% CI 0.23–0.51), p<0.001; incidence 0.73 vs 2.14 per 100 person-weeks; risk ratio 0.48 (95% CI 0.33–0.69) at 24 weeks.
“Use of permethrin-treated baby wraps significantly reduced clinical malaria incidence among young children with access to bednets.”
ConclusionFind in source
supportedReviewer 1
Protection was attained even with provision of LLINs and high levels of reported use.
Reported bednet use was very high, supporting the claim.
Evidence: Children were reported to have slept under the LLIN more than 99% of nights.
“This level of protection was attained even with provision of LLINs to participants and high levels of reported use.”
ResultsFind in source
supportedReviewers 1, 2, 3
Adverse events were infrequent, mild, and similar between arms.
The safety data support the claim.
Evidence: Rash in 8.5% (permethrin) vs 6.0% (sham); all rashes mild; no SAEs in the permethrin arm; one severe malaria in the sham arm.
“Adverse events were infrequent, mild, and similar between arms.”
DiscussionFind in source
supportedReviewers 1, 2, 3
Permethrin-treated wraps are effective at preventing malaria without evident safety concerns for six months of use.
The six-month RCT follow-up supports efficacy and short-term safety.
Evidence: Primary outcome IRR 0.34 and safety outcomes across the 24-week trial.
“These findings demonstrate that permethrin-treated wraps are effective at preventing malaria in perennial-transmission settings and without evident safety concerns, at least for six months of use.”
DiscussionFind in source
supportedReviewer 2
Treated wraps could provide an additional level of protection against malaria beyond LLINs.
The significant reduction in malaria incidence in the context of high LLIN use supports this claim.
Evidence: Primary outcome IRR 0.34 (95% CI 0.23-0.51), with LLIN use >99% of nights.
“assuming the wraps primarily exerted their effect on dusk/dawn biting, they could work synergistically with household-based interventions such as LLINs and indoor residual spraying.”
DiscussionFind in source

Efficacy claim is anchored to an adequate endpoint and a meaningful effect.

ADEQUATESurrogate endpoint
The primary outcome is clinical malaria (fever plus positive RDT), a hard clinical event, not a surrogate biomarker.
“The primary outcome was clinical malaria in children, defined as fever (temperature of ≥38.0 Celsius) or reported fever within the past 24 hours and a positive malaria RDT.”
Find in source
ADEQUATEEffect size
Incidence rate ratio 0.34 (66% reduction) with 95% CI 0.23–0.51; risk ratio at 24 weeks 0.48 (52% reduction). Absolute reduction from 2.14 to 0.73 per 100 person-weeks. Effect is large and clinically meaningful.
“The incidence of clinical malaria was 0.73 and 2.14 cases per 100 person weeks in the permethrin- and sham-treated arms, respectively (IRR 0.34, 95%CI 0.23–0.51, IRD −1.41, 95%CI −2.02 - −0.83).”
Find in source

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

3 findings · worst high

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Statistical reporting gaps (tests, assumptions, effect sizes)Assessed
Ethics/consent reporting incompleteAssessed
Key resources under-identified (antibodies, cell lines, RRIDs)Assessed

Eight Dimensions5 pass · 3 warn

Prior work is cited to contextualize the need for complementary innovations, including limitations of LLINs, vaccines, and seasonal chemoprevention. The premise that treated wraps could protect during outdoor/daytime biting is logically derived from the evidence. Limitations of prior research (e.g., waning vaccine efficacy in infants, feasibility of seasonal chemoprevention in perennial settings) are acknowledged.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 92% conf

The trial is well grounded in prior literature on ITN/insecticide-treated clothing and clearly links the premise to a testable hypothesis.

Evidence

paraphrase[Introduction]

“Similar approaches have been employed for military uniforms, as well as clothing and blankets for refugees.”

“We hypothesized that treating wraps with repellent might provide an additional layer of protection against malaria.”

IntroductionFind in source

PASSReviewer 2· 95% conf

The paper establishes a clear scientific foundation, citing prior work on malaria burden, insecticide resistance, outdoor biting, and gaps in existing interventions, and provides a logical rationale for the study.

Evidence

paraphrase[Background, paragraph 1-3]

“Paraphrase: The background cites studies on insecticide resistance, outdoor biting, seasonal chemoprevention, and malaria vaccines, noting waning protection and reduced efficacy in infants.”

“We hypothesized that treating wraps with repellent might provide an additional layer of protection against malaria.”

Introduction ¶3Find in source

“Yet existing vaccines are characterized by waning protection and appear to be less effective in infants.”

Introduction ¶2Find in source

PASSReviewer 3· 95% conf

The paper clearly establishes the scientific premise by citing prior research on malaria burden, limitations of existing interventions, and the rationale for treated wraps, and addresses gaps in prior work.

Evidence

paraphrase[Introduction, paragraphs 1-3]

“Despite gains, progress against malaria has stalled; insecticide resistance and outdoor biting are cited; seasonal chemoprevention and vaccines have limitations.”

“We hypothesized that treating wraps with repellent might provide an additional layer of protection against malaria.”

Introduction ¶4Find in source

paraphrase[Introduction, paragraph 3]

“Existing vaccines characterized by waning protection and less effective in infants; seasonal chemoprevention feasibility uncertain in perennial transmission.”

Randomization was performed using REDCap with a permuted block design, stratified by age and site. The trial is described as double-blind, with blinding of participants and clinicians; the distinct odor of permethrin is acknowledged as a potential limitation. A power analysis justified the sample size of 400 pairs. Inclusion/exclusion criteria are clearly stated. The analysis follows an intention-to-treat approach with censoring for recurrent infections.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 93% conf

Core design elements are reported and adequate for a human RCT: randomization, blinding, power analysis, and inclusion/exclusion criteria are all described.

Evidence

“Randomization was stratified by age of the child (age 6–11 months and 12–18 months) and clinical site, using a permuted block design.”

MethodsFind in source

“A total of 400 mother-infant pairs (200 per arm) were required to detect a 30% reduction in the incidence of clinical malaria (i.e., incidence rate ratio [IRR]=0.70) in the permethrin-treated arm relative to the sham-treated arm over the 24-week study period with a two-sided test, power of 0.80, and type I error 0.05.”

Statistical analysisFind in source

“Study participants and clinicians remained blinded to the study allocation.”

MethodsFind in source

PASSReviewer 2· 95% conf

The study design is rigorous for a human RCT: randomization method, blinding, power analysis, inclusion/exclusion criteria are all adequately reported.

Evidence

“Randomization was stratified by age of the child (age 6–11 months and 12–18 months) and clinical site, using a permuted block design. Randomization was performed on-site by a research assistant using REDCap.”

Methods ¶3Find in source

paraphrase[Methods, paragraph 4 and Discussion]

“Study participants and clinicians remained blinded to the study allocation. ...permethrin does have a distinct odor which could not be blinded.”

Statistical analysisFind in source

PASSReviewer 3· 95% conf

The study design is rigorous: randomization method, unit, blinding, power analysis, inclusion/exclusion criteria, and pre-specified analysis population are all adequately reported.

Evidence

MethodsFind in source

“Study participants and clinicians remained blinded to the study allocation.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“A total of 400 mother-infant pairs (200 per arm) were required to detect a 30% reduction in the incidence of clinical malaria... with a two-sided test, power of 0.80, and type I error 0.05.”

All applicable sub-criteria are reported and adequate. Sex of children is reported in Table 1 (47% female in sham, 49% in permethrin). Age, weight (MUAC), and health status (hemoglobin, malaria status) are detailed. Demographics include maternal age, education, household characteristics, and travel time. Sex justification is not applicable as both sexes are included.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 90% conf

Sex, age, weight/nutritional status, and demographic characteristics are reported for the human participants.

Evidence

“Female | 94 (47.0) | 98 (49.0) | | Age in months (Median (Q1, Q3)) | 11.0 (8.0, 14.0) | 12.0 (8.0, 15.0)”

Table 1Find in source

“MUAC in cm (Median (Q1, Q3)) | 14.3 (13.8, 15.1) | 14.3 (13.6, 15.2)”

Table 1Find in source

PASSReviewer 2· 90% conf

Biological variables are adequately reported for a human trial: sex, age, health status, and demographics are provided.

Evidence

“Female | 94 (47.0) | 98 (49.0)”

Table 1Find in source

paraphrase[Table 1 and Methods]

“Paraphrase: Table 1 includes age in months, MUAC, hemoglobin, and baseline malaria test results.”

paraphrase[Table 1]

“Paraphrase: Table 1 includes maternal age, education, parity, place of birth, household characteristics (floor material, water source, livestock, etc.).”

PASSReviewer 3· 95% conf

Biological variables for human subjects are adequately reported: child's sex, age, MUAC, hemoglobin, and maternal demographics are provided.

Evidence

paraphrase[Table 1]

“Female 94 (47.0%) [sham], 98 (49.0%) [permethrin]”

paraphrase[Table 1]

“Age in months, MUAC in cm, and hemoglobin in g/dL are shown with medians and quartiles.”

paraphrase[Table 1]

“Maternal age, parity, education, place of birth, household members, floor material, water source, etc., are listed.”

The trial was approved by three named ethics bodies (WCG IRB, Mbarara University REC, Uganda National Council for Science and Technology). Written informed consent from mothers is stated. However, the paper does not explicitly state compliance with the Declaration of Helsinki, ICH-GCP, or other regulatory frameworks, which is required for a human trial. The adherence to CONSORT guidelines is a reporting standard, not a regulatory compliance statement.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceNOT REPORTED

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 95% conf

Named ethics bodies approved the trial and written informed consent was obtained.

Evidence

“The trial was approved by the WCG Institutional Review Board, the Mbarara University of Science and Technology Research Ethics Committee, and the Uganda National Council of Science and Technology.”

MethodsFind in source

“Written informed consent was obtained from the mother.”

MethodsFind in source

WARNReviewer 2· 90% conf

Ethical approval and informed consent are explicitly reported, but a statement of regulatory compliance with a recognized framework is missing.

Evidence

Methods ¶1Find in source

“Written informed consent was obtained from the mother.”

Methods ¶1Find in source

absence[Methods, paragraph 1 and throughout]

No explicit statement of compliance with Declaration of Helsinki or ICH-GCP is present.

WARNReviewer 3· 90% conf

Ethics approval and informed consent are adequately reported, but a statement of regulatory compliance (e.g., Declaration of Helsinki) is missing.

Evidence

MethodsFind in source

“Written informed consent was obtained from the mother.”

MethodsFind in source

absence[Methods, Study Design and throughout]

No statement of adherence to a regulatory framework (e.g., Declaration of Helsinki) is found.

The permethrin is identified by manufacturer (Sawyer Products), dilution (0.5%), and treatment procedure. The bed net (PermaNet 2.0, Vestergaard) is also identified. However, the statistical software (e.g., SAS, R, Stata) used for the primary analysis is not mentioned, which is a key resource for reproducibility. Other sub-criteria (antibodies, cell lines, mycoplasma, organisms) are not applicable to this clinical trial.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedNOT REPORTED

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 88% conf

The investigational product (permethrin-treated wraps) and the LLIN are identified with manufacturer, formulation, and regimen; REDCap is named.

Evidence

paraphrase[Methods, Interventions]

“Wraps were soaked in permethrin diluted to 0.5% in accordance with the manufacturer's instructions (Sawyer Products, Safety Harbor, FL)”

“All participants received a new, pyrethroid-only LLIN (PermaNet 2.0, Vestergaard).”

MethodsFind in source

WARNReviewer 2· 80% conf

The investigational product (permethrin) is adequately identified, but the statistical software used for analysis is not reported.

Evidence

“Wraps were soaked in permethrin diluted to 0.5% in accordance with the manufacturer’s instructions (Sawyer Products, Safety Harbor, FL)”

Methods ¶4Find in source

“All participants received a new, pyrethroid-only LLIN (PermaNet 2.0, Vestergaard).”

Methods ¶4Find in source

absence[Methods, Statistical analysis]

Statistical software not identified in the main text.

WARNReviewer 3· 85% conf

The investigational product (permethrin and wraps) is adequately identified, but the statistical software used for analysis is not reported.

Evidence

“Wraps were soaked in permethrin diluted to 0.5% in accordance with the manufacturer’s instructions (Sawyer Products, Safety Harbor, FL)”

MethodsFind in source

“All participants received a new, pyrethroid-only LLIN (PermaNet 2.0, Vestergaard).”

MethodsFind in source

absence[Methods, Statistical analysis and throughout]

Statistical software for analysis is not reported.

The primary outcome is reported with IRR (0.34, 95% CI 0.23-0.51) and IRD, and cumulative incidence curves are shown. However, the paper does not name the specific model (e.g., Poisson regression) used to estimate the IRR, nor does it discuss verification of model assumptions. The p-value is reported as '<0.001' rather than exact. Statistical software is not identified. Data presentation meets clinical trial standards (tables with CIs, CONSORT diagram, Kaplan-Meier-like curves). Mathematical plausibility checks on reported incidence rates are consistent.

Sub-criteria

tests namedINADEQUATE

exact p valuesINADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedNOT REPORTED

mathematical plausibilityPASS

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 85% conf

Primary and secondary analyses use named tests with effect sizes and confidence intervals; the primary p-value is reported as a threshold (p<0.001) and analysis software is not named.

Evidence

“Clinical malaria incidence was 2.14 (95% CI 1.73–2.62) and 0.73 (95% CI 0.51–1.02) per 100 person weeks in the sham-treated and permethrin-treated arms, respectively (incidence rate ratio 0.34, 95% CI 0.23–0.51, p<0.001).”

AbstractFind in source

“Incidence rates of clinical P. falciparum malaria in children over the 24-week follow-up period were calculated by arm and compared by estimating the IRR and incidence rate difference (IRD) with adjustments for stratification variables.”

Statistical analysisFind in source

WARNReviewer 2· 85% conf

Effect sizes with confidence intervals and data presentation are adequate, but the specific statistical test is not named, assumptions are not verified, p-values are not exact, and software is not identified.

Evidence

paraphrase[Methods, Statistical analysis]

“A detailed description of the statistical methods is provided in the Supplementary Appendix.”

“incidence rate ratio 0.34, 95% CI 0.23–0.51, p<0.001”

Results ¶2Find in source

“Clinical malaria incidence (per 100 person-weeks) | 2.14 (1.73, 2.62) | 0.73 (0.51, 1.02) | −1.41 (−2.03, −0.83) | 0.34 (0.23, 0.51)”

Table 2Find in source

WARNReviewer 3· 85% conf

Effect sizes with confidence intervals and data presentation are adequate, but the specific statistical test is not named, assumptions are not verified, exact p-values are not provided, and statistical software is not identified.

Evidence

Statistical analysisFind in source

absence[Methods, Statistical analysis]

Assumptions are not verified.

paraphrase[Results, Primary Outcome]

“p<0.001”

The data-availability statement names a concrete route (DE-identified individual data shared 9–36 months post-publication after IRB/REB approval and a data use/sharing agreement with UNC), which meets the managed-access standard. Repository deposit and accession numbers are n/a for identifiable patient-level data; no bespoke public code repository is mentioned.

Sub-criteria

code sharingNOT REPORTED

accession numbersN/A

repository depositN/A

data availability statementADEQUATE

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 90% conf

A concrete managed-access data-sharing statement is provided; repository deposit and accession numbers are n/a for identifiable patient data.

Evidence

“Deidentified individual data that supports the results will be shared beginning 9 to 36 months following publication provided the investigator who proposes to use the data has approval from an Institutional Review Board (IRB), Independent Ethics Committee (IEC), or Research Ethics Board (REB), as applicable, and executes a data use/sharing agreement with UNC.”

Data availabilityFind in source

PASSReviewer 2· 90% conf

A data availability statement is present with a concrete access mechanism via data use agreement with UNC, which is appropriate for patient-level data.

Evidence

Data availabilityFind in source

PASSReviewer 3· 90% conf

A data availability statement with a concrete access route (managed access via UNC with conditions) is provided, and code sharing is not applicable as no custom code is mentioned.

Evidence

Data availabilityFind in source

Trial is registered (NCT05391230), CONSORT adherence is stated, detailed methods are given, and limitations are candidly discussed (single site, self-reported LLIN/wash use, blinding compromise by permethrin odor). Null/contrary secondary results (growth Z-scores) are reported transparently. Funding and grant numbers are disclosed; some secondary/molecular outcomes are deferred to separate reports, which is disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedINADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 92% conf

The manuscript reports thoroughly: registration, CONSORT adherence, funding/COI, limitations, and proportional conclusions.

Evidence

“This report adheres to the guidelines for Consolidated Standards of Reporting Trials.”

MethodsFind in source

“ClinicalTrials.gov (http://ClinicalTrials.gov) NCT05391230”

AbstractFind in source

“Funding for the trial was provided by a Clinical Scientist Development Award to RMB from the Doris Duke Foundation (Award 24971).”

FundingFind in source

PASSReviewer 2· 90% conf

Reporting is transparent overall: methods are complete, trial is registered, reporting guideline is followed, limitations are discussed, and conclusions are proportional. However, not all secondary outcomes are reported in this paper, and a conflict of interest statement is missing.

Evidence

“ClinicalTrials.gov (http://ClinicalTrials.gov) NCT05391230 (https://clinicaltrials.gov/ct2/show/NCT05391230)”

AbstractFind in source

“Molecular testing for asymptomatic parasitemia and analysis of maternal outcomes is ongoing and will be reported separately.”

MethodsFind in source

absence[Funding section and end of manuscript]

No explicit conflict of interest statement is present.

PASSReviewer 3· 90% conf

Most reporting transparency criteria are met: methods are complete, trial is registered, reporting guideline is followed, limitations are discussed, and conclusions are proportional. However, not all pre-specified outcomes are reported in this paper (some are pending), and a conflicts-of-interest statement is absent.

Evidence

“ClinicalTrials.gov (http://ClinicalTrials.gov) NCT05391230”

AbstractFind in source

“Molecular testing for asymptomatic parasitemia and analysis of maternal outcomes is ongoing and will be reported separately.”

MethodsFind in source

absence[Acknowledgements and throughout]

No conflicts-of-interest statement is found.

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

ClinicalTrials.gov

NCT05391230

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 30 references by DOI: 22 verified — 8 no DOI (shown, not verified).

NO DOI
World malaria report 2024: addressing inequity in the global malaria response
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Seasonal malaria chemoprevention with sulfadoxine–pyrimethamine plus amodiaquine in children: a field guide
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Systematic Review and Meta-Analysis of Seasonal Malaria Chemoprevention
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Consolidated guidelines for prevention and treatment of HIV in Uganda
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
National Guidelines for the Management of Common Conditions
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Testing the ratio of two Poisson rates
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Effect of a spatial repellent on malaria incidence in an area of western Kenya characterised by high malaria transmission, insecticide resistance, and universal coverage of insecticide treated nets (part of the AEGIS Consortium): a cluster-randomised, controlled trial
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Repellent Treated Clothing
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).

3 data/code links checked; 2 live.

datahttps://clinicaltrials.gov/ct2/show/NCT05391230LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttp://ClinicalTrials.govLIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://NEJM.orgUNVERIFIEDHTTP 403
Liveness indeterminate — content not checked.

Copyediting

10 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 10 minor suggestions below.

10 copyedit issues flagged: mostly consistency, other, typo.

MINORotherHeader / first line
“pmc 1 Permethrin-treated baby wraps... 393 14 497471 1399 1408”
→ Remove apparent OCR/page-number artifacts ('pmc 1', '393 14 497471 1399 1408') from the manuscript header.
These look like PDF extraction artifacts rather than author content.
MINORtypoAcknowledgements
“the Bugoye and Mukathi Level IIl Health Centres”
→ Change 'IIl' to 'III'.
Lowercase 'l' used instead of uppercase 'I' in the roman numeral.
MINORconsistencyResults, Trial Population vs Table 1
“including 21 (10.7%) in the sham- and 20 (10.1%) in the permethrin-treated arm”
→ Correct the percentages to 10.5% and 10.0% to match Table 1.
21/200 = 10.5% and 20/200 = 10.0%, so the in-text percentages are slightly off.
MINORconsistencyAbstract header
“pmc 1 Permethrin-treated baby wraps for the prevention of malaria: Uganda Boyce Ross M. MD, MSc Shook-Sa Bonnie E. DrPH Ndizeye Ronnie BS Baguma Emmanuel BS Giandomenico Dana MPH Cassidy Caitlin A. MS Eshun Solomon BS Siedner Mark J. MD, MPH Staedke Sarah G. MD, PhD Ntaro Moses MPH Juliano Jonathan J. MD, MSPH Reyes Raquel MD, MPA Mulogo Edgar M. PhD, MPH”
→ Remove extraneous text and format author list consistently.
This appears to be a formatting artifact from the source.
MINORclarityFigure 2 caption
“nts (center, right)”
→ Replace with full caption text.
Incomplete caption.
MINORtypoAbstract
“pmc 1 Permethrin-treated baby wraps for the prevention of malaria: Uganda”
→ Remove 'pmc 1' and fix formatting: 'Permethrin-treated baby wraps for the prevention of malaria in Uganda'
Appears to be a formatting artifact from the source.
MINORgrammarMethods, Interventions
“Wraps were soaked in permethrin diluted to 0.5% in accordance with the manufacturer’s instructions (Sawyer Products, Safety Harbor, FL) and allowed to dry ().”
→ Remove the empty parentheses '()'.
Incomplete sentence or placeholder.
MINORclarityMethods, Study Design
“The trial design and protocols have been published and are included in the .”
→ Complete the sentence: '...are included in the Supplementary Appendix.'
The sentence ends abruptly.
MINORconsistencyTable 2
“p-value <0.001”
→ Replace with exact p-value if possible, or state 'p<0.001' consistently.
The paper uses p<0.001, which is acceptable but not exact.
MINORotherAcknowledgements
“Sawyer Products (Safety Harbor, FL) provided bottles of 40% permethrin at no cost to the study.”
→ Consider adding a statement that this does not constitute endorsement or conflict of interest.
This is a potential conflict of interest that should be formally declared.

Kaimen Rigor Action ItemsFinal pass before journal submission

This published paper is robust in its core design and primary findings, but an informed reader should note the missing regulatory compliance statement, unspecified statistical software, and unreported model assumptions as limitations. The authors should consider issuing a correction for the baseline numerical errors (mRDT percentages, MUAC category percentages) and adding a conflicts-of-interest statement. The reported effect size is large and consistent with the recomputed incidence rates, so the overall conclusion is likely trustworthy.

1.
HIGHethics
Issue a correction to add a statement of regulatory compliance (e.g., 'The trial was conducted in accordance with the Declaration of Helsinki and ICH-GCP') to the Methods section.
A human clinical trial must explicitly state adherence to recognized ethical standards; its absence is a regulatory reporting gap.
2.
HIGHreporting
Issue a correction to add a formal conflicts-of-interest statement for all authors (e.g., 'The authors declare no competing interests') in the Acknowledgements or a dedicated section.
The paper currently discloses funding but no COI statement; this is a standard journal requirement for published research.
3.
HIGHrigor
Issue a correction to correct the baseline mRDT-positive percentages in the Results text (currently 10.7% and 10.1%) to match Table 1 values (10.5% and 10.0%).
The in-text percentages are arithmetically inconsistent with the counts (21/200=10.5%, 20/200=10.0%); this is a factual error that could mislead readers.
4.
HIGHrigor
Issue a correction to correct the permethrin-arm MUAC category percentages in Table 1 (currently 19.0% and 82.0%) to the exact values (18.5% and 81.5%) so the column sums to 100%.
The reported percentages sum to 101% and are inconsistent with the counts (37/200=18.5%, 163/200=81.5%); this is a minor data error that should be corrected.
5.
HIGHstatistics
Issue a correction to identify the name and version of the statistical software used for analysis (e.g., R 4.2, Stata 17, SAS 9.4) in the Statistical analysis section.
Reproducibility requires knowing the software environment; this is a standard reporting expectation for clinical trials.
6.
HIGHstatistics
Issue a correction to name the specific statistical model used to estimate the incidence rate ratio (e.g., Poisson regression, negative binomial regression) in the Statistical analysis section.
The current description ('estimating the IRR with adjustments for stratification variables') is ambiguous; naming the model is essential for reproducibility.
7.
HIGHstatistics
Report an exact p-value for the primary IRR (e.g., p=0.0002) instead of the threshold 'p<0.001' in the Results section, or state that the p-value is reported as a threshold per journal policy.
Exact p-values allow readers to assess the strength of evidence more precisely; thresholds are considered less informative.
8.
HIGHstatistics
Add a brief description of assumption verification for the primary analysis (e.g., 'The proportional hazards assumption was tested using Schoenfeld residuals') or explain why standard methods are appropriate.
Model assumptions are critical for validity; their absence reduces confidence in the reported effect estimates.
9.
HIGHreporting
In the Discussion, explicitly note that molecular testing for asymptomatic parasitemia and maternal outcomes are deferred to separate reports, and reference the protocol or registration for the full list of outcomes.
Transparency requires clear acknowledgment of incomplete outcome reporting; this is already stated but could be made more explicit for readers.
10.
MEDIUMcopyedit
Remove apparent OCR artifacts ('pmc 1', '393 14 497471 1399 1408') from the manuscript header and abstract.
These are formatting errors from PDF extraction that should not appear in the published version.
11.
MEDIUMcopyedit
Fix the typo 'Level IIl Health Centres' to 'Level III Health Centres' in the Acknowledgements.
Lowercase 'l' used instead of uppercase 'I' in the roman numeral is a typographical error.
12.
MEDIUMcopyedit
Complete the incomplete sentence in Methods, Study Design: 'The trial design and protocols have been published and are included in the .' should be '...are included in the Supplementary Appendix.'
The sentence ends abruptly, leaving a missing reference.
13.
MEDIUMcopyedit
Remove the empty parentheses '()' in Methods, Interventions: '...and allowed to dry ().'
Empty parentheses are a placeholder that should be removed or completed.
14.
LOWother
Consider adding a note in the Acknowledgements that the provision of permethrin by Sawyer Products does not constitute an endorsement or conflict of interest.
Product donation could be perceived as a conflict; a formal statement would clarify this.

Full text (28,292 chars)Analyzed: Aug 10, 2026

RigorReviewer 1

RigorReviewer 2

RigorReviewer 3

RigorPre-Submission Reviewer

CopyeditAgent Scribe

CitationsCitation Integrity

StatisticsStatistics Consistency

ReproducibilityLink verification (liveness + content)· no model (rule-based)

PreregistrationDeterministic check· no model (rule-based)

The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”

How stars are deducted

Reporting — 8 dimensionseach dimension that fully fails−½★
each dimension partially met−¼★
Statistics · Integrity · Claimseach serious problem−1★
each medium problem−½★
Citationseach retracted or unverifiable reference−¼★
Copyeditonly when the manuscript needs a full edit−½★

The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.

The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.

The eight reporting dimensions

Scientific PremisePrior work, rationale, and how it addresses gaps.

Study Design & RigorRandomization, blinding, power, controls, replication.

Biological VariablesSex, age, species/strain, housing, demographics.

Ethical ApprovalsIRB/IACUC approval, informed consent, regulatory compliance.

Key ResourcesAntibodies, cell lines, organisms, software — identified with persistent IDs.

Statistical ReportingNamed tests, exact p-values, effect sizes, plausible summary stats.

Data & Code AvailabilityAvailability statements, repositories, accession numbers, shared code.

Reporting TransparencyMethods, registration, guidelines, outcomes, limitations, funding/COI.

Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.

This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.

Permethrin-Treated Baby Wraps for the Prevention of Malaria.

Boyce RM, Shook-Sa BE, Ndizeye R, Baguma E, Giandomenico D, Cassidy CA, Eshun S, Siedner MJ, Staedke SG, Ntaro M, Juliano JJ, Reyes R, Mulogo EM

DOI

10.1056/NEJMoa2501628

Record issued

2026-08-10

Engine

7.29.0

Exported

2026-09-20