Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.

Name: Kaimen Rigor review — Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.
Item: Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.
Rating: 96
Author: Alpha1

Bermingham KM, Linenberg I, Polidori L, Asnicar F, Arrè A, Wolf J, Badri F, Bernard H, Capdevila J, Bulsiewicz WJ, Gardner CD, Ordovas JM, Davies R, Hadjigeorgiou G, Hall WL, Delahanty LM, Valdes AM, Segata N, Spector TD, Berry SE

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.25★ (Weak), 0 critical, 2 high issues for “Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.

Read full text (PMC)

DOI

10.1038/s41591-024-02951-6

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/20901ffa-61e0-456d-aac8-8a8fd8b0bb78" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/20901ffa-61e0-456d-aac8-8a8fd8b0bb78/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 2 high issues for “Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

fdddcb502c0cb3af067c2e17248e931e0cde1ca0e7cb1ffce9615614531f9e03

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.

Paper source

Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on changes in serum triglycerides (TG) and LDL cholesterol, which are surrogate biomarkers for cardiovascular outcomes. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD) nor cite validated evidence linking these surrogates to hard clinical outcomes. The effect on LDL-C was not significant, and the TG reduction, while statistically significant, is a biomarker change presented as proof of clinical benefit.
“Primary outcomes were serum low-density lipoprotein cholesterol and TG concentrations at baseline and at 18 weeks.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is a small reduction in triglycerides (mean difference = -0.13 mmol/L) and no significant change in LDL-C. The TG reduction is a small fraction of the baseline value (1.35 mmol/L) and is not anchored to a minimal clinically important difference or hard clinical outcome. The weight loss (2.46 kg) is below the 5% threshold considered clinically meaningful, as acknowledged in the discussion.
“The mean difference in changes between the groups was −0.13 mmol l−1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016)”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported RCT with strong methodological rigor across most dimensions. The main weakness is the lack of a public code repository and incomplete data accession details, which limits full reproducibility.

Both reviewers independently scored all eight dimensions and agreed on all statuses; no divergence was present. The study is a human interventional trial, so animal-related and cell-line criteria were marked not applicable. Statistical verification was limited to one recomputed test; other statistics were not machine-verified.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

7 major claims checked against the paper's own evidence: 3 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

1 finding · worst low

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Other integrity concernAssessed

3 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites observational research and prior RCTs on personalized nutrition, acknowledges limitations of single-axis personalization, and hypothesizes that a multilevel approach will improve efficacy. The rationale is well-linked to the study objectives. Limitations of prior work are addressed by the multilevel design.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior research on personalized nutrition and variability in responses to foods, and provides a logical rationale for the study hypothesis.

Evidence

“Observational research supports the application of personalized nutrition , but there are few randomized controlled trials designed to test the efficacy of personalized nutrition programs compared to standard dietary advice on health outcomes.”

Introduction ¶2Find in source

“Therefore, we hypothesized that a multilevel approach to personalization encompassing multiple factors contributing to intraindividual and interindividual variability in nutritional responses to diet will improve the efficacy of advice to elicit a meaningful impact on health outcomes.”

Introduction ¶3Find in source

“Personalized nutrition approaches and corresponding studies typically use a single axis of personalization but reported low correlations between biomarkers, for example, triglycerides (TGs) and glucose, suggesting that a prediction algorithm using a multilevel approach to personalization may yield superior results.”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise by citing prior research on personalized nutrition and variability in responses to foods, and provides a logical rationale for the study hypothesis.

Evidence

Introduction ¶1Find in source

Introduction ¶3Find in source

Randomization was performed using a minimization program (MinimPy) with stratification factors. The unit of randomization is the individual participant. Blinding is partially addressed: the between-group analysis was performed by a blinded researcher, and group allocation was concealed. A power analysis is reported (n=150 per group, 90% power, P<0.05). Inclusion/exclusion criteria are detailed. Outlier handling is addressed through the ITT and per-protocol analyses and missing-data approaches. Controls are appropriate (USDA dietary advice). Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, blinding of the between-group analysis, a priori power calculation, and pre-specified inclusion/exclusion criteria.

Evidence

“a minimization-randomization program (MinimPy v.0.3, Python Package Index; pypi.org/project/MinimPy/ (https://pypi.org/project/MinimPy/) ) was used for treatment allocation.”

MethodsFind in source

“The between-group analysis was performed by a blinded researcher. Group allocation was concealed by labeling the groups with nonidentifying terms.”

Statistical analysisFind in source

“The study was powered on a sample size of 150 participants per group ( n = 300) at 90% power and P < 0.05, to detect a 0.21 mmol l −1 between-group difference in TG (endpoint change from baseline).”

MethodsFind in source

PASSReviewer 2· 95% conf

The study design is rigorous: it is a randomized controlled trial with a clear randomization method, pre-specified inclusion/exclusion criteria, a power analysis, and appropriate handling of the analysis population.

Evidence

“a minimization-randomization program (MinimPy v.0.3, Python Package Index; pypi.org/project/MinimPy/ (https://pypi.org/project/MinimPy/) ) was used for treatment allocation.”

MethodsFind in source

“The between-group analysis was performed by a blinded researcher. Group allocation was concealed by labeling the groups with nonidentifying terms.”

Statistical analysisFind in source

Sex is reported (86% female). Age, BMI, and health status are reported. Demographics include ethnicity, education, and menopausal status. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported: sex, age, BMI, and other demographics are provided in Table 1.

Evidence

“In total, 86% of participants were female”

ResultsFind in source

“mean ± s.d. age of 52 ± 7.5 years, body mass index (BMI) of 34 ± 5.8 kg m − 2”

ResultsFind in source

paraphrase[Table 1]

“Ethnicity (%) | American Indian or Alaskan Native | 0.3 | 1 | 1 | 1 | 0 | 0”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial: sex, age, BMI, and other demographics are provided in Table 1.

Evidence

“In total, 86% of participants were female”

ResultsFind in source

“mean ± s.d. age of 52 ± 7.5 years, body mass index (BMI) of 34 ± 5.8 kg m − 2”

ResultsFind in source

paraphrase[Table 1]

“Ethnicity (%) | White | 82 | 285 | 82 | 146 | 82 | 139”

The paper states ethical approval was obtained through Advarra IRB with protocol number, and all participants provided written informed consent. Regulatory compliance with good clinical practice and the Declaration of Helsinki is stated.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval is clearly documented with a named IRB and protocol number, and informed consent is described.

Evidence

“Ethical approval for the trial was obtained through the Advarra IRB (IRB no. 00000971; protocol no. 00044316).”

MethodsFind in source

“All participants provided written informed consent”

MethodsFind in source

“the study was carried out in accordance with good clinical practice and the Declaration of Helsinki (2013).”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals are clearly documented: named IRB approval, written informed consent, and compliance with the Declaration of Helsinki and good clinical practice.

Evidence

“Ethical approval for the trial was obtained through the Advarra IRB (IRB no. 00000971; protocol no. 00044316).”

MethodsFind in source

“All participants provided written informed consent”

MethodsFind in source

“the study was carried out in accordance with good clinical practice and the Declaration of Helsinki (2013).”

MethodsFind in source

The investigational product (PDP) is described in detail, including the ZOE 2022 algorithm and app. Software tools are identified with versions (R, Python, MinimPy, MetaPhlAn). Reagents for stool collection and DNA extraction are identified with catalog numbers. Antibodies, cell lines, and mycoplasma testing are not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources are well identified: the investigational product (ZOE app and algorithm) is described, and software tools are named with versions.

Evidence

“DNA/RNA SheildTM Fecal Collection Tube (Zymo Research) containing buffer (catalog no. R1101, Zymo Research).”

MethodsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7. Pandas v.1.1.3, NumPy v.1.23.5 and SciPy v.1.11.1 were used”

Statistical analysisFind in source

“Species-level profiling of the 815 samples was performed with both MetaPhlAn 3.0 (ref. ) and MetaPhlAn 4.0 (ref. ).”

MethodsFind in source

PASSReviewer 2· 90% conf

Key resources are well identified: the investigational product (ZOE app and algorithm) is described, and software tools are named with versions.

Evidence

“A personalized ZOE food quality score was computed using the ZOE 2022 algorithm for each food item consumed by the PDP participants.”

MethodsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7. Pandas v.1.1.3, NumPy v.1.23.5 and SciPy v.1.11.1 were used to manage and preprocess data.”

Statistical analysisFind in source

“The DNA was first isolated using the ZymoBIOMICS 96 MagBead DNA Kit (Zymo Research).”

MethodsFind in source

The primary analysis used repeated measures models with interaction terms, and p-values are reported exactly (e.g., P = 0.016). Effect sizes are reported with 95% CIs. Software is identified. Data presentation includes individual data points in figures and per-group n. Assumptions are handled by log-transformation and normality testing. Mathematical plausibility checks were not possible for all values, but no obvious errors were found.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well-described, with exact p-values for primary outcomes and effect sizes with confidence intervals.

Evidence

“mean difference in changes between the groups was −0.13 mmol l −1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016”

ResultsFind in source

“body weight: −2.46 kg (95% CI = −3.67 to −1.25)”

ResultsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7.”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

Statistical analysis is generally rigorous: tests are named, effect sizes with CIs are reported, and software is identified. However, some p-values are reported as thresholds (e.g., P < 0.05) for secondary outcomes, which is imprecise but not a major flaw.

Evidence

“P = 0.016 for the interaction between diet group, time-adjusted for age and sex”

ResultsFind in source

“mean difference in changes between the groups was −0.13 mmol l −1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016”

ResultsFind in source

“Reductions in body weight, waist circumference and glycated hemoglobin (HbA1c), and increases in diet quality (HEI score), were significantly greater after the PDP than with the control diet; differences between treatments were as follows: body weight: −2.46 kg (95% CI = −3.67 to −1.25); waist circumference: −2.35 cm (95% CI = −4.07 to −0.63); HbA1c: −0.05% (95% CI = −0.01 to −0.001); and diet quality (HEI score): 7.08 (95% CI = 5.02 to 9.15).”

ResultsFind in source

The data availability statement provides a concrete route for data access (proposal to scientific advisory board, contact email). Microbiome data will be uploaded to EBI. However, code availability is only 'available upon request' with no public repository or permanent identifier, which is inadequate for code sharing.

Sub-criteria

code sharingINADEQUATE

accession numbersINADEQUATE

repository depositINADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

Data availability is stated with a managed-access procedure, but code availability is vague ('available upon request') without a public repository.

Evidence

“The study data can be released to bona fide researchers submitting a research proposal approved by a subpanel of our scientific advisory board.”

Data availabilityFind in source

“The microbiome data will be uploaded onto the EBI website ( www.ebi.ac.uk/ (https://www.ebi.ac.uk/) ).”

Data availabilityFind in source

“The scripts for the statistical analysis are freely available upon request to ZOE Ltd.”

Data availabilityFind in source

WARNReviewer 2· 90% conf

Data availability is described with a managed-access procedure, but code availability is vague ('available upon request') and the microbiome data accession is not yet provided.

Evidence

“The study data can be released to bona fide researchers submitting a research proposal approved by a subpanel of our scientific advisory board.”

Data availabilityFind in source

“The microbiome data will be uploaded onto the EBI website ( www.ebi.ac.uk/ (https://www.ebi.ac.uk/) ).”

Data availabilityFind in source

“The scripts for the statistical analysis are freely available upon request to ZOE Ltd. Application is via data.papers@joinzoe.com. Code will be made available within 2 months of the request.”

Data availabilityFind in source

The trial is registered on ClinicalTrials.gov (NCT05273268). Methods are comprehensive. Limitations are discussed, including lack of matching for contact/intensity and inability to capture physical activity. Conclusions are generally proportional, though some claims about microbiome benefits are somewhat strong. Funding and competing interests are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05273268 (https://clinicaltrials.gov/ct2/show/NCT05273268)”

AbstractFind in source

“Limitations include that we could not accurately capture changes in physical activity status.”

Discussion ¶8Find in source

paraphrase[Acknowledgements and Competing interests]

“This research was funded by ZOE Ltd; ... T.D.S., J.W. and G.H. are co-founders of ZOE Ltd.”

PASSReviewer 2· 90% conf

Reporting is transparent: trial registration is provided, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05273268 (https://clinicaltrials.gov/ct2/show/NCT05273268) .”

AbstractFind in source

“Limitations include that we could not accurately capture changes in physical activity status. Furthermore, although reflective of how the advice is delivered in real life, the USDA recommended diet was delivered via leaflet and video, and was intentionally not matched for contact or intensity with the PDP group.”

Discussion ¶8Find in source

“This research was funded by ZOE Ltd; the study funder contributed, as part of the scientific advisory board, to study design, data collection and analysis, and the writing of the manuscript.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 47 references by DOI: 46 verified — 1 no DOI (shown, not verified).

4 data/code links checked; 4 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and generally trustworthy, but readers should weigh the limited code availability and missing microbiome accession numbers as minor reproducibility concerns. No erratum is warranted based on the current evidence, though providing the code and accession numbers would strengthen the record.

1.
HIGHdata code
Deposit the statistical analysis code in a public repository (e.g., Zenodo or GitHub) with a DOI, and update the Code availability statement to include the repository link and permanent identifier.
The current 'available upon request' is vague and does not meet reproducibility standards.
2.
HIGHdata code
Provide the EBI accession number for the microbiome data once deposited, and include it in the Data availability statement.
Without an accession number, the data deposit is not verifiable.
3.
MEDIUMstatistics
Report exact p-values for all secondary outcomes instead of thresholds (e.g., P < 0.05) in the Results section.
Exact p-values improve precision and transparency.
4.
MEDIUMreporting
Clarify the blinding status of participants and outcome assessors in the Methods; currently only the between-group analysis is stated as blinded.
Full blinding details are expected for a rigorous RCT.
5.
MEDIUMreporting
Add an explicit statement that the CONSORT checklist is followed, and consider providing it as a supplementary file.
Explicit reference to the reporting guideline enhances transparency.
6.
MEDIUMreporting
Temper the claim about microbiome benefits in the Discussion, as the clinical relevance of the observed changes is not established.
Overstating exploratory findings can mislead readers.
7.
MEDIUMstatistics
Add a note in the Methods about how missing data were handled in the repeated measures model (e.g., mixed-effects model handles missing data).
Clarifying missing data handling is important for reproducibility.
8.
MEDIUMdata code
Specify the exact version of the ZOE algorithm used and whether it is publicly available for replication.
The algorithm is a key resource; version and availability are needed for reproducibility.
9.
LOWcopyedit
Fix the subject-verb agreement error in the Abstract: 'The results demonstrates' should be 'The results demonstrate'.
Correct grammar is expected in a published manuscript.
10.
LOWcopyedit
Standardize the abbreviation of confidence interval in the Results section (e.g., use '95% CI' consistently).
Consistent terminology improves readability.
11.
LOWcopyedit
Clarify in the Methods that the ITT cohort restriction to 118 and 112 individuals applies only to the microbiome analysis.
Prevents misinterpretation of the ITT cohort for all analyses.
12.
LOWreporting
Consider reporting the exact number of female participants in the Results for clarity, in addition to the percentage.
Exact counts are more informative than percentages alone.

Full text (73,974 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.

Read full text (PMC)

DOI

10.1038/s41591-024-02951-6

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/20901ffa-61e0-456d-aac8-8a8fd8b0bb78" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/20901ffa-61e0-456d-aac8-8a8fd8b0bb78/badge" alt="Kaimen Rigor review — 2.25★ (Weak), 0 critical, 2 high issues for “Effects of a personalized nutrition program on cardiometabolic health: a randomized controlled trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

fdddcb502c0cb3af067c2e17248e931e0cde1ca0e7cb1ffce9615614531f9e03

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×3−1.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on changes in serum triglycerides (TG) and LDL cholesterol, which are surrogate biomarkers for cardiovascular outcomes. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD) nor cite validated evidence linking these surrogates to hard clinical outcomes. The effect on LDL-C was not significant, and the TG reduction, while statistically significant, is a biomarker change presented as proof of clinical benefit.
“Primary outcomes were serum low-density lipoprotein cholesterol and TG concentrations at baseline and at 18 weeks.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary reported effect is a small reduction in triglycerides (mean difference = -0.13 mmol/L) and no significant change in LDL-C. The TG reduction is a small fraction of the baseline value (1.35 mmol/L) and is not anchored to a minimal clinically important difference or hard clinical outcome. The weight loss (2.46 kg) is below the 5% threshold considered clinically meaningful, as acknowledged in the discussion.
“The mean difference in changes between the groups was −0.13 mmol l−1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016)”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

7 major claims checked against the paper's own evidence: 3 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

1 finding · worst low

Other integrity concernAssessed

3 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise by citing prior research on personalized nutrition and variability in responses to foods, and provides a logical rationale for the study hypothesis.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise by citing prior research on personalized nutrition and variability in responses to foods, and provides a logical rationale for the study hypothesis.

Evidence

Introduction ¶1Find in source

Introduction ¶3Find in source

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, blinding of the between-group analysis, a priori power calculation, and pre-specified inclusion/exclusion criteria.

Evidence

“a minimization-randomization program (MinimPy v.0.3, Python Package Index; pypi.org/project/MinimPy/ (https://pypi.org/project/MinimPy/) ) was used for treatment allocation.”

MethodsFind in source

“The between-group analysis was performed by a blinded researcher. Group allocation was concealed by labeling the groups with nonidentifying terms.”

Statistical analysisFind in source

MethodsFind in source

PASSReviewer 2· 95% conf

Evidence

“a minimization-randomization program (MinimPy v.0.3, Python Package Index; pypi.org/project/MinimPy/ (https://pypi.org/project/MinimPy/) ) was used for treatment allocation.”

MethodsFind in source

“The between-group analysis was performed by a blinded researcher. Group allocation was concealed by labeling the groups with nonidentifying terms.”

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported: sex, age, BMI, and other demographics are provided in Table 1.

Evidence

“In total, 86% of participants were female”

ResultsFind in source

“mean ± s.d. age of 52 ± 7.5 years, body mass index (BMI) of 34 ± 5.8 kg m − 2”

ResultsFind in source

paraphrase[Table 1]

“Ethnicity (%) | American Indian or Alaskan Native | 0.3 | 1 | 1 | 1 | 0 | 0”

PASSReviewer 2· 90% conf

Biological variables are well reported for a human trial: sex, age, BMI, and other demographics are provided in Table 1.

Evidence

“In total, 86% of participants were female”

ResultsFind in source

“mean ± s.d. age of 52 ± 7.5 years, body mass index (BMI) of 34 ± 5.8 kg m − 2”

ResultsFind in source

paraphrase[Table 1]

“Ethnicity (%) | White | 82 | 285 | 82 | 146 | 82 | 139”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval is clearly documented with a named IRB and protocol number, and informed consent is described.

Evidence

“Ethical approval for the trial was obtained through the Advarra IRB (IRB no. 00000971; protocol no. 00044316).”

MethodsFind in source

“All participants provided written informed consent”

MethodsFind in source

“the study was carried out in accordance with good clinical practice and the Declaration of Helsinki (2013).”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approvals are clearly documented: named IRB approval, written informed consent, and compliance with the Declaration of Helsinki and good clinical practice.

Evidence

“Ethical approval for the trial was obtained through the Advarra IRB (IRB no. 00000971; protocol no. 00044316).”

MethodsFind in source

“All participants provided written informed consent”

MethodsFind in source

“the study was carried out in accordance with good clinical practice and the Declaration of Helsinki (2013).”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Key resources are well identified: the investigational product (ZOE app and algorithm) is described, and software tools are named with versions.

Evidence

“DNA/RNA SheildTM Fecal Collection Tube (Zymo Research) containing buffer (catalog no. R1101, Zymo Research).”

MethodsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7. Pandas v.1.1.3, NumPy v.1.23.5 and SciPy v.1.11.1 were used”

Statistical analysisFind in source

“Species-level profiling of the 815 samples was performed with both MetaPhlAn 3.0 (ref. ) and MetaPhlAn 4.0 (ref. ).”

MethodsFind in source

PASSReviewer 2· 90% conf

Key resources are well identified: the investigational product (ZOE app and algorithm) is described, and software tools are named with versions.

Evidence

“A personalized ZOE food quality score was computed using the ZOE 2022 algorithm for each food item consumed by the PDP participants.”

MethodsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7. Pandas v.1.1.3, NumPy v.1.23.5 and SciPy v.1.11.1 were used to manage and preprocess data.”

Statistical analysisFind in source

“The DNA was first isolated using the ZymoBIOMICS 96 MagBead DNA Kit (Zymo Research).”

MethodsFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well-described, with exact p-values for primary outcomes and effect sizes with confidence intervals.

Evidence

“mean difference in changes between the groups was −0.13 mmol l −1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016”

ResultsFind in source

“body weight: −2.46 kg (95% CI = −3.67 to −1.25)”

ResultsFind in source

“Analyses were carried out using v.4.0.2 of R and Python v.3.9.7.”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

Evidence

“P = 0.016 for the interaction between diet group, time-adjusted for age and sex”

ResultsFind in source

“mean difference in changes between the groups was −0.13 mmol l −1 (log-transformed, 95% CI = −0.07 to −0.01, P = 0.016”

ResultsFind in source

Sub-criteria

code sharingINADEQUATE

accession numbersINADEQUATE

repository depositINADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 90% conf

Data availability is stated with a managed-access procedure, but code availability is vague ('available upon request') without a public repository.

Evidence

“The study data can be released to bona fide researchers submitting a research proposal approved by a subpanel of our scientific advisory board.”

Data availabilityFind in source

“The microbiome data will be uploaded onto the EBI website ( www.ebi.ac.uk/ (https://www.ebi.ac.uk/) ).”

Data availabilityFind in source

“The scripts for the statistical analysis are freely available upon request to ZOE Ltd.”

Data availabilityFind in source

WARNReviewer 2· 90% conf

Data availability is described with a managed-access procedure, but code availability is vague ('available upon request') and the microbiome data accession is not yet provided.

Evidence

“The study data can be released to bona fide researchers submitting a research proposal approved by a subpanel of our scientific advisory board.”

Data availabilityFind in source

“The microbiome data will be uploaded onto the EBI website ( www.ebi.ac.uk/ (https://www.ebi.ac.uk/) ).”

Data availabilityFind in source

“The scripts for the statistical analysis are freely available upon request to ZOE Ltd. Application is via data.papers@joinzoe.com. Code will be made available within 2 months of the request.”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05273268 (https://clinicaltrials.gov/ct2/show/NCT05273268)”

AbstractFind in source

“Limitations include that we could not accurately capture changes in physical activity status.”

Discussion ¶8Find in source

paraphrase[Acknowledgements and Competing interests]

“This research was funded by ZOE Ltd; ... T.D.S., J.W. and G.H. are co-founders of ZOE Ltd.”

PASSReviewer 2· 90% conf

Reporting is transparent: trial registration is provided, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05273268 (https://clinicaltrials.gov/ct2/show/NCT05273268) .”

AbstractFind in source

Discussion ¶8Find in source

“This research was funded by ZOE Ltd; the study funder contributed, as part of the scientific advisory board, to study design, data collection and analysis, and the writing of the manuscript.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 47 references by DOI: 46 verified — 1 no DOI (shown, not verified).

4 data/code links checked; 4 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, typo.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Deposit the statistical analysis code in a public repository (e.g., Zenodo or GitHub) with a DOI, and update the Code availability statement to include the repository link and permanent identifier.
The current 'available upon request' is vague and does not meet reproducibility standards.
2.
HIGHdata code
Provide the EBI accession number for the microbiome data once deposited, and include it in the Data availability statement.
Without an accession number, the data deposit is not verifiable.
3.
MEDIUMstatistics
Report exact p-values for all secondary outcomes instead of thresholds (e.g., P < 0.05) in the Results section.
Exact p-values improve precision and transparency.
4.
MEDIUMreporting
Clarify the blinding status of participants and outcome assessors in the Methods; currently only the between-group analysis is stated as blinded.
Full blinding details are expected for a rigorous RCT.
5.
MEDIUMreporting
Add an explicit statement that the CONSORT checklist is followed, and consider providing it as a supplementary file.
Explicit reference to the reporting guideline enhances transparency.
6.
MEDIUMreporting
Temper the claim about microbiome benefits in the Discussion, as the clinical relevance of the observed changes is not established.
Overstating exploratory findings can mislead readers.
7.
MEDIUMstatistics
Add a note in the Methods about how missing data were handled in the repeated measures model (e.g., mixed-effects model handles missing data).
Clarifying missing data handling is important for reproducibility.
8.
MEDIUMdata code
Specify the exact version of the ZOE algorithm used and whether it is publicly available for replication.
The algorithm is a key resource; version and availability are needed for reproducibility.
9.
LOWcopyedit
Fix the subject-verb agreement error in the Abstract: 'The results demonstrates' should be 'The results demonstrate'.
Correct grammar is expected in a published manuscript.
10.
LOWcopyedit
Standardize the abbreviation of confidence interval in the Results section (e.g., use '95% CI' consistently).
Consistent terminology improves readability.
11.
LOWcopyedit
Clarify in the Methods that the ITT cohort restriction to 118 and 112 individuals applies only to the microbiome analysis.
Prevents misinterpretation of the ITT cohort for all analyses.
12.
LOWreporting
Consider reporting the exact number of female participants in the Results for clarity, in addition to the percentage.
Exact counts are more informative than percentages alone.

Full text (73,974 chars)Analyzed: Aug 16, 2026