Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.
Combet E, Haag L, Richardson J, Haig CE, Cunningham Y, Fraser HL, Brosnahan N, Ibbotson T, Ormerod J, White C, McIntosh E, O'Donnell CA, Sattar N, McConnachie A, Lean MEJ, Blane DN
- DOI
- 10.1038/s41591-024-03384-x
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-21
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/00cc5359-16f5-4cb2-86fc-f5e404f0ef6c is authoritative.
How this rating was calculated
- CitationsCitations & links (capped) ×9−1★
- IntegrityIntegrity concern−0.5★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
Citations & links are capped at −1★ combined, however many are flagged.
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary outcome is a patient-selected symptom score (fatigue, breathlessness, pain, anxiety/depression, or other) measured via validated questionnaires or VAS. These are patient-reported outcomes, not hard clinical endpoints. The paper does not provide evidence that these symptom scores are validated surrogates for long-term clinical outcomes in long COVID, nor does it demonstrate target engagement linking the intervention to these outcomes beyond weight loss. The discussion acknowledges that the symptom measures have not been validated in the context of long COVID, making it difficult to assess clinical significance.
“We note that the symptom outcome measures (for fatigue, pain, breathlessness, anxiety/depression and other) have not previously been validated in the context of LC, making it difficult to assess the clinical significance of improvements”
- 02Treatment effect not shown to be clinically meaningful
The primary outcome treatment effect at 6 months is -0.34 (95% CI -0.67 to -0.01), which is less than the prespecified minimal important difference of 0.5 standard deviations. The paper does not anchor this effect to a clinically meaningful threshold, and the confidence interval includes values close to zero. Although weight loss was substantial (10.3% vs 0.6%), the primary symptom improvement is small and not clearly clinically meaningful.
“The study was designed to be able to detect a mean difference between groups at the primary analysis time point (6 months) of 0.5 points. At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95%…”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
The paper is a well-conducted and transparently reported randomized trial with strong methodological rigor across all eight dimensions. Minor reporting gaps (e.g., explicit regulatory compliance statement, outlier handling detail) and a small internal inconsistency in participant numbers do not undermine the overall validity.
Both reviewers classified the study as interventional; no divergence. The evaluation covered the full text, with specialized checks on statistics (8 tests recomputed consistently), citations (9 references not found in registry), reproducibility (link live), and integrity (one low-severity internal contradiction). Non-applicable criteria (e.g., animal/housing, cell lines) were excluded.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 8 tests: 8 consistent, 0 inconsistent; 8 via agent-written checks.
- CONSISTENTreported p = .047 · recomputed p = .043Reviewers 1, 2Primary outcome treatment effect at 6 months: p-value from estimate and 95% CI.
“intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-0.34, -0.67, -0.01, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Primary outcome treatment effect at 3 months: p-value from estimate and 95% CI.
“This difference was more marked at 3 months (−0.90 (95% CI −1.27 to −0.53), P < 0.0001)”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-0.90, -1.27, -0.53, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Fatigue secondary outcome at 6 months: p-value from estimate and 95% CI.
“treatment effect of −3.64 (95% CI −5.42 to −1.86), P < 0.0001”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-3.64, -5.42, -1.86, 0) - CONSISTENTreported p = .012 · recomputed p = .012Reviewer 1Breathlessness secondary outcome at 6 months: p-value from estimate and 95% CI.
“treatment effect of −0.27 (95% CI −0.48 to −0.06), P = 0.0124”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-0.27, -0.48, -0.06, 0) - CONSISTENTreported p = .025 · recomputed p = .025Reviewer 1Anxiety/depression secondary outcome at 6 months: p-value from estimate and 95% CI.
“treatment effect of −1.94 (95% CI −3.64 to −0.25), P = 0.0249”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-1.94, -3.64, -0.25, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 1Weight change at 6 months: p-value from estimate and 95% CI.
“adjusted group difference −9.79 kg (95% CI −11.5 to −8.1), P < 0.0001”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-9.79, -11.5, -8.1, 0) - CONSISTENTreported p = .013 · recomputed p = .012Reviewer 1SBP change at 6 months: p-value from estimate and 95% CI.
“adjusted group difference −4.16 mmHg (95% CI −7.42 to −0.90), P = 0.0126”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-4.16, -7.42, -0.90, 0) - CONSISTENTreported p = .016 · recomputed p = .016Reviewer 1DBP change at 6 months: p-value from estimate and 95% CI.
“adjusted group difference −2.73 mmHg (95% CI −4.95 to −0.51), P = 0.0160”
Taken as given: The estimate is the mean difference.; The CI is a 95% confidence interval.; The p-value is two-sided.Method: Recomputed p-value from the estimate and 95% CI using the normal approximation.How we recomputed it: pCI(-2.73, -4.95, -0.51, 0)
- lowinternal contradictionThe Results state 'n = 240 were recruited and provided consent' and 'Five did not complete the baseline assessment and were not randomized, and one withdrew consent after randomization, resulting in n = 234 randomized'. The Methods state 235 randomized. This discrepancy is not explained.
n = 240 were recruited and provided consent ... resulting in n = 234 randomized ... Successful recruitment initiatives and a 12-week extension resulted in the randomization of 235 participants.
Statistical analysisreviewer’s wording
Overstated conclusions
3 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
- Conclusions only partially backed by the presented evidenceAssessed
7 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewer 1The intervention improved work productivity (reduced missed hours).The reduction in missed work hours was not statistically significant at 6 months, though the direction favored the intervention.Evidence: Work productivity analysis: treatment effect 2.44 (95% CI −0.43 to 5.31, P = 0.0949).
“The number of hours of work missed per week due to health problems reduced by 3.38 (s.d. 13.97) in the intervention group and 2.34 (s.d. 14.03) in the control group, with a treatment effect of 2.44 (95% CI −0.43 to 5.31, P = 0.0949).”
ResultsFind in source - supportedReviewers 1, 2The intervention improved the respective primary outcome (participant-selected LC symptom) at 6 months.The primary outcome analysis shows a statistically significant treatment effect with a 95% CI that excludes zero.Evidence: Primary outcome analysis: treatment effect −0.34 (95% CI −0.67 to −0.01), P = 0.0466.
“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”
ResultsFind in source - supportedReviewers 1, 2The intervention improved all LC symptoms as secondary outcomes except pain at 6 months.The secondary outcome analyses show significant improvements for fatigue, breathlessness, and anxiety/depression, but not for pain.Evidence: Secondary outcome analyses: fatigue P < 0.0001, breathlessness P = 0.0124, anxiety/depression P = 0.0249, pain P = 0.1480.
“At 6 months, the intervention improved all LC symptoms as secondary outcomes, except for pain (treatment effect −1.41 (95% CI −3.32 to 0.50), P = 0.1480)”
ResultsFind in source - supportedReviewers 1, 2The intervention resulted in substantial weight loss compared with control.Weight loss was significantly greater in the intervention group, with a mean difference of about 10 kg.Evidence: Weight change analysis: adjusted group difference −9.79 kg (95% CI −11.5 to −8.1), P < 0.0001.
“Mean body weight in the intervention group fell by −9.8 kg (s.d. 6.0) after 3 months and by −10.3 kg (s.d. 7.5) at 6 months. Mean weight changes in the control group were small: −1.3 kg (s.d. 4.7) after 3 months and −0.7 kg (s.d. 5.2) after 6 months (adjusted group difference −9.79 kg (95% CI −11.5 to −8.1), P < 0.0001).”
ResultsFind in source - supportedReviewer 1The intervention improved quality of life.EQ-5D VAS improved significantly, though the utility score did not reach significance.Evidence: EQ-5D VAS treatment effect 7.55 (95% CI 2.82 to 12.29), P = 0.0019; utility score P = 0.0725.
“Quality of life (EQ-5D VAS; Fig. ) changed by 10.9 (s.d. 18.2) points in the intervention group and 2.3 (s.d. 17.8) points in the control group, with a treatment effect of 7.55 (95% CI 2.82 to 12.29), P = 0.0019.”
ResultsFind in source - supportedReviewers 1, 2The intervention was safe with no excess of serious adverse events.SAE rates were similar between groups, and no deaths occurred.Evidence: SAE table: 6 SAEs in intervention, 10 in control; no deaths.
“A total of 16 serious adverse events (SAEs) were reported during the 6 months of the study, 10 in the control group and 6 in the intervention group (Table ). There were no deaths.”
ResultsFind in source - supportedReviewer 2The intervention improved quality of life (EQ-5D VAS) at 6 months.The EQ-5D VAS showed a significant improvement with a treatment effect of 7.55 (95% CI 2.82 to 12.29), P = 0.0019.Evidence: Quality of life (EQ-5D VAS) changed by 10.9 (s.d. 18.2) in intervention vs 2.3 (s.d. 17.8) in control; treatment effect 7.55 (95% CI 2.82 to 12.29), P = 0.0019.
“Quality of life (EQ-5D VAS; Fig. ) changed by 10.9 (s.d. 18.2) points in the intervention group and 2.3 (s.d. 17.8) points in the control group, with a treatment effect of 7.55 (95% CI 2.82 to 12.29), P = 0.0019.”
ResultsFind in source
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary outcome is a patient-selected symptom score (fatigue, breathlessness, pain, anxiety/depression, or other) measured via validated questionnaires or VAS. These are patient-reported outcomes, not hard clinical endpoints. The paper does not provide evidence that these symptom scores are validated surrogates for long-term clinical outcomes in long COVID, nor does it demonstrate target engagement linking the intervention to these outcomes beyond weight loss. The discussion acknowledges that the symptom measures have not been validated in the context of long COVID, making it difficult to assess clinical significance.
“We note that the symptom outcome measures (for fatigue, pain, breathlessness, anxiety/depression and other) have not previously been validated in the context of LC, making it difficult to assess the clinical significance of improvements”
- INADEQUATEEffect sizeThe primary outcome treatment effect at 6 months is -0.34 (95% CI -0.67 to -0.01), which is less than the prespecified minimal important difference of 0.5 standard deviations. The paper does not anchor this effect to a clinically meaningful threshold, and the confidence interval includes values close to zero. Although weight loss was substantial (10.3% vs 0.6%), the primary symptom improvement is small and not clearly clinically meaningful.
“The study was designed to be able to detect a mean difference between groups at the primary analysis time point (6 months) of 0.5 points. At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
None foundRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
Checked — nothing surfaced.
The introduction cites multiple studies on long COVID prevalence, risk factors, and the rationale for weight loss as a therapeutic target. It acknowledges gaps in evidence-based strategies and justifies the remote delivery approach. Limitations of prior research are implicitly addressed by the study design (e.g., respective primary outcome).
“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”
“the metabolic and proinflammatory profile of excess body fat, the impact of excess weight on joints, blood vessels and lung function and the implications for future disease risk already associated with COVID-19 infections (for example, type 2 (T2) diabetes and cardiovascular diseases) provide a rationale for evaluating the impact of weight loss on LC among those also living with overweight and obesity”
“there is a gap in evidence-based strategies for people living with established LC and excess weight”
“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”
“the metabolic and proinflammatory profile of excess body fat, the impact of excess weight on joints, blood vessels and lung function and the implications for future disease risk already associated with COVID-19 infections (for example, type 2 (T2) diabetes and cardiovascular diseases) provide a rationale for evaluating the impact of weight loss on LC among those also living with overweight and obesity”
“there is a gap in evidence-based strategies for people living with established LC and excess weight”
Randomization used minimization with a 80:20 random component, balancing key stratification variables. Blinding was partial (open-label for participants and dietitians, but statisticians blinded until analysis). Power analysis was pre-specified to detect a 0.5 SD difference with 90% power. Inclusion/exclusion criteria were detailed. Outlier handling was not explicitly described, but missing data were handled via multiple imputation and inverse probability weighting. Controls were the wait-list usual care group. Independent replication is not applicable for a single pivotal trial.
“Participants were allocated to intervention or control groups using a mixed minimization and randomization approach to balance the groups with respect to the participant-selected dominant LC symptom (fatigue, breathlessness, pain, anxiety/depression or other), sex (male, female and other), age (<50 and 50+), ethnicity (white, South Asian and other) and IMD (postcode-based, deciles 1–5 and 6–10).”
“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”
“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”
“Participants were allocated to intervention or control groups using a mixed minimization and randomization approach to balance the groups with respect to the participant-selected dominant LC symptom (fatigue, breathlessness, pain, anxiety/depression or other), sex (male, female and other), age (<50 and 50+), ethnicity (white, South Asian and other) and IMD (postcode-based, deciles 1–5 and 6–10).”
“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”
“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”
Sex is reported for both groups, with a majority female. Age, weight, BMI, and blood pressure are reported. Demographics include ethnicity, region, and IMD. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.
“Female | 98 (84.5) | 100 (84.7)”
“Age (years) | 46.4 (9.1) | 46.1 (10.5)”
“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”
“Female | 98 (84.5) | 100 (84.7)”
“Age (years) | 46.4 (9.1) | 46.1 (10.5)”
“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”
The study obtained ethical approval from a named ethics committee with a reference number. Written informed consent was obtained electronically. Regulatory compliance is implied by adherence to the Declaration of Helsinki and CONSORT guidelines.
“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”
“All participants provided written informed consent, electronically.”
“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”
“All participants provided written informed consent, electronically.”
The intervention is described in detail, including the dietary approach and the Counterweight app. The software used for randomization and statistical analysis is identified. No antibodies, cell lines, or mycoplasma testing are applicable.
“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”
“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”
Tests are named (linear regression, ANCOVA, mixed-effects models). Assumptions are handled by design (baseline adjustment). Exact p-values are reported (e.g., P = 0.0466). Effect sizes with 95% CIs are provided throughout. Software is identified. Data presentation includes figures with means and CIs, and per-group n. Mathematical plausibility checks were not possible for all outcomes due to continuous data and large N, but no obvious errors were found.
“intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466”
“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”
“Primary and secondary outcomes were analyzed using linear regression, with a binary predictor for the randomized group and adjustment for stratification variables”
“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”
“Fatigue changed by −7.5 (s.d. 7.7) points in the intervention group and −3.7 (s.d. 5.5) points in the control at 6 months, with a treatment effect of −3.64 (95% CI −5.42 to −1.86), P < 0.0001”
The data availability statement describes a managed-access process with a named repository and conditions. The statistical analysis plan is available via ISRCTN, and eCRF screenshots are on figshare. Code sharing is not applicable as no custom code is mentioned.
“Upon publication of these papers, fully anonymized and minimized data (and data dictionaries) will be placed in a research data repository with access given to bona fide researchers on request to the corresponding authors and subject to appropriate data-sharing agreements.”
“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”
“Upon publication of these papers, fully anonymized and minimized data (and data dictionaries) will be placed in a research data repository with access given to bona fide researchers on request to the corresponding authors and subject to appropriate data-sharing agreements. Proposals will be assessed on a monthly basis, with a response within 2 months of submission.”
“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”
The trial is registered (ISRCTN12595520). CONSORT and CONSORT-PRO checklists are mentioned. All outcomes are reported, including non-significant ones. Limitations are extensively discussed. Conclusions are proportional to the evidence. Funding and competing interests are declared.
“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”
“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”
“We recognize several limitations but also strengths.”
“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”
“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”
“We recognize several limitations but also strengths. The trial was conducted in real-life settings with few exclusions, but as with most studies of LC, the trial relied on patient-generated data, including self-reported weight.”
Registered (1 ID: ISRCTN). Reporting guideline cited: CONSORT.
Broken references and links
1 finding · worst lowReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
- References not resolvable to a published paperRecomputed
Checked 50 references by DOI: 39 verified — 9 DOI unresolved, 2 no DOI (shown, not verified).
- UNRESOLVED10.1016/s2213-2600(22)00207-0Long COVID: systemic inflammation and obesity as therapeutic targetsCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.1186/s12889-022-12822-5Association between weight loss, change in physical activity, and change in quality of life following a corporately sponsored, online weight loss programCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.3310/nihropenres.13552.1Baseline characteristics in the remote diet intervention to reduce long-COVID symptoms trial (ReDIRECT)Cited DOI does not resolve to any Crossref record.
- UNRESOLVED10.1017/s0007114509993046Anthropometric, metabolic, psychosocial and dietary factors associated with dropout in overweight and obese postmenopausal women engaged in a 6-month weight loss programme: a MONET studyCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.1186/s12889-020-09255-5Exploring the influences on men’s engagement with weight loss services: a qualitative studyCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.1007/s11136-011-9921-zQuality and acceptability of patient-reported outcome measures used in chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME): a systematic reviewCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.3310/nihropenres.17785.1The remote diet intervention to reduce long COVID symptoms trial (ReDIRECT): protocol for a randomised controlled trial to determine the effectiveness and cost-effectiveness of a remotely delivered supported weight management programme for people with long COVID and excess weight, with personalised improvement goalsCited DOI does not resolve to any Crossref record.
- UNRESOLVED10.1007/s00125-021-05478-6Antihypertensive medication needs and blood pressure control with weight loss in the Diabetes Remission Clinical Trial (DiRECT)Cited DOI does not resolve to any Crossref record.
- UNRESOLVED10.6084/m9.figshare.21270837ReDIRECT study eCRF questionnaires screenshotsCited DOI does not resolve to any Crossref record.
- NO DOIAdults’ Media Use and Attitudes Report 2022No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIR: A Language and Environment for Statistical ComputingNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
1 data/code link checked; 1 live.
- datahttps://doi.org/10.1186/ISRCTN12595520LIVEHTTP 200Resolved page looks like data.
Copyediting
5 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 5 minor suggestions below.
5 copyedit issues flagged: mostly consistency, clarity, grammar.
- MINORconsistencyAbstract“n = 234, 1:1) to control ( n = 116, usual care) or the remotely delivered structured weight management ( n = 118”→ Ensure consistent use of spaces around 'n =' and parentheses.Minor formatting inconsistency.
- MINORclarityResults, Primary outcome“In n = 7 cases, ‘other’ symptoms selected as the primary outcome that matched a core symptom were recoded for sensitivity analysis”→ Clarify that the recoding was done for sensitivity analysis only, not for the primary analysis.Potential ambiguity.
- MINORgrammarDiscussion, paragraph 2“We recognize several limitations but also strengths.”→ Consider rephrasing to 'We recognize several limitations, but also several strengths.'Minor grammatical improvement.
- MINORconsistencyAbstract“n = 234, 1:1) to control ( n = 116, usual care) or the remotely delivered structured weight management ( n = 118”→ Ensure consistent use of spaces around parentheses and numbers.Minor formatting inconsistency.
- MINORclarityResults, Primary outcome“In n = 7 cases, ‘other’ symptoms selected as the primary outcome that matched a core symptom were recoded for sensitivity analysis”→ Clarify that this recoding was done for sensitivity analysis only.Could be clearer.
The published work is robust and generally trustworthy, but an informed reader should weigh the unresolved internal contradiction in participant numbers (235 vs 234 randomized) and the 9 references flagged as not found in registries, which may warrant a correction or verification. The minor copyedit issues and reporting gaps are not validity threats.
- 1.HIGHrigorResolve the internal contradiction in participant numbers: the Methods state 235 randomized while the Results state 234 (with 5 not completing baseline and 1 withdrawing after consent). Clarify the correct number and reconcile the text.An unexplained discrepancy in the primary trial denominator is a validity threat that could affect the interpretation of all results.
- 2.HIGHreportingVerify or correct the 9 references flagged as 'not found in registry' (e.g., Long COVID: systemic inflammation and obesity as therapeutic targets; Association between weight loss...; ReDIRECT protocol; etc.) — confirm they exist and are correctly cited, or replace them.References that cannot be located in any registry may be fabricated or contain errors, which is a serious integrity concern.
- 3.HIGHethicsAdd an explicit statement of regulatory compliance (e.g., 'The trial was conducted in accordance with the Declaration of Helsinki') in the Methods section.One reviewer noted regulatory compliance was only implied; an explicit statement strengthens the ethics reporting.
- 4.MEDIUMreportingIn the Methods, add a brief statement on how outliers were handled in the analysis, even if none were excluded.One reviewer flagged outlier handling as 'reported_but_inadequate'; explicit documentation improves reproducibility.
- 5.MEDIUMreportingClarify the handling of missing data for the primary outcome in the main analysis (e.g., state whether complete-case analysis or imputation was used).Both reviewers suggested this; ambiguity in missing data handling can affect interpretation of results.
- 6.MEDIUMreportingIn the Results, clarify that the recoding of 'other' symptoms to core symptoms was done for sensitivity analysis only, not for the primary analysis.The copyedit flagged this as potentially ambiguous; clarity prevents misinterpretation.
- 7.MEDIUMdata codeConsider sharing the analysis code (e.g., R scripts) in a public repository to enhance reproducibility.Although not required, sharing code would strengthen the data/code availability and allow independent verification.
- 8.MEDIUMreportingIn the Discussion, explicitly state that the study was not powered for subgroup analyses, and discuss the potential impact of the open-label design on subjective outcomes.These are known limitations that, if explicitly acknowledged, would strengthen the transparency of the paper.
- 9.LOWcopyeditFix minor formatting inconsistencies in the Abstract (e.g., consistent spacing around 'n =' and parentheses).The copyedit flagged these as minor but noticeable issues.
- 10.LOWcopyeditRephrase 'We recognize several limitations but also strengths' to 'We recognize several limitations, but also several strengths' for grammatical clarity.Minor grammatical improvement flagged by the copyedit.
- 11.LOWreportingIn the Data Availability section, provide a direct link to the repository once data are deposited, and consider adding a data access request form or contact email.This would make the access route more concrete and user-friendly.
- 12.LOWreportingIn the Results, report the number of participants with missing data for each secondary outcome to enhance transparency.This would allow readers to assess the potential impact of missing data on secondary analyses.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.