Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.

Name: Kaimen Rigor review — Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.
Item: Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.
Rating: 100
Author: Alpha1

Combet E, Haag L, Richardson J, Haig CE, Cunningham Y, Fraser HL, Brosnahan N, Ibbotson T, Ormerod J, White C, McIntosh E, O'Donnell CA, Sattar N, McConnachie A, Lean MEJ, Blane DN

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 2.5★ (Weak), 0 critical, 3 high issues for “Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.

Combet E, Haag L, Richardson J, Haig CE, Cunningham Y, Fraser HL, Brosnahan N, Ibbotson T, Ormerod J, White C, McIntosh E, O'Donnell CA, Sattar N, McConnachie A, Lean MEJ, Blane DN

Read full text (PMC)

DOI

10.1038/s41591-024-03384-x

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/00cc5359-16f5-4cb2-86fc-f5e404f0ef6c" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/00cc5359-16f5-4cb2-86fc-f5e404f0ef6c/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 3 high issues for “Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

caeea21aff6b3ab762032b420c0d45c5091203061f92f3034d0e83aa95d2daa3

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.

Combet E, Haag L, Richardson J, Haig CE, Cunningham Y, Fraser HL, Brosnahan N, Ibbotson T, Ormerod J, White C, McIntosh E, O'Donnell CA, Sattar N, McConnachie A, Lean MEJ, Blane DN

Paper source

Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

CitationsCitations & links (capped) ×9−1★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary outcome is a patient-selected symptom score (fatigue, breathlessness, pain, anxiety/depression, or other) measured via validated questionnaires or VAS. These are patient-reported outcomes, not hard clinical endpoints. The paper does not provide evidence that these symptom scores are validated surrogates for long-term clinical outcomes in long COVID, nor does it demonstrate target engagement linking the intervention to these outcomes beyond weight loss. The discussion acknowledges that the symptom measures have not been validated in the context of long COVID, making it difficult to assess clinical significance.
“We note that the symptom outcome measures (for fatigue, pain, breathlessness, anxiety/depression and other) have not previously been validated in the context of LC, making it difficult to assess the clinical significance of improvements”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary outcome treatment effect at 6 months is -0.34 (95% CI -0.67 to -0.01), which is less than the prespecified minimal important difference of 0.5 standard deviations. The paper does not anchor this effect to a clinically meaningful threshold, and the confidence interval includes values close to zero. Although weight loss was substantial (10.3% vs 0.6%), the primary symptom improvement is small and not clearly clinically meaningful.
“The study was designed to be able to detect a mean difference between groups at the primary analysis time point (6 months) of 0.5 points. At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95%…”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The paper is a well-conducted and transparently reported randomized trial with strong methodological rigor across all eight dimensions. Minor reporting gaps (e.g., explicit regulatory compliance statement, outlier handling detail) and a small internal inconsistency in participant numbers do not undermine the overall validity.

Both reviewers classified the study as interventional; no divergence. The evaluation covered the full text, with specialized checks on statistics (8 tests recomputed consistently), citations (9 references not found in registry), reproducibility (link live), and integrity (one low-severity internal contradiction). Non-applicable criteria (e.g., animal/housing, cell lines) were excluded.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Recomputed 8 tests: 8 consistent, 0 inconsistent; 8 via agent-written checks.

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

7 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

None found

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Checked — nothing surfaced.

Eight Dimensions8 pass

The introduction cites multiple studies on long COVID prevalence, risk factors, and the rationale for weight loss as a therapeutic target. It acknowledges gaps in evidence-based strategies and justifies the remote delivery approach. Limitations of prior research are implicitly addressed by the study design (e.g., respective primary outcome).

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale linking weight management to long COVID symptom improvement.

Evidence

“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”

Introduction ¶1Find in source

“the metabolic and proinflammatory profile of excess body fat, the impact of excess weight on joints, blood vessels and lung function and the implications for future disease risk already associated with COVID-19 infections (for example, type 2 (T2) diabetes and cardiovascular diseases) provide a rationale for evaluating the impact of weight loss on LC among those also living with overweight and obesity”

Introduction ¶2Find in source

“there is a gap in evidence-based strategies for people living with established LC and excess weight”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale linking weight management to long COVID symptom improvement.

Evidence

“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”

Introduction ¶1Find in source

Introduction ¶2Find in source

“there is a gap in evidence-based strategies for people living with established LC and excess weight”

Introduction ¶3Find in source

Randomization used minimization with a 80:20 random component, balancing key stratification variables. Blinding was partial (open-label for participants and dietitians, but statisticians blinded until analysis). Power analysis was pre-specified to detect a 0.5 SD difference with 90% power. Inclusion/exclusion criteria were detailed. Outlier handling was not explicitly described, but missing data were handled via multiple imputation and inverse probability weighting. Controls were the wait-list usual care group. Independent replication is not applicable for a single pivotal trial.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with clear randomization, blinding of statisticians, a priori power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

“Participants were allocated to intervention or control groups using a mixed minimization and randomization approach to balance the groups with respect to the participant-selected dominant LC symptom (fatigue, breathlessness, pain, anxiety/depression or other), sex (male, female and other), age (<50 and 50+), ethnicity (white, South Asian and other) and IMD (postcode-based, deciles 1–5 and 6–10).”

MethodsFind in source

“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”

MethodsFind in source

“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with clear randomization, blinding of statisticians, a priori power calculation, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”

MethodsFind in source

“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”

Statistical analysisFind in source

Sex is reported for both groups, with a majority female. Age, weight, BMI, and blood pressure are reported. Demographics include ethnicity, region, and IMD. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including sex, age, weight, BMI, and demographics.

Evidence

“Female | 98 (84.5) | 100 (84.7)”

Table 1Find in source

“Age (years) | 46.4 (9.1) | 46.1 (10.5)”

Table 1Find in source

“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”

Table 1Find in source

PASSReviewer 2· 90% conf

Sex, age, weight, BMI, and health status are reported; demographics are comprehensive.

Evidence

“Female | 98 (84.5) | 100 (84.7)”

Table 1Find in source

“Age (years) | 46.4 (9.1) | 46.1 (10.5)”

Table 1Find in source

“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”

Table 1Find in source

The study obtained ethical approval from a named ethics committee with a reference number. Written informed consent was obtained electronically. Regulatory compliance is implied by adherence to the Declaration of Helsinki and CONSORT guidelines.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”

MethodsFind in source

“All participants provided written informed consent, electronically.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approval from a named REC and informed consent are documented; regulatory compliance is implied.

Evidence

“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”

MethodsFind in source

“All participants provided written informed consent, electronically.”

MethodsFind in source

The intervention is described in detail, including the dietary approach and the Counterweight app. The software used for randomization and statistical analysis is identified. No antibodies, cell lines, or mycoplasma testing are applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The investigational product (Counterweight-Plus program) is adequately identified, and software tools are named.

Evidence

paraphrase[Methods, Procedures]

“Participants in the intervention group were provided with the Counterweight-Plus program, an evidence-based structured dietary weight management program (Counterweight).”

“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

The investigational product (Counterweight-Plus program) is identified with manufacturer and components; software tools are named.

Evidence

paraphrase[Methods, Procedures]

“Participants in the intervention group were provided with the Counterweight-Plus program, an evidence-based structured dietary weight management program (Counterweight).”

“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”

Statistical analysisFind in source

Tests are named (linear regression, ANCOVA, mixed-effects models). Assumptions are handled by design (baseline adjustment). Exact p-values are reported (e.g., P = 0.0466). Effect sizes with 95% CIs are provided throughout. Software is identified. Data presentation includes figures with means and CIs, and per-group n. Mathematical plausibility checks were not possible for all outcomes due to continuous data and large N, but no obvious errors were found.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-reported, with exact p-values and effect sizes with confidence intervals.

Evidence

“intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466”

ResultsFind in source

“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”

ResultsFind in source

“Primary and secondary outcomes were analyzed using linear regression, with a binary predictor for the randomized group and adjustment for stratification variables”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described; effect sizes with CIs are reported; p-values are exact.

Evidence

“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”

ResultsFind in source

“Fatigue changed by −7.5 (s.d. 7.7) points in the intervention group and −3.7 (s.d. 5.5) points in the control at 6 months, with a treatment effect of −3.64 (95% CI −5.42 to −1.86), P < 0.0001”

ResultsFind in source

The data availability statement describes a managed-access process with a named repository and conditions. The statistical analysis plan is available via ISRCTN, and eCRF screenshots are on figshare. Code sharing is not applicable as no custom code is mentioned.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is clearly stated with a concrete access route, and the statistical analysis plan is available via ISRCTN.

Evidence

“Upon publication of these papers, fully anonymized and minimized data (and data dictionaries) will be placed in a research data repository with access given to bona fide researchers on request to the corresponding authors and subject to appropriate data-sharing agreements.”

Data availabilityFind in source

“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability statement is concrete with a managed-access procedure; code is not shared but is not applicable.

Evidence

Data availabilityFind in source

“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”

Data availabilityFind in source

The trial is registered (ISRCTN12595520). CONSORT and CONSORT-PRO checklists are mentioned. All outcomes are reported, including non-significant ones. Limitations are extensively discussed. Conclusions are proportional to the evidence. Funding and competing interests are declared.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The manuscript is transparent with trial registration, reporting guidelines, and thorough discussion of limitations.

Evidence

“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”

AbstractFind in source

“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”

Supplementary materialFind in source

“We recognize several limitations but also strengths.”

Discussion ¶2Find in source

PASSReviewer 2· 95% conf

The trial is registered, reporting guidelines are followed, limitations are discussed, and conclusions are proportional.

Evidence

“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”

AbstractFind in source

“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”

Supplementary materialFind in source

“We recognize several limitations but also strengths. The trial was conducted in real-life settings with few exclusions, but as with most studies of LC, the trial relied on patient-generated data, including self-reported weight.”

Discussion ¶2Find in source

Registered (1 ID: ISRCTN). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 50 references by DOI: 39 verified — 9 DOI unresolved, 2 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and generally trustworthy, but an informed reader should weigh the unresolved internal contradiction in participant numbers (235 vs 234 randomized) and the 9 references flagged as not found in registries, which may warrant a correction or verification. The minor copyedit issues and reporting gaps are not validity threats.

1.
HIGHrigor
Resolve the internal contradiction in participant numbers: the Methods state 235 randomized while the Results state 234 (with 5 not completing baseline and 1 withdrawing after consent). Clarify the correct number and reconcile the text.
An unexplained discrepancy in the primary trial denominator is a validity threat that could affect the interpretation of all results.
2.
HIGHreporting
Verify or correct the 9 references flagged as 'not found in registry' (e.g., Long COVID: systemic inflammation and obesity as therapeutic targets; Association between weight loss...; ReDIRECT protocol; etc.) — confirm they exist and are correctly cited, or replace them.
References that cannot be located in any registry may be fabricated or contain errors, which is a serious integrity concern.
3.
HIGHethics
Add an explicit statement of regulatory compliance (e.g., 'The trial was conducted in accordance with the Declaration of Helsinki') in the Methods section.
One reviewer noted regulatory compliance was only implied; an explicit statement strengthens the ethics reporting.
4.
MEDIUMreporting
In the Methods, add a brief statement on how outliers were handled in the analysis, even if none were excluded.
One reviewer flagged outlier handling as 'reported_but_inadequate'; explicit documentation improves reproducibility.
5.
MEDIUMreporting
Clarify the handling of missing data for the primary outcome in the main analysis (e.g., state whether complete-case analysis or imputation was used).
Both reviewers suggested this; ambiguity in missing data handling can affect interpretation of results.
6.
MEDIUMreporting
In the Results, clarify that the recoding of 'other' symptoms to core symptoms was done for sensitivity analysis only, not for the primary analysis.
The copyedit flagged this as potentially ambiguous; clarity prevents misinterpretation.
7.
MEDIUMdata code
Consider sharing the analysis code (e.g., R scripts) in a public repository to enhance reproducibility.
Although not required, sharing code would strengthen the data/code availability and allow independent verification.
8.
MEDIUMreporting
In the Discussion, explicitly state that the study was not powered for subgroup analyses, and discuss the potential impact of the open-label design on subjective outcomes.
These are known limitations that, if explicitly acknowledged, would strengthen the transparency of the paper.
9.
LOWcopyedit
Fix minor formatting inconsistencies in the Abstract (e.g., consistent spacing around 'n =' and parentheses).
The copyedit flagged these as minor but noticeable issues.
10.
LOWcopyedit
Rephrase 'We recognize several limitations but also strengths' to 'We recognize several limitations, but also several strengths' for grammatical clarity.
Minor grammatical improvement flagged by the copyedit.
11.
LOWreporting
In the Data Availability section, provide a direct link to the repository once data are deposited, and consider adding a data access request form or contact email.
This would make the access route more concrete and user-friendly.
12.
LOWreporting
In the Results, report the number of participants with missing data for each secondary outcome to enhance transparency.
This would allow readers to assess the potential impact of missing data on secondary analyses.

Full text (66,104 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.

Combet E, Haag L, Richardson J, Haig CE, Cunningham Y, Fraser HL, Brosnahan N, Ibbotson T, Ormerod J, White C, McIntosh E, O'Donnell CA, Sattar N, McConnachie A, Lean MEJ, Blane DN

Read full text (PMC)

DOI

10.1038/s41591-024-03384-x

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/00cc5359-16f5-4cb2-86fc-f5e404f0ef6c" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/00cc5359-16f5-4cb2-86fc-f5e404f0ef6c/badge" alt="Kaimen Rigor review — 2.5★ (Weak), 0 critical, 3 high issues for “Remotely delivered weight management for people with long COVID and overweight: the randomized wait-list-controlled ReDIRECT trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

caeea21aff6b3ab762032b420c0d45c5091203061f92f3034d0e83aa95d2daa3

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

CitationsCitations & links (capped) ×9−1★
IntegrityIntegrity concern−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★

Citations & links are capped at −1★ combined, however many are flagged.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary outcome is a patient-selected symptom score (fatigue, breathlessness, pain, anxiety/depression, or other) measured via validated questionnaires or VAS. These are patient-reported outcomes, not hard clinical endpoints. The paper does not provide evidence that these symptom scores are validated surrogates for long-term clinical outcomes in long COVID, nor does it demonstrate target engagement linking the intervention to these outcomes beyond weight loss. The discussion acknowledges that the symptom measures have not been validated in the context of long COVID, making it difficult to assess clinical significance.
“We note that the symptom outcome measures (for fatigue, pain, breathlessness, anxiety/depression and other) have not previously been validated in the context of LC, making it difficult to assess the clinical significance of improvements”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary outcome treatment effect at 6 months is -0.34 (95% CI -0.67 to -0.01), which is less than the prespecified minimal important difference of 0.5 standard deviations. The paper does not anchor this effect to a clinically meaningful threshold, and the confidence interval includes values close to zero. Although weight loss was substantial (10.3% vs 0.6%), the primary symptom improvement is small and not clearly clinically meaningful.
“The study was designed to be able to detect a mean difference between groups at the primary analysis time point (6 months) of 0.5 points. At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95%…”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 04DisclosureNone found 105AvailabilityBroken references and links 06Copyedit5 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Recomputed 8 tests: 8 consistent, 0 inconsistent; 8 via agent-written checks.

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

7 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

None found

Checked — nothing surfaced.

Eight Dimensions8 pass

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale linking weight management to long COVID symptom improvement.

Evidence

“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”

Introduction ¶1Find in source

Introduction ¶2Find in source

“there is a gap in evidence-based strategies for people living with established LC and excess weight”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The paper establishes a clear scientific premise with extensive prior work and a logical rationale linking weight management to long COVID symptom improvement.

Evidence

“Long COVID (LC) is a multisystem condition that can affect approximately 10% of people following a coronavirus disease 2019 (COVID-19) infection”

Introduction ¶1Find in source

Introduction ¶2Find in source

“there is a gap in evidence-based strategies for people living with established LC and excess weight”

Introduction ¶3Find in source

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingINADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The trial design is rigorous with clear randomization, blinding of statisticians, a priori power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”

MethodsFind in source

“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The trial design is rigorous with clear randomization, blinding of statisticians, a priori power calculation, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

“Statisticians analyzing the data remained blinded until the statistical analysis plan was completed and the primary analysis database was locked.”

MethodsFind in source

“For 90% power at 5% statistical significance, 86 participants per group with outcome data were calculated as necessary.”

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are well reported for a human trial, including sex, age, weight, BMI, and demographics.

Evidence

“Female | 98 (84.5) | 100 (84.7)”

Table 1Find in source

“Age (years) | 46.4 (9.1) | 46.1 (10.5)”

Table 1Find in source

“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”

Table 1Find in source

PASSReviewer 2· 90% conf

Sex, age, weight, BMI, and health status are reported; demographics are comprehensive.

Evidence

“Female | 98 (84.5) | 100 (84.7)”

Table 1Find in source

“Age (years) | 46.4 (9.1) | 46.1 (10.5)”

Table 1Find in source

“Ethnicity a , n (%) | | White | 106 (91.4) | 105 (89.0)”

Table 1Find in source

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval and informed consent are clearly documented.

Evidence

“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”

MethodsFind in source

“All participants provided written informed consent, electronically.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethical approval from a named REC and informed consent are documented; regulatory compliance is implied.

Evidence

“Ethical approval was obtained from the South-East Scotland Research Ethics Committee 01 (REC reference number 21/SS/0077).”

MethodsFind in source

“All participants provided written informed consent, electronically.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The investigational product (Counterweight-Plus program) is adequately identified, and software tools are named.

Evidence

paraphrase[Methods, Procedures]

“Participants in the intervention group were provided with the Counterweight-Plus program, an evidence-based structured dietary weight management program (Counterweight).”

“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”

Statistical analysisFind in source

PASSReviewer 2· 85% conf

The investigational product (Counterweight-Plus program) is identified with manufacturer and components; software tools are named.

Evidence

paraphrase[Methods, Procedures]

“Participants in the intervention group were provided with the Counterweight-Plus program, an evidence-based structured dietary weight management program (Counterweight).”

“Statistical analyses were performed using SAS software, version 9.4 and R for Windows, version 4.1.2”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical methods are appropriate and well-reported, with exact p-values and effect sizes with confidence intervals.

Evidence

“intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466”

ResultsFind in source

“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”

ResultsFind in source

“Primary and secondary outcomes were analyzed using linear regression, with a binary predictor for the randomized group and adjustment for stratification variables”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Statistical methods are appropriate and well-described; effect sizes with CIs are reported; p-values are exact.

Evidence

“At 6 months, the adjusted between-group mean difference favored the intervention (intervention effect estimate −0.34 (95% CI −0.67 to −0.01), P = 0.0466).”

ResultsFind in source

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositADEQUATE

data availability statementADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Data availability is clearly stated with a concrete access route, and the statistical analysis plan is available via ISRCTN.

Evidence

Data availabilityFind in source

“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability statement is concrete with a managed-access procedure; code is not shared but is not applicable.

Evidence

Data availabilityFind in source

“The Statistical Analysis Plan is available via ISRCTN (10.1186/ISRCTN12595520)”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The manuscript is transparent with trial registration, reporting guidelines, and thorough discussion of limitations.

Evidence

“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”

AbstractFind in source

“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”

Supplementary materialFind in source

“We recognize several limitations but also strengths.”

Discussion ¶2Find in source

PASSReviewer 2· 95% conf

The trial is registered, reporting guidelines are followed, limitations are discussed, and conclusions are proportional.

Evidence

“International Standard Randomised Controlled Trial Number Registry registration: ISRCTN 12595520 (https://doi.org/10.1186/ISRCTN12595520)”

AbstractFind in source

“Consolidated Standards of Reporting Trials (CONSORT) checklist and CONSORT extension for reporting of patient-reported outcomes (CONSORT-PRO) checklist.”

Supplementary materialFind in source

Discussion ¶2Find in source

Registered (1 ID: ISRCTN). Reporting guideline cited: CONSORT.

Broken references and links

1 finding · worst low

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

Checked 50 references by DOI: 39 verified — 9 DOI unresolved, 2 no DOI (shown, not verified).

1 data/code link checked; 1 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHrigor
Resolve the internal contradiction in participant numbers: the Methods state 235 randomized while the Results state 234 (with 5 not completing baseline and 1 withdrawing after consent). Clarify the correct number and reconcile the text.
An unexplained discrepancy in the primary trial denominator is a validity threat that could affect the interpretation of all results.
2.
HIGHreporting
Verify or correct the 9 references flagged as 'not found in registry' (e.g., Long COVID: systemic inflammation and obesity as therapeutic targets; Association between weight loss...; ReDIRECT protocol; etc.) — confirm they exist and are correctly cited, or replace them.
References that cannot be located in any registry may be fabricated or contain errors, which is a serious integrity concern.
3.
HIGHethics
Add an explicit statement of regulatory compliance (e.g., 'The trial was conducted in accordance with the Declaration of Helsinki') in the Methods section.
One reviewer noted regulatory compliance was only implied; an explicit statement strengthens the ethics reporting.
4.
MEDIUMreporting
In the Methods, add a brief statement on how outliers were handled in the analysis, even if none were excluded.
One reviewer flagged outlier handling as 'reported_but_inadequate'; explicit documentation improves reproducibility.
5.
MEDIUMreporting
Clarify the handling of missing data for the primary outcome in the main analysis (e.g., state whether complete-case analysis or imputation was used).
Both reviewers suggested this; ambiguity in missing data handling can affect interpretation of results.
6.
MEDIUMreporting
In the Results, clarify that the recoding of 'other' symptoms to core symptoms was done for sensitivity analysis only, not for the primary analysis.
The copyedit flagged this as potentially ambiguous; clarity prevents misinterpretation.
7.
MEDIUMdata code
Consider sharing the analysis code (e.g., R scripts) in a public repository to enhance reproducibility.
Although not required, sharing code would strengthen the data/code availability and allow independent verification.
8.
MEDIUMreporting
In the Discussion, explicitly state that the study was not powered for subgroup analyses, and discuss the potential impact of the open-label design on subjective outcomes.
These are known limitations that, if explicitly acknowledged, would strengthen the transparency of the paper.
9.
LOWcopyedit
Fix minor formatting inconsistencies in the Abstract (e.g., consistent spacing around 'n =' and parentheses).
The copyedit flagged these as minor but noticeable issues.
10.
LOWcopyedit
Rephrase 'We recognize several limitations but also strengths' to 'We recognize several limitations, but also several strengths' for grammatical clarity.
Minor grammatical improvement flagged by the copyedit.
11.
LOWreporting
In the Data Availability section, provide a direct link to the repository once data are deposited, and consider adding a data access request form or contact email.
This would make the access route more concrete and user-friendly.
12.
LOWreporting
In the Results, report the number of participants with missing data for each secondary outcome to enhance transparency.
This would allow readers to assess the potential impact of missing data on secondary analyses.

Full text (66,104 chars)Analyzed: Aug 16, 2026