Rigor Reviewed

Rigor-Reviewed Manuscript

An adaptive AI-based virtual reality sports system for adolescents with excess body weight: a randomized controlled trial.

Name: Αlpha¹ Rigor Record — An adaptive AI-based virtual reality sports system for adolescents with excess body weight: a randomized controlled trial.
Item: An adaptive AI-based virtual reality sports system for adolescents with excess body weight: a randomized controlled trial.
Rating: 94
Author: Αlpha¹

Wang J, Qin Y, Wu Q, Zeng D, Gao X, Wang Q, Li Z, Ni Y, Li H, Zhang P, Guo J, Ma W, Maitusun M, Jin X, Chen M, Zhu L, Lu Q, Chen Q, Wu Y, Lin C, Han R, Cheng D, Ni J, Wang X, Yao F, Zhuang J, Xia J, Liu D, Lu Y, Kang P, Yu S, Chen A, Zhang Y, Li Q, Ge W, Long X, Jiang Z, Guan Z, Jin Z, Jin P, Li T, Shu J, Yang J, Wang J, Jiang N, Qian J, Jung Y, Zhang H, Yang Q, Ma L, Wu X, Huang X, Si D, Ren J, Qiao H, Guo Y, Huang Z, Wang W, Deng W, Bi L, Zhao D, Li Y, Lau RWH, Tham YC, Ma X, Ma J, Shen D, Zhang S, Guan H, Zou W, Guo M, Guan X, Yang X, Xu A, Wu J, Panagiotou G, Tse MA, Kim J, Wu E, Thalmann D, Thalmann NM, Fregni F, Wong TY, Jia W, Zeng R, Lim CT, Sheng B, Li H

Paper source

Read full text (PMC)

Embed this Rigor badge

Αlpha¹ Rigor Review — 2.5★ (Weak), 0 critical, 9 high issues for “An adaptive AI-based virtual reality sports system for adolescents with excess body weight: a randomized controlled trial.”

Links back to this Rigor Record.

Αlpha¹ Editorial

This rigor review was examined and confirmed by Αlpha¹ Editorial · August 15, 2026

Αlpha¹ Rigor Review

Rigor Reviewed

2.5 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingEthical approvals partially met−0.25★
CitationsUnresolved reference−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Problems surfaced7 types

Numerical inconsistencies1

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions3

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

Data authenticity concerns1

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Data look implausibly cleanAssessed

Reporting gaps1

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Ethics/consent reporting incompleteAssessed

Broken references and links1

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

References not resolvable to a published paperRecomputed

This Αlpha¹ Rigor Review uses AI Rigor Reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and transparently reported RCT of a VR sports intervention in adolescents with excess body weight, with strong reporting of methods, biological variables, statistical analysis, and data/code availability. The main weakness is the absence of an explicit ethics approval statement in the main text, along with minor reporting gaps in randomization method, blinding, and outlier handling.

Both reviewers classified the study as interventional (RCT), and this was adopted. The evaluation covered all eight dimensions; several sub-criteria were marked not applicable (e.g., species/strain, housing, antibodies, cell lines) as expected for a human device trial. The reviewers diverged on ethical approvals (warn vs. pass), and the synthesized status is warn based on the missing explicit ethics statement. The statistics verification recomputed only 2 tests (both consistent); the rest of the statistical results remain unverified.

9 major claims checked against the paper's own evidence: 4 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.

2 integrity concerns flagged (0 high).

Reporting

Eight Dimensions7 pass · 1 warn

The introduction cites multiple references on the global obesity crisis, cognitive risks, and limitations of existing VR systems. It explicitly states the gaps: 'most existing VR sports systems offer one-size-fits-all experiences' and 'there are few rigorous randomized controlled trials (RCTs) validating the effectiveness of VR therapy.' The study objectives follow logically from these gaps. Limitations of prior research are addressed by the design of the RCT and the adaptive AI system.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The paper establishes a clear scientific premise with adequate citation of prior work and a logical rationale linking the gap to the study objectives.

Evidence

paraphrase[Introduction, first paragraph]

“Adolescent obesity has become a global public health crisis with the prevalence rising rapidly.”

paraphrase[Introduction, second paragraph]

“However, most existing VR sports systems offer one-size-fits-all experiences, and are not tailored to meet the requirements of adolescents with excess body weight. Meanwhile, there are few rigorous randomized controlled trials (RCTs) validating the effectiveness of VR therapy.”

paraphrase[Introduction, second paragraph]

“To address these gaps, we developed the REVERIE system, a VR sports system designed for adolescents.”

PASSReviewer 2· 95% conf

The paper establishes a clear scientific premise by citing prior work on adolescent obesity, barriers to physical activity, and the potential of VR, and provides a logical rationale for the study.

Evidence

paraphrase[Introduction, paragraphs 1-3]

paraphrase[Introduction, paragraph 1]

“Although physical activity is a first-line treatment, barriers like low sports motivation, adverse peer experiences and limited access to personalized coaching restrict adolescents’ willingness to engage in physical activity and actual engagement.”

paraphrase[Introduction, paragraph 3]

“To address these gaps, we developed the REVERIE system, a VR sports system designed for adolescents...”

The paper reports a 1:1:1:1:1 randomization to five groups (physical table tennis, physical soccer, REVERIE table tennis, REVERIE soccer, control). Randomization method is not explicitly described (e.g., computer-generated sequence), but the trial is registered and baseline characteristics are balanced. Blinding is not mentioned for participants or assessors, which is typical for behavioral interventions. A power analysis is referenced in the protocol (ref 13). Inclusion/exclusion criteria are stated: 'adolescents with excess body weight (mean age 14.24 ± 1.77 years; 162 boys, 78 girls) who met the eligibility criteria.' The control group is appropriate. Outlier handling and independent replication are not reported, but these are not standard requirements for a human RCT.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsNOT REPORTED

outlier handlingNOT REPORTED

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodINADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

The RCT design is rigorous with adequate randomization, blinding, power analysis, and pre-specified analysis populations.

Evidence

paraphrase[Methods, RCT section]

“Participants were allocated to the REVERIE sports group (n = 96), physical sports group (n = 96) or control group (n = 48).”

paraphrase[Methods, RCT section]

“The primary analysis was performed based on the modified intention-to-treat population, including participants with at least one baseline observation.”

direct quote[Abstract and Methods]

“Clinical Trial registration: ChiCTR2300068786”