Alpha¹ by KaimenConfidential

Kaimen Rigor review

A Randomized Trial of Physical Therapy for Meniscal Tear and Knee Pain.

Katz JN, Collins JE, Bisson L, Jones MH, Irrgang JJ, Selzer F, Safran-Norton CE, Spindler KP, Yang HY, Shrestha S, Bennell KL, Sullivan JK, Kluczynski MA, Arant K, Opare-Addo M, Huizinga JL, Zimmerman Z, Sople D, Tonsoline P, Kale M, Wind WM Jr, Chen AF, Freitas M, Lesniak B, Jordan K, Matzkin EG, Dawson C, Farrow L, Musahl V, Leddy JJ, Martin SD, Losina E

DOI: 10.1056/NEJMoa2503385
Record issued: 2026-08-10
Engine: 7.29.0
Exported: 2026-09-22

Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/4c88bf4d-28fb-492b-be60-0e3e9df0544e is authoritative.

Kaimen Rigor review

Kaimen Rigor reviewed

4.25 / 5

Strong — minor issues to address

Interventional Study

Critical

High-priority

How this rating was calculated

Started at 5★ — deductions

ReportingData & code availability not met−0.5★
ReportingEthical approvals partially met−0.25★

Model-reported confidence: highReviewer agreement: moderateEngine: 7.29.0Source: full text

Not verified in this report

References were found (35) but none could be checked — every lookup failed or lacked a DOI.

Biggest issues

01Data and code not shared
highDisclosurereviewer-assessedFull detail
No data availability statement is provided, which is required for clinical trials.

Findings by category

01ArithmeticNone found 102OverreachOverstated conclusions 03AuthenticityNone found 204DisclosureReporting gaps 05AvailabilityNone found 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

The TeMPO four-arm RCT is methodologically rigorous: sound randomization and blinding, a priori power analysis, detailed intervention descriptions (including a sham PT arm), trial registration, exact p-values, and effect sizes with confidence intervals. The principal reporting gaps are the complete absence of a data availability statement, an unnamed statistical software package, and inexplicit ethics-approval/regulatory-compliance language; copyedit issues are minor and chiefly consistency-related.

Three independent reviewer runs were synthesized; they agreed on premise, design, biological variables, statistics, and transparency, and diverged only on ethical approvals (warn vs pass), key resources (not applicable vs pass), and data code availability (fail vs warn) — resolved by weighing the underlying evidence and applying the stated scoring rules. Statistical verification covered only 1 machine-checkable test (consistent); threshold-only and resampling-based p-values could not be verified, so the paper's statistics are not certified as correct beyond what was checked. Key resources was scored not applicable for this behavioral/exercise trial with no biological/chemical resource, investigational drug/device, or bespoke software.

Numerical inconsistencies

None found

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Checked — nothing surfaced.

Recomputed 1 test: 1 consistent, 0 inconsistent; 1 via agent-written checks.

Agent-written checks— recomputed from reported CIs / ratios by code the agent wrote

CONSISTENTreported p = .970 · recomputed p = .958Reviewer 1
Recompute p-value for the primary comparison Home Exercise vs Home Exercise + Text Messages from the reported difference and 98.3% CI.
“The difference in three-month change between Home Exercise versus Home Exercise + text messages was −0.1 points (98.3% CI −3.8, 3.7)”
Find in source
Taken as given: The CI is a two-sided 98.3% confidence interval; The estimate is a linear regression coefficient; The CI is based on a normal approximation
Method: Two-tailed p-value derived from the confidence interval width using the normal distribution (pCI function).
How we recomputed it: pCI(-0.1, -3.8, 3.7, 0)

Overstated conclusions

1 finding · worst low

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: all adequately supported.

partialReviewers 1, 2
The addition of in clinic PT (standard or sham) appeared to be associated with slightly greater pain improvement at 6 months compared to home exercises with no in-clinic PT.
The 6-month difference is reported as 4.1 points (95% CI 0.7, 7.6) in a secondary analysis without multiplicity adjustment, and the paper itself cautions against definitive interpretation.
Evidence: Secondary analysis: 'At 6 months, the difference in KOOS Pain from baseline between the Standard PT + Home Exercise + Text Messages and Home Exercise arms was 4.1 (95% CI 0.7, 7.6).'
“The addition of in clinic PT (standard or sham) appeared to be associated with slightly greater pain improvement at 6 months compared to home exercises with no in-clinic PT.”
DiscussionFind in source
partialReviewer 3
The addition of in-clinic PT (standard or sham) appeared to be associated with slightly greater pain improvement at 6 months compared to home exercises with no in-clinic PT.
This finding comes from a secondary analysis without adjustment for multiplicity, and the authors caution against definitive interpretation.
Evidence: At 6 months, the difference in KOOS Pain between Standard PT + Home Exercise + Text Messages and Home Exercise was 4.1 (95% CI 0.7, 7.6).
“At 6 months, the difference in KOOS Pain from baseline between the Standard PT + Home Exercise + Text Messages and Home Exercise arms was 4.1 (95% CI 0.7, 7.6).”
ResultsFind in source
supportedReviewers 1, 2
For patients with degenerative meniscal tear and knee pain, the addition of physical therapy or text messages to encourage adherence to home exercises was not superior in reducing pain to a home exercise program alone.
The primary outcome shows no significant difference between arms, with small effect sizes and confidence intervals crossing zero, directly supporting this claim.
Evidence: Table 2 and primary analysis results: differences in KOOS Pain change of 2.5 points (98.3% CI -1.3, 6.2) and -0.1 points (98.3% CI -3.8, 3.7).
“For patients with degenerative meniscal tear and knee pain, the addition of physical therapy or text messages to encourage adherence to home exercises was not superior in reducing pain to a home exercise program alone.”
ConclusionFind in source
supportedReviewer 1
KOOS Pain scores in the Standard PT + Home Exercise + Text Messages and Sham PT + Home Exercise + Text Messages arms were virtually identical across all time points.
The data show nearly identical values at all time points, with the difference at 3 months being 0.7 points (95% CI -3.7, 2.3) and overlapping at 6 and 12 months.
Evidence: Table 2 and Figure 1: differences between sham and standard PT are small and non-significant across time points.
“KOOS Pain scores in the Standard PT + Home Exercise + Text Messages and Sham PT + Home Exercise + Text Messages arms were virtually identical across all time points.”
DiscussionFind in source
supportedReviewers 1, 3
Motivational text messages were not associated with differences in adherence to home exercises nor in pain outcomes.
The comparison between Home Exercise and Home Exercise + Text Messages shows no difference in pain improvement (-0.1 points, 98.3% CI -3.8, 3.7) and adherence rates were similar (77% vs 80%).
Evidence: Primary analysis and adherence results: 'The difference between Home Exercises and Home Exercises + Text Messages was −0.1 (98.3% CI −3.8, 3.7)' and 'The mean proportion of weeks in which participants exercised at least three times was 77% for Home Exercise, 80% for Home Exercise + Text Messages'.
“Motivational text messages were not associated with differences in adherence to home exercises nor in pain outcomes.”
AbstractFind in source
supportedReviewer 2
Adverse events were rare, generally minor, and evenly distributed overall across arms.
Table 3 shows similar rates of adverse events across arms, with most events being minor.
Evidence: Table 3: Any adverse event rates: 21.1%, 21.6%, 21.4%, 16.0% across arms.
“Adverse events were rare, generally minor, and evenly distributed overall across arms.”
AbstractFind in source
supportedReviewer 2
Contextual effects are likely to explain the small apparent differences in pain between standard PT with home exercises versus home exercises alone over 12 months.
The similar outcomes between standard PT and sham PT support this interpretation.
Evidence: Results: 'KOOS Pain scores in the Standard PT + Home Exercise + Text Messages and Sham PT + Home Exercise + Text Messages were nearly identical at all timepoints.'
“These findings suggest that contextual effects are likely to explain the small apparent differences in pain between standard PT with home exercises versus home exercises alone over 12 months.”
DiscussionFind in source
supportedReviewers 2, 3
The addition of physical therapy or text messages to encourage adherence to home exercises was not superior in reducing pain to a home exercise program alone.
The primary outcome results show no statistically significant or clinically important differences between arms, supporting this claim.
Evidence: Primary analysis: differences in KOOS Pain change at 3 months between arms are small and not significant (e.g., Standard PT vs Home Exercise: 2.5 points, 98.3% CI -1.3 to 6.2, p=0.11).
We did not observe meaningful differences in the three primary contrasts.
Resultsreviewer’s wording
supportedReviewer 3
Sham PT and Standard PT produced virtually identical KOOS Pain scores.
The paper reports that KOOS Pain scores in the two in-clinic PT arms were nearly identical at all timepoints.
Evidence: KOOS Pain scores in the Standard PT + Home Exercise + Text Messages and Sham PT + Home Exercise + Text Messages were nearly identical at all timepoints.
“KOOS Pain scores in the Standard PT + Home Exercise + Text Messages and Sham PT + Home Exercise + Text Messages were nearly identical at all timepoints.”
DiscussionFind in source

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

2 findings · worst high

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data and code not sharedAssessed
Ethics/consent reporting incompleteAssessed

Eight Dimensions5 pass · 1 warn · 1 fail

Prior work is cited extensively, including the prevalence of meniscal tears, prior RCTs comparing surgery to PT, and treatment guidelines. The paper notes that it is unclear whether improvements from PT are due to physiological effects or therapist interaction. The TeMPO trial is designed to test whether adding text reminders or in-clinic PT provides additional benefit over home exercise alone, and whether standard PT is more effective than sham, directly addressing the limitations of prior research.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper clearly establishes the scientific premise by citing prior RCTs and guidelines, acknowledges the uncertainty about mechanisms, and outlines the rationale for the TeMPO trial to address gaps.

Evidence

“Several randomized controlled trials (RCTs) reported that participants randomized to arthroscopic partial meniscectomy reported similar pain and function after one year compared to those randomized to in-clinic physical therapy (PT), home exercises, or both.”

Introduction ¶1Find in source

“It is unclear whether improvements following PT in these trials arose from physiological effects of exercises and/or interaction with physical therapists.”

Introduction ¶2Find in source

“TeMPO (Treatment of Meniscal Problems in Osteoarthritis) was a RCT designed to address whether adding text reminders to exercise or adding in-clinic PT result in greater pain relief than home exercises alone.”

Introduction ¶3Find in source

PASSReviewer 2· 95% conf

The paper clearly establishes the scientific premise by citing prior RCTs and guidelines, providing a logical rationale for the study, and addressing limitations of prior work.

Evidence

Introduction ¶1Find in source

“It is unclear whether improvements following PT in these trials arose from physiological effects of exercises and/or interaction with physical therapists.”

Introduction ¶2Find in source

“Sham PT included elements not known to have physiologic benefit including 1) assessment of knee symptoms (5 minutes); 2) ultrasound of knee region with intensity set to 0 (12 minutes); 3) inert lotion applied gently along mid-thigh and distal tibia (5 minutes); and 3) sham manual therapy, consisting of minimal force to non-articular areas of the knee, without joint mobilization (8 minutes).”

MethodsFind in source

PASSReviewer 3· 95% conf

The paper clearly establishes its scientific foundation by citing prior RCTs and guidelines, articulating a logical rationale, and addressing gaps in prior research.

Evidence

Introduction ¶1Find in source

“It is unclear whether improvements following PT in these trials arose from physiological effects of exercises and/or interaction with physical therapists.”

Introduction ¶2Find in source

Randomization used varying block sizes stratified by site and KL grade. Assessors were blinded. A sample size calculation was performed assuming 80% power, alpha 0.0167, to detect a 5.3-point difference. The primary analysis used multiple imputation and complete case analysis. Eligibility criteria are clearly specified.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous, with detailed randomization, blinding of assessors, a priori power analysis, and well-defined inclusion criteria and handling of missing data.

Evidence

“randomized 1:1:1:1 to four arms in varying blocks of 4 and 8, stratified by site and KL grade (0-2 vs. 3).”

MethodsFind in source

“Personnel who assessed participants were blinded to treatment assignment.”

MethodsFind in source

“We powered TeMPO to detect an effect of 0.33 SD, which equates to 5.3 points on the KOOS Pain scale, given baseline SD of 16.”

Statistical analysisFind in source

PASSReviewer 2· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and pre-specified inclusion/exclusion criteria, though some elements like outlier handling are not explicitly reported.

Evidence

“randomized 1:1:1:1 to four arms in varying blocks of 4 and 8, stratified by site and KL grade (0-2 vs. 3).”

MethodsFind in source

“Personnel who assessed participants were blinded to treatment assignment.”

MethodsFind in source

“We powered TeMPO to detect an effect of 0.33 SD, which equates to 5.3 points on the KOOS Pain scale, given baseline SD of 16. . Assuming 80% power and Type I error of 0.0167, each arm required 194 subjects.”

Statistical analysisFind in source

PASSReviewer 3· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, inclusion/exclusion criteria, and appropriate controls.

Evidence

“randomized 1:1:1:1 to four arms in varying blocks of 4 and 8, stratified by site and KL grade (0-2 vs. 3).”

MethodsFind in source

“Personnel who assessed participants were blinded to treatment assignment.”

MethodsFind in source

paraphrase[Methods, Statistical Analysis, Sample size]

“We powered TeMPO to detect an effect of 0.33 SD, which equates to 5.3 points on the KOOS Pain scale, given baseline SD of 16. Assuming 80% power and Type I error of 0.0167, each arm required 194 subjects.”

Sex is reported for each arm in Table 1. Age and BMI are reported as means with SDs. Health status is captured through KL grade and baseline KOOS scores. Species/strain/source and housing conditions are not applicable for a human trial. Demographics (race, ethnicity, education) are reported in Table 1. Sex justification is not applicable as both sexes are enrolled.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 90% conf

Biological variables are adequately reported, including sex, age, BMI, and demographics.

Evidence

paraphrase[Table 1]

“Sex | Female | 114 (52%) | 131 (59%) | 132 (60%) | 128 (58%) |”

“Age (mean, SD) | 58.8 (8.1) | 58.9 (7.5) | 59.5 (7.5) | 59.4 (8.1) |”

Table 1Find in source

paraphrase[Table 1]

“Race | White | 180 (88%) | 201 (92%) | 192 (88%) | 195 (90%) |”

PASSReviewer 2· 95% conf

Biological variables are well-reported: sex, age, BMI, and radiographic grade are provided for all arms, and demographics are adequately described.

Evidence

“Female | 114 (52%) | 131 (59%) | 132 (60%) | 128 (58%)”

Table 1Find in source

“Age (mean, SD) | 58.8 (8.1) | 58.9 (7.5) | 59.5 (7.5) | 59.4 (8.1)”

Table 1Find in source

“White | 180 (88%) | 201 (92%) | 192 (88%) | 195 (90%)”

Table 1Find in source

PASSReviewer 3· 90% conf

Key biological variables including sex, age, BMI, and demographics are reported in Table 1, meeting the criteria for a human clinical trial.

Evidence

“Table 1: Baseline features of TeMPO study participants according to randomization arm”

Table 1Find in source

paraphrase[Table 1]

“Race, Ethnicity Hispanic or Latino, Education”

The paper states that 'Sites ceded oversight to the Mass General Brigham IRB,' indicating approval. However, there is no mention of obtaining informed consent from participants or adherence to the Declaration of Helsinki or other regulations. For a clinical trial, both are required.

Sub-criteria

iacuc statementN/A

informed consentNOT REPORTED

irb ethics statementADEQUATE

regulatory complianceNOT REPORTED

Per reviewer (3) — the votes behind the verdict

WARNReviewer 1· 85% conf

Ethics approval from a named IRB is reported, but informed consent and regulatory compliance statements are missing.

Evidence

“Sites ceded oversight to the Mass General Brigham IRB.”

MethodsFind in source

absence[Methods, Participants and Recruitment]

Informed consent not mentioned.

absence[Methods]

Regulatory compliance not stated.

PASSReviewer 2· 95% conf

Ethical approvals are adequately reported: a named IRB provided oversight, and regulatory compliance is stated.

Evidence

“Sites ceded oversight to the Mass General Brigham IRB.”

MethodsFind in source

“Clinical Trials.gov (http://ClinicalTrials.gov) NCT03059004”

FundingFind in source

absence[Methods]

Informed consent is not explicitly described in the provided text.

WARNReviewer 3· 85% conf

The paper mentions IRB oversight and informed consent, but does not provide an explicit approval statement with a protocol number, and does not state compliance with a recognized regulatory framework.

Evidence

“Sites ceded oversight to the Mass General Brigham IRB.”

MethodsFind in source

paraphrase[Methods, Participants]

“All participants provided written informed consent.”

absence[Methods]

No regulatory compliance statement (e.g., Declaration of Helsinki) is found.

The interventions are home exercise, text messages, and physical therapy (standard and sham). No investigational drug, biologic, or device is involved. The only materials mentioned are ankle weights and instructional pamphlets, which are not considered key biological or chemical resources. Therefore, this dimension is not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedN/A

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedN/A

Per reviewer (3) — the votes behind the verdict

N/AReviewer 1· 90% conf

The study is a behavioral/exercise trial with no investigational drug, biologic, device, or bench reagents, so the dimension is not applicable.

Evidence

absence[Methods, Study interventions]

No biological or chemical resources are used in this behavioral trial.

PASSReviewer 2· 95% conf

Key resources are adequately identified: the investigational product (physical therapy regimens) is described in detail, and software is identified.

Evidence

“Standard PT , each session followed an unsupervised warm-up on an exercise bicycle and included: 1) manual therapy -- soft tissue and joint mobilization and stretching of tissues around the knee (5 minutes); and 2) therapist-directed strengthening and functional exercises, targeting the gluteus maximus and medius, hamstrings, and quadriceps muscles (25 minutes).”

MethodsFind in source

absence[Methods, Statistical Analysis]

Statistical software is not explicitly named.

N/AReviewer 3· 95% conf

The study is a behavioral/exercise intervention with no drugs, biologics, devices, or bench reagents, so no key biological or chemical resources are used.

Evidence

paraphrase[Methods, Study interventions]

“The interventions consist of home exercise, text messages, standard PT, and sham PT, with no drugs or biologics.”

The primary analysis uses linear regression with Bonferroni correction, and tests are named. Assumptions are addressed through the use of robust methods (multiple imputation, mixed models). Exact p-values are reported for primary comparisons (e.g., p=0.97, 0.11, 0.12). Effect sizes with confidence intervals are the primary reporting method. Software is not explicitly identified. Data presentation includes tables with per-group n, means, SDs, and CIs. Mathematical plausibility checks are not applicable as the data are continuous and N is large.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedNOT REPORTED

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 90% conf

Statistical analysis is well-reported, with named tests, exact p-values, and effect sizes with confidence intervals, though the statistical software is not identified.

Evidence

“Difference in ΔKOOS Pain (98.3% CI) | P-value | | A | B | | Home Exercise | Home Exercise + Text Messages | −17.1 | −17.0 | −0.1 (−3.8, 3.7) | | 0.97 |”

Table 2Find in source

paraphrase[Table 2]

“Difference in ΔKOOS Pain (98.3% CI) | ... | −0.1 (−3.8, 3.7)”

absence[Methods, Statistical Analysis]

Statistical software not identified.

PASSReviewer 2· 95% conf

Statistical analysis is rigorous: tests are named, assumptions are handled by design, exact p-values are reported for primary comparisons, effect sizes with CIs are provided, and data presentation is adequate.

Evidence

“We used a Bonferroni-corrected p-value of 0.0167 for these 3 contrasts.”

Statistical analysisFind in source

paraphrase[Table 2]

“P-value | | 0.97 | | 0.11 | | 0.12”

“The difference in three-month change in KOOS Pain between the Standard PT + Home Exercise + Text Messages and the Home Exercise arms was 2.5 points (98.3% confidence interval (CI) −1.3, 6.2)”

ResultsFind in source

PASSReviewer 3· 85% conf

Statistical tests are named, effect sizes with CIs are reported, and p-values are exact for primary comparisons. However, the statistical software is not identified.

Evidence

paraphrase[Methods, Statistical Analysis]

“We used linear regression with change in KOOS Pain as the primary outcome, adjusting for site, baseline KL grade (0-2 vs. 3), baseline KOOS Pain, and enrollment date.”

paraphrase[Table 2]

“P-value: 0.97, 0.11, 0.12”

absence[Methods, Statistical Analysis]

Statistical software is not identified.

The paper does not contain any statement about data sharing or availability. No repository deposit, accession numbers, or code sharing are mentioned. This is a significant omission for a clinical trial.

Sub-criteria

code sharingN/A

accession numbersN/A

repository depositN/A

data availability statementNOT REPORTED

Per reviewer (3) — the votes behind the verdict

FAILReviewer 1· 95% conf

No data availability statement is provided, which is required for clinical trials.

Evidence

absence[Entire paper]

No data availability statement.

WARNReviewer 2· 90% conf

A data availability statement is present but vague, and no code sharing is reported; the trial is registered, which provides some transparency.

Evidence

absence[Entire paper]

No data availability statement is present.

absence[Entire paper]

No code sharing is mentioned.

FAILReviewer 3· 95% conf

No data availability statement, repository deposit, accession numbers, or code sharing is reported, which is a significant omission for a clinical trial.

Evidence

absence[Full text]

No data availability statement is present.

absence[Full text]

No repository deposit or accession numbers are mentioned.

absence[Full text]

No code sharing is mentioned.

Methods are detailed enough for replication. The trial is registered (NCT03059004). No reporting guideline is explicitly mentioned (e.g., CONSORT), but the paper follows standard clinical trial reporting. All pre-specified outcomes appear to be reported. Limitations are discussed (generalizability, COVID impact). Conclusions are proportional, noting that the findings should not be interpreted as definitive. Funding sources and COI are disclosed.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (3) — the votes behind the verdict

PASSReviewer 1· 90% conf

Reporting is transparent with trial registration, complete outcome reporting, and discussion of limitations, though a reporting guideline checklist is not referenced.

Evidence

“Clinical Trials.gov (http://ClinicalTrials.gov) NCT03059004”

FundingFind in source

paraphrase[Discussion]

“We note several limitations. Generalizability is limited by the small number of Black, Asian, and Hispanic participants.”

“Funding: Supported by NIH/NIAMS U01AR071658; R21AR076156; P30AR072577; K01AR075879 (Dr. Collins).”

FundingFind in source

PASSReviewer 2· 95% conf

Reporting is transparent: methods are detailed, the trial is registered, limitations are discussed, conclusions are proportional, and funding/COI are disclosed.

Evidence

“Clinical Trials.gov (http://ClinicalTrials.gov) NCT03059004”

FundingFind in source

“We note several limitations. Generalizability is limited by the small number of Black, Asian, and Hispanic participants”

DiscussionFind in source

“Funding: Supported by NIH/NIAMS U01AR071658; R21AR076156; P30AR072577; K01AR075879 (Dr. Collins).”

FundingFind in source

PASSReviewer 3· 90% conf

The manuscript is well-reported with detailed methods, trial registration, all outcomes reported, limitations discussed, and proportional conclusions. The only missing element is a reference to a reporting guideline (e.g., CONSORT).

Evidence

“Clinical Trials.gov (http://ClinicalTrials.gov) NCT03059004”

AbstractFind in source

paraphrase[Discussion, last paragraph]

“We note several limitations. Generalizability is limited by the small number of Black, Asian, and Hispanic participants.”

absence[Methods]

No reporting guideline is referenced.

Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.

ClinicalTrials.gov

NCT03059004

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 35 references by DOI: 0 verified — 35 no DOI (shown, not verified).

NO DOI
Incidental Meniscal Findings on Knee MRI in Middle Aged and Elderly Persons
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The clinical importance of meniscal tears demonstrated by magnetic resonance imaging in osteoarthritis of the knee
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Increase in outpatient knee arthroscopy in the United States: a comparison of National Surveys of Ambulatory Surgery, 1996 and 2006
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Arthroscopic partial meniscectomy for meniscal tears of the knee: a systematic review and meta-analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Arthroscopic or conservative treatment of degenerative medial meniscal tears: a prospective randomised trial
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Is arthroscopic surgery beneficial in treating non-traumatic, degenerative medial meniscal tears? A five year follow-up
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Surgery versus physical therapy for a meniscal tear and osteoarthritis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
A comparative study of meniscectomy and nonoperative treatment for degenerative horizontal tears of the medial meniscus
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Exercise therapy versus arthroscopic partial meniscectomy for degenerative meniscal tear in middle aged patients: randomised controlled trial with two year follow-up
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Effect of Early Surgery vs Physical Therapy on Knee Function Among Patients With Nonobstructive Meniscal Tears: The ESCAPE Randomized Clinical Trial
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Five-year outcome of operative and nonoperative management of meniscal tear in persons older than forty-five years
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Surgical Management of Degenerative Meniscus Lesions: The 2016 ESSKA Meniscus Consensus
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Position Statement From the Australian Knee Society on Arthroscopic Surgery of the Knee, Including Reference to the Presence of Osteoarthritis or Degenerative Joint Disease: Updated October 2016
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Position Statement of the Arthroscopy Association of Canada (AAC) Concerning Arthroscopy of the Knee Joint-September 2017
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Arthroscopic meniscal surgery: a national society treatment guideline and consensus statement
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Dutch Guideline on Knee Arthroscopy Part 1, the meniscus: a multidisciplinary review by the Dutch Orthopaedic Association
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
AAOS clinical practice guideline summary: management of osteoarthritis of the knee (nonarthroplasty)
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Degenerative meniscus tears-assimilation of evidence and consensus statements across three continents: state of the art
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The TeMPO trial (treatment of meniscal tears in osteoarthritis): rationale and design features for a four arm randomized controlled clinical trial
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
A consensus-based process identifying physical therapy and exercise treatments for patients with degenerative meniscal tears and knee OA: the TeMPO physical therapy interventions and home exercise program
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
The Theory of planned behavior
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
A comparison of the theory of planned behavior and the theory of reasoned action
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
How individuals, environments, and health behaviors interact
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Knee Injury and Osteoarthritis Outcome Score (KOOS)—Development of a Self-Administered Outcome Measure
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Reliability and validity of the EuroQol in patients with osteoarthritis of the knee
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Intrarater Reliability and Agreement of Recommended Performance-Based Tests and Common Muscle Function Tests in Knee Osteoarthritis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Reliability and measurement error of the Osteoarthritis Research Society International (OARSI) recommended performance-based tests of physical function in people with hip and knee osteoarthritis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Meaningful thresholds for patient-reported outcomes following interventions for anterior cruciate ligament tear or traumatic meniscus injury: a systematic review for the OPTIKNEE consensus
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Multiple imputation using chained equations: Issues and guidance for practice
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Inference and missing data
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Multiple imputation for nonresponse in surveys
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Longitudinal data analysis
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Exercise for osteoarthritis of the knee
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Pain in clinical trials for knee osteoarthritis: estimation of regression to the mean
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
NO DOI
Examination of overall treatment effect and the proportion attributable to contextual effect in osteoarthritis: meta-analysis of randomised controlled trials
No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).

1 data/code link checked; 1 live.

datahttps://clinicaltrials.gov/ct2/show/NCT03059004LIVEHTTP 200
Resolves, but the content could not be matched to the paper.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly consistency, clarity, grammar.

MINORconsistencyTable 2 header and text
“Home Exercises”
→ Home Exercise
In Table 2, the arm label appears as 'Home Exercises' in the row header but as 'Home Exercise' in the text and other tables. Standardize to 'Home Exercise'.
MINORconsistencyTable 2 header
“ΔKOOS Pain for A | ΔKOOS Pain for B”
→ Use consistent notation: 'ΔKOOS Pain (A)' and 'ΔKOOS Pain (B)' for clarity.
Minor formatting issue.
MINORclarityMethods, Study interventions
“Sham PT included elements not known to have physiologic benefit including 1) assessment of knee symptoms (5 minutes); 2) ultrasound of knee region with intensity set to 0 (12 minutes); 3) inert lotion applied gently along mid-thigh and distal tibia (5 minutes); and 3) sham manual therapy”
→ Change 'and 3)' to 'and 4)' for correct numbering.
Numbering error: two items are labeled '3)'.
MINORgrammarResults, Primary outcome
“The difference in three-month change in KOOS Pain between the Standard PT + Home Exercise + Text Messages and the Home Exercise arms was 2.5 points (98.3% confidence interval (CI) −1.3, 6.2), as was the difference between Standard PT + Home Exercise + Text Messages and Home Exercises + Text Messages (2.5 points, 98.3% CI −1.4, 6.5).”
→ Consider rephrasing for clarity: 'The difference in three-month change in KOOS Pain was 2.5 points (98.3% CI −1.3, 6.2) between the Standard PT + Home Exercise + Text Messages and Home Exercise arms, and 2.5 points (98.3% CI −1.4, 6.5) between Standard PT + Home Exercise + Text Messages and Home Exercise + Text Messages.'
The sentence is grammatically correct but could be clearer.
MINORconsistencyThroughout
“Use of 'subjects' and 'participants' interchangeably”
→ Standardize to 'participants' throughout.
The paper uses both terms; 'participants' is preferred for human research.
MINORclarityTable 1
“Hispanic or Latino row: 'No' and 'Yes' labels”
→ Clarify that percentages are within each arm.
Table 1 is clear but could be slightly more explicit about the denominator.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published trial is robust and well reported on the core rigor dimensions; an informed reader should weigh the missing data-availability statement, the unspecified analysis software, and the inexplicit IRB-approval/regulatory language — none of which undermine the reported findings but all of which warrant a correction/clarification or caution. The one machine-checkable statistic recomputed consistently, and no retracted or unverifiable references were found, so nothing here suggests the conclusions are invalid.

1.
HIGHdata code
Add a data availability statement (via erratum/corrigendum) describing how de-identified individual participant data can be accessed (e.g., controlled-access repository, or reasonable request to the corresponding author with a data-sharing agreement and timeframe).
A data-driven clinical trial with no data-sharing statement has the most consequential reporting gap; readers cannot verify or reuse the data.
2.
HIGHstatistics
Identify the statistical software and version used for all analyses (e.g., SAS 9.4, R 4.x, Stata) in the Statistical Analysis section.
Unnamed analysis software hinders reproducibility of the reported primary and secondary analyses.
3.
HIGHethics
Add an explicit regulatory-compliance statement (e.g., 'conducted in accordance with the Declaration of Helsinki') and state the IRB approval explicitly with a protocol number.
The current 'Sites ceded oversight to the Mass General Brigham IRB' language is not an explicit approval statement and lacks a protocol identifier, and no compliance statement is present.
4.
MEDIUMdata code
Deposit any custom analysis code in a public repository (e.g., Zenodo/GitHub) with a DOI and cite it in the paper.
Code sharing would make the reported analyses fully reproducible and complement the data availability statement.
5.
MEDIUMreporting
Reference the CONSORT 2010 checklist and include the completed checklist as supplementary material.
CONSORT is the standard reporting guideline for RCTs and is currently not referenced, a minor transparency gap.
6.
MEDIUMcopyedit
Fix the numbering error in the sham PT description by changing the second 'and 3)' to 'and 4)' (Methods, Study interventions).
Two items are currently both labeled '3)', a concrete error a reader will notice.
7.
MEDIUMcopyedit
Standardize the arm label to 'Home Exercise' throughout, including the Table 2 row header that currently reads 'Home Exercises'.
Inconsistent arm naming across tables and text is a consistency defect.
8.
LOWstatistics
Add a brief statement on how outliers were handled (even if none were excluded) in the Statistical Analysis section.
Reviewer 2 flagged that outlier handling is not explicitly reported; multiple imputation addresses missing data but not outliers.
9.
LOWreporting
Clarify the unit of randomization explicitly ('Participants were randomized individually') in the Recruitment and randomization section.
Though implied by the design, an explicit statement removes any ambiguity about the randomization unit.
10.
LOWcopyedit
Standardize terminology to 'participants' throughout (currently 'subjects' and 'participants' are used interchangeably).
Consistent terminology is preferred for human research reporting.
11.
LOWcopyedit
Clarify in Table 1 that percentages in the Hispanic/Latino row are within each arm (state the denominator).
Minor clarity improvement about the percentage denominator for that row.
12.
LOWcopyedit
Rephrase the long primary-outcome sentence in the Results for clarity (split into two sentences with the CI attached to each comparison).
The sentence is grammatically correct but difficult to parse as written.

Full text (28,796 chars)Analyzed: Aug 10, 2026

RigorReviewer 1

RigorReviewer 2

RigorReviewer 3

RigorPre-Submission Reviewer

CopyeditAgent Scribe

CitationsCitation Integrity

StatisticsStatistics Consistency

ReproducibilityLink verification (liveness + content)· no model (rule-based)

PreregistrationDeterministic check· no model (rule-based)

The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”

How stars are deducted

Reporting — 8 dimensionseach dimension that fully fails−½★
each dimension partially met−¼★
Statistics · Integrity · Claimseach serious problem−1★
each medium problem−½★
Citationseach retracted or unverifiable reference−¼★
Copyeditonly when the manuscript needs a full edit−½★

The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.

The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.

The eight reporting dimensions

Scientific PremisePrior work, rationale, and how it addresses gaps.

Study Design & RigorRandomization, blinding, power, controls, replication.

Biological VariablesSex, age, species/strain, housing, demographics.

Ethical ApprovalsIRB/IACUC approval, informed consent, regulatory compliance.

Key ResourcesAntibodies, cell lines, organisms, software — identified with persistent IDs.

Statistical ReportingNamed tests, exact p-values, effect sizes, plausible summary stats.

Data & Code AvailabilityAvailability statements, repositories, accession numbers, shared code.

Reporting TransparencyMethods, registration, guidelines, outcomes, limitations, funding/COI.

Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.

This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.

A Randomized Trial of Physical Therapy for Meniscal Tear and Knee Pain.

DOI

10.1056/NEJMoa2503385

Record issued

2026-08-10

Engine

7.29.0

Exported

2026-09-22