Provision of knee bracing for knee osteoarthritis (PROP OA): multicentre, parallel group, superiority, statistician blinded, randomised controlled trial.
Holden MA, Nicholls E, Abdali Z, Birrell F, Borrelli B, Callaghan M, Dziedzic K, Felson D, Foster NE, Halliday N, Ingram C, Jinks C, Jowett S, Peat G, PROP OA trial team
- DOI
- 10.1136/bmj-2025-086005
- Record issued
- 2026-08-10
- Engine
- 7.29.0
- Exported
- 2026-09-21
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/bf9ad03a-03d5-4f97-b432-db4d264fcb5b is authoritative.
How this rating was calculated
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- ReportingEthical approvals partially met−0.25★
- 01Treatment effect not shown to be clinically meaningful
The primary effect on KOOS-5 at 6 months was an adjusted mean difference of 3.39 points (effect size 0.24), which the manuscript explicitly states did not reach the predefined minimal clinically important difference of 8 points. The effect is thus below the established MCID and not anchored to clinical meaningfulness.
“The treatment effect for the primary outcome did not reach the predefined minimum clinically important difference of eight points on KOOS-5, used to inform our sample size calculation.”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
PROP OA is a methodologically strong, transparently reported multicentre superiority RCT of adding knee bracing plus an adherence intervention to advice, information and exercise instruction for knee osteoarthritis. Computerised stratified randomisation, statistician blinding, pre-specified power and missing-data estimand, open data/code, registration and proportional conclusions are all in place. The only substantive gap is the absence of an explicit named regulatory-framework statement (ethics warn), alongside a missing CONSORT checklist reference and minor copyedit artifacts.
Full-text audit synthesizing three independent reviewer runs; the reviewers converged on six of eight dimensions at pass and diverged narrowly on ethical approvals (1 pass vs 2 warn) and data code availability (2 pass vs 1 warn), resolved here as warn and pass respectively. Statistics verification recomputed 2/2 reported test/CI values consistently (coverage limited to tests with a test statistic + df or an effect + CI; threshold-only p-values and resampling-based values were not machine-verifiable), the citation check found 0/34 retracted or unresolvable references, and the reproducibility check confirmed 2/2 links live. No integrity-lens concern was raised.
Numerical inconsistencies
None foundValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
Checked — nothing surfaced.
Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.
- CONSISTENTreported p = .006 · recomputed p = .006Reviewer 2Recompute the two-sided p-value implied by the primary outcome KOOS-5 adjusted mean difference at 6 months from its reported 95% CI.
“At six months, greater improvement in KOOS-5 was seen in the AIE+B group than in the AIE group (adjusted mean difference 3.39, 95% confidence interval (CI) 0.96 to 5.82; effect size 0.24).”
Taken as given: The 95% CI is two-sided and symmetric on the linear scale (log=0) for the adjusted mean difference; The CI width corresponds to ±1.96 standard errors of the estimate from the linear mixed model; The paper reports no p-value, so this recomputes the implied p from estimate and CIMethod: SE = (high-low)/(2*1.96) = 1.2398; z = estimate/SE = 2.734; two-tailed p = 2*(1-normalCdf(z)), computed via pCI(3.39, 0.96, 5.82, 0).How we recomputed it: pCI(3.39, 0.96, 5.82, 0) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewer 2Recompute the two-sided p-value implied by the KOOS pain subscale adjusted mean difference at 6 months from its reported 95% CI.
“The greatest improvements were seen in the pain and activities of daily living subscales (adjusted mean difference on a 0-100 scale at six months for pain (6.13, 95% CI 3.36 to 8.91; effect size 0.39)”
Taken as given: The 95% CI is two-sided and symmetric on the linear scale (log=0); The value 6.13 is the adjusted mean difference and 3.36/8.91 are the 95% CI bounds; The paper reports no p-value, so this recomputes the implied p from estimate and CIMethod: SE = (8.91-3.36)/(2*1.96) = 1.4158; z = 6.13/1.4158 = 4.33; two-tailed p = 2*(1-normalCdf(z)), computed via pCI(6.13, 3.36, 8.91, 0).How we recomputed it: pCI(6.13, 3.36, 8.91, 0)
Overstated conclusions
2 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Treatment effect not shown to be clinically meaningfulAssessed
- Conclusions only partially backed by the presented evidenceAssessed
12 major claims checked against the paper's own evidence: all adequately supported.
- partialReviewer 3The evidence generated by the PROP OA trial can be used to update and reduce conflicting recommendations about knee bracing for knee osteoarthritis in international clinical guidelines.The trial provides high-quality evidence, but the claim that it can 'reduce conflicting recommendations' assumes that the evidence will be incorporated into guidelines, which is beyond the scope of the paper. The evidence is strong, but the claim is slightly forward-looking.Evidence: The paper discusses implications for guidelines in the conclusion.
“The evidence generated by the PROP OA trial can be used to update and reduce conflicting recommendations about knee bracing for knee osteoarthritis in international clinical guidelines and support treatment decision making for patients, healthcare providers, policy makers, and commissioners.”
DiscussionFind in source - supportedReviewers 1, 2Adding compartment specific knee bracing and an adherence intervention to AIE results in small improvements in patient reported outcomes.The pre-specified primary endpoint showed a statistically significant small positive difference consistent with the 'small improvements' wording.Evidence: Primary outcome at 6 months: adjusted mean difference 3.39 (95% CI 0.96 to 5.82), effect size 0.24.
“Adding compartment specific knee bracing and an adherence intervention to advice, written information, and exercise instruction resulted in small improvements in patient reported outcomes among individuals with knee osteoarthritis.”
ConclusionFind in source - supportedReviewer 1Secondary outcome benefits of bracing diminished over time.The point estimates decline over time and the 12-month confidence interval includes zero, matching the claim of diminishing benefit.Evidence: KOOS-5 adjusted mean differences: 3.67 at 3 months, 3.39 at 6 months, and 2.67 at 12 months (95% CI −0.24 to 5.57) in Table 4.
“Secondary outcomes showed the benefits of AIE+B over AIE that diminished over time.”
AbstractFind in source - supportedReviewer 1Largest effects were observed for pain reduction.The numeric effect for pain is the largest among the reported subscales.Evidence: Table 4 reports KOOS pain adjusted mean difference 6.13 (3.36 to 8.91) with effect size 0.39 at 6 months, larger than the other KOOS subscales.
“The largest effects observed were for pain reduction (KOOS pain (0-100) adjusted mean difference at six months 6.13, 95% CI 3.36 to 8.91; effect size 0.39).”
AbstractFind in source - supportedReviewer 1Adverse events were minor and expected.The tabulated events are local, mild, and predominantly expected for bracing.Evidence: No suspected unexpected serious adverse reactions; most AEs were skin irritation, blistering, swelling, or soreness (Table 5).
“Adverse events were minor and expected.”
AbstractFind in source - supportedReviewer 1The intervention is safe and offers a potential treatment option.Evidence supports a cautious conclusion of safety within trial follow-up and potential treatment value, though 'safe' is limited to the 12-month window.Evidence: No serious unexpected adverse reactions; small but significant primary benefit; acceptability ratings favoured AIE+B.
“This safe intervention offers a potential treatment option for this common condition.”
DiscussionFind in source - supportedReviewer 1Radiography may not always be necessary to determine the brace type.The κ value supports the cautious 'suggests' wording.Evidence: Agreement between clinical judgment alone and combined with radiography was 86% (κ=0.79, 95% CI 0.74 to 0.84).
“Despite lower physiotherapist confidence, the good level of agreement between their clinical judgment of the predominant compartmental distribution of knee osteoarthritis only and when combined with radiographic presentation, suggests that radiography may not always be necessary to determine the appropriate type of brace.”
DiscussionFind in source - supportedReviewer 2At six months, greater improvement in KOOS-5 was seen in the AIE+B group than in the AIE group.The CI excludes zero, supporting a statistically significant between-group difference at the primary time point.Evidence: Adjusted mean difference 3.39 (95% CI 0.96 to 5.82), which excludes the null.
“At six months, greater improvement in KOOS-5 was seen in the AIE+B group than in the AIE group (adjusted mean difference 3.39, 95% confidence interval (CI) 0.96 to 5.82; effect size 0.24).”
AbstractFind in source - supportedReviewer 2The largest effects observed were for pain reduction (KOOS pain adjusted mean difference at six months 6.13, 95% CI 3.36 to 8.91; effect size 0.39).The reported secondary outcome directly supports the claim that pain showed the largest effect.Evidence: Reported KOOS pain adjusted mean difference 6.13 (95% CI 3.36 to 8.91), the largest among secondary outcomes.
“The largest effects observed were for pain reduction (KOOS pain (0-100) adjusted mean difference at six months 6.13, 95% CI 3.36 to 8.91; effect size 0.39).”
AbstractFind in source - supportedReviewers 2, 3This safe intervention offers a potential treatment option for this common condition.The adverse-event data support the safety assertion and the 'potential treatment option' framing is appropriately modest.Evidence: Adverse events were minor and expected; no suspected unexpected serious adverse reactions; AE table shows mostly minor events (e.g., skin irritation up to 20%).
“This safe intervention offers a potential treatment option for this common condition.”
ConclusionFind in source - supportedReviewers 2, 3PROP OA provides more certainty that adding compartment specific bracing and an adherence intervention to AIE leads to, on average, small additional benefits on patient reported outcomes for people with knee osteoarthritis.The breadth of consistent outcome and sensitivity analyses supports increased certainty about small benefits.Evidence: Primary and key secondary outcomes at three, six, and 12 months with CIs and effect sizes, plus sensitivity analyses.
“PROP OA provides more certainty that adding compartment specific bracing and an adherence intervention to AIE leads to, on average, small additional benefits on patient reported outcomes for people with knee osteoarthritis.”
DiscussionFind in source - supportedReviewers 2, 3Adding compartment specific knee bracing and an adherence intervention to advice, written information, and exercise instruction resulted in small improvements in patient reported outcomes among individuals with knee osteoarthritis.The primary outcome (KOOS-5 at 6 months) shows a statistically significant adjusted mean difference of 3.39 (95% CI 0.96 to 5.82), supporting the claim of small improvements.Evidence: Primary outcome result: adjusted mean difference 3.39, 95% CI 0.96 to 5.82, effect size 0.24.
“At six months, greater improvement in KOOS-5 was seen in the AIE+B group than in the AIE group (adjusted mean difference 3.39, 95% confidence interval (CI) 0.96 to 5.82; effect size 0.24).”
AbstractFind in source
Premise concern: effect size not shown to be clinically meaningful.
- ADEQUATESurrogate endpointThe primary outcome is KOOS-5, a validated composite patient-reported outcome measuring pain, symptoms, function, and quality of life. This is a clinical outcome scale, not a surrogate biomarker. The trial directly measures patient-reported disease impact.
“The primary outcome was a composite patient reported Knee Osteoarthritis Outcomes Score (KOOS)-5 (0-100) at six months after randomisation.”
- INADEQUATEEffect sizeThe primary effect on KOOS-5 at 6 months was an adjusted mean difference of 3.39 points (effect size 0.24), which the manuscript explicitly states did not reach the predefined minimal clinically important difference of 8 points. The effect is thus below the established MCID and not anchored to clinical meaningfulness.
“The treatment effect for the primary outcome did not reach the predefined minimum clinically important difference of eight points on KOOS-5, used to inform our sample size calculation.”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
1 finding · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Ethics/consent reporting incompleteAssessed
Prior research is cited, including conflicting international guidelines, sparse high-quality RCTs, and inconclusive systematic reviews. The rationale for a large, independent trial with outcomes beyond 6 months follows logically, and the design directly targets previous limitations: compartment-specific bracing, adherence promotion and measurement, large sample, and longer follow-up.
“Internationally, clinical guidelines offer conflicting recommendations on the use of knee bracing for knee osteoarthritis, and evidence from high quality randomised controlled trials is sparse.”
“Previous systematic reviews have been inconclusive because of limitations in existing trials, such as risk of bias, small sample sizes, short follow-up, and lack of targeting of adherence”
“PROP OA addressed these challenges by tailoring the type of brace to participant presentation and incorporating strategies to promote and measure adherence to the use of the brace.”
“Internationally, clinical guidelines offer conflicting recommendations on the use of knee bracing for knee osteoarthritis, and evidence from high quality randomised controlled trials is sparse.”
“PROP OA addressed these challenges by tailoring the type of brace to participant presentation and incorporating strategies to promote and measure adherence to the use of the brace.”
“Internationally, clinical guidelines offer conflicting recommendations on the use of knee bracing for knee osteoarthritis, and evidence from high quality randomised controlled trials is sparse.”
“Before PROP OA, randomised controlled trials of knee bracing for knee osteoarthritis were hampered by targeting only one knee compartment for all participants, small sample sizes, risk of bias, lack of follow-up beyond three months, and heterogeneity.”
Randomisation used a centralised web-based service with stratified random permuted blocks (sizes 2, 4, 6); participants are the unit of randomisation. The statistician was masked, with explicit rationale for inability to mask participants or physiotherapists. The sample size calculation used an effect size of 0.35, 90% power, 5% significance, and allowed for 20% loss to follow-up. Missing data were handled through a treatment-policy estimand, multiple imputation, and sensitivity analyses, which meets the human-RCT mapping of the outlier/analysis-population criterion.
“We used a computerised web based randomisation service and random number generator, stratified by clinic site, predominant compartmental distribution of knee osteoarthritis (based on a combination of clinical assessment and radiographic presentation), and the presence of instability (buckling), with a 1:1 allocation with random permuted blocks of sizes 2, 4, and 6.”
“Although masking participants or physiotherapists to treatment allocation was not possible, the trial statistician was masked to treatment allocation.”
“The trial was powered to detect an effect size between groups of 0.35 (small-to-medium effect) in KOOS-5 at six months with two sided 5% significance and 90% power.”
“We used a computerised web based randomisation service and random number generator, stratified by clinic site, predominant compartmental distribution of knee osteoarthritis (based on a combination of clinical assessment and radiographic presentation), and the presence of instability (buckling), with a 1:1 allocation with random permuted blocks of sizes 2, 4, and 6.”
“Although masking participants or physiotherapists to treatment allocation was not possible, the trial statistician was masked to treatment allocation.”
“The trial was powered to detect an effect size between groups of 0.35 (small-to-medium effect) in KOOS-5 at six months with two sided 5% significance and 90% power.”
“We used a computerised web based randomisation service and random number generator, stratified by clinic site, predominant compartmental distribution of knee osteoarthritis (based on a combination of clinical assessment and radiographic presentation), and the presence of instability (buckling), with a 1:1 allocation with random permuted blocks of sizes 2, 4, and 6.”
“Although masking participants or physiotherapists to treatment allocation was not possible, the trial statistician was masked to treatment allocation.”
“The trial was powered to detect an effect size between groups of 0.35 (small-to-medium effect) in KOOS-5 at six months with two sided 5% significance and 90% power.”
Sex is reported (46% female overall) and both sexes were enrolled, so a single-sex justification is not applicable. Age, BMI, comorbidity counts, and anxiety/depression scores are provided. Demographics include ethnicity, education, employment, and Index of Multiple Deprivation. Species/strain and housing criteria are not applicable to this human trial.
“Mean (SD) age (years) | 64 (9) | 64 (9) | 64 (9)”
“Female participants | 213 (46) | 113 (49) | 100 (42)”
“466 participants (mean age 64 (standard deviation 9) years; 46% female participants) were randomised”
“Mean (SD) age (years) | 64 (9) | 64 (9) | 64 (9)”
“Female participants | 213 (46) | 113 (49) | 100 (42)”
The study was approved by a named ethics committee (North West Preston Research Ethics Committee) with a reference number, and written informed consent was obtained. However, the paper does not mention compliance with the Declaration of Helsinki, ICH-GCP, or any other named framework. While the ethics approval implies regulatory compliance, the sub-criterion requires explicit naming of the framework. This is a minor reporting gap.
“The study was approved by North West Preston Research Ethics Committee, the Health Research Authority, and Health and Care Research in Wales (research ethics committee reference 19/NW/0183; Integrated Research Application System reference 247370).”
“The physiotherapist obtained written informed consent from participants before collection of self-reported baseline data (including sex, defined as female, male, or other), randomisation, and delivery of the interventions.”
“The study was approved by North West Preston Research Ethics Committee, the Health Research Authority, and Health and Care Research in Wales (research ethics committee reference 19/NW/0183; Integrated Research Application System reference 247370).”
“The physiotherapist obtained written informed consent from participants before collection of self-reported baseline data”
“The study was approved by North West Preston Research Ethics Committee, the Health Research Authority, and Health and Care Research in Wales (research ethics committee reference 19/NW/0183; Integrated Research Application System reference 247370).”
“The physiotherapist obtained written informed consent from participants before collection of self-reported baseline data (including sex, defined as female, male, or other), randomisation, and delivery of the interventions.”
The knee braces are named (Bioskin Q Brace, Össur Unloader One, Donjoy Nano, Össur Formfit Knee Hinged) with manufacturers. The analysis software is Stata 18.0. These are reported and adequate. Antibodies, cell lines, and other wet-lab resources are not applicable. The trial does not involve a drug or biologic, so reagents_identified is scored against the device, which is adequate.
“Participants were then given a patellofemoral (Bioskin Q Brace), tibiofemoral unloading (first choice brace was Össur Unloader One and second choice brace was Donjoy Nano), or a neutral stabilising knee brace (Össur Formfit Knee Hinged).”
“Data were analysed with Stata version 18.0.”
“Participants were then given a patellofemoral (Bioskin Q Brace), tibiofemoral unloading (first choice brace was Össur Unloader One and second choice brace was Donjoy Nano), or a neutral stabilising knee brace (Össur Formfit Knee Hinged).”
“Data were analysed with Stata version 18.0.”
“Participants were then given a patellofemoral (Bioskin Q Brace), tibiofemoral unloading (first choice brace was Össur Unloader One and second choice brace was Donjoy Nano), or a neutral stabilising knee brace (Össur Formfit Knee Hinged).”
“Data were analysed with Stata version 18.0.”
Tests are named (linear and logistic mixed models, κ statistics, intraclass correlation). Model assumptions were examined, with unstructured covariance and robust standard errors used where residuals indicated correlation. No numeric p-values are reported; instead effect estimates with CIs are provided, so exact_p_values is n/a and effect_sizes_ci is adequate. Data presentation is appropriate for a large trial (means/SD, CIs, flow diagram), and no arithmetic impossibilities were identified.
“Longitudinal mixed models were used to estimate treatment effects for primary and secondary outcomes at the three, six, and, 12 month follow-up periods, with results presented as adjusted mean differences and effect sizes, or adjusted odds ratios (AIE+B v AIE) for continuous and categorical outcomes, respectively, with 95% confidence intervals (CIs).”
“All model assumptions were largely satisfied in the data, despite the raw scores for some outcomes not following a normal distribution. Some evidence exists indicating a correlation between the model residuals and the random intercept, and hence models were fitted with an unstructured covariance matrix and robust standard errors.”
“Data were analysed with Stata version 18.0.”
“Longitudinal mixed models were used to estimate treatment effects for primary and secondary outcomes at the three, six, and, 12 month follow-up periods”
“All model assumptions were largely satisfied in the data, despite the raw scores for some outcomes not following a normal distribution.”
“At six months, greater improvement in KOOS-5 was seen in the AIE+B group than in the AIE group (adjusted mean difference 3.39, 95% confidence interval (CI) 0.96 to 5.82; effect size 0.24).”
“Longitudinal mixed models were used to estimate treatment effects for primary and secondary outcomes at the three, six, and, 12 month follow-up periods, with results presented as adjusted mean differences and effect sizes, or adjusted odds ratios (AIE+B v AIE) for continuous and categorical outcomes, respectively, with 95% confidence intervals (CIs).”
“All model assumptions were largely satisfied in the data, despite the raw scores for some outcomes not following a normal distribution.”
“At six months, we found greater improvement in KOOS-5 in the AIE+B group than in the AIE group (adjusted mean difference 3.39, 95% CI 0.96 to 5.82; effect size 0.24).”
The data availability statement provides a direct link to a public repository (DOI: 10.21252/9tpn-8970). The code is available in the supplementary files. These are reported and adequate. Repository deposit is applicable and satisfied. Accession numbers are not applicable (clinical trial data).
“The data underlying the findings in this paper are openly and publicly available and can be found here: https://doi.org/10.21252/9tpn-8970 .”
“The code used to analyse the data in the paper can be found in the supplementary files.”
“The data underlying the findings in this paper are openly and publicly available and can be found here: https://doi.org/10.21252/9tpn-8970 .”
“The code used to analyse the data in the paper can be found in the supplementary files.”
“The data underlying the findings in this paper are openly and publicly available and can be found here: https://doi.org/10.21252/9tpn-8970 .”
“The code used to analyse the data in the paper can be found in the supplementary files.”
Methods are sufficiently detailed, including intervention content, training, and fidelity. Trial registration ISRCTN28555470 is stated. All outcomes, including non-significant ones, are reported, and the erroneously omitted PROMIS outcome is explicitly acknowledged. Limitations are discussed extensively, conclusions use cautious language, and funding/COI statements are thorough. The paper does not explicitly reference a CONSORT checklist, although a CONSORT-style flow diagram is provided, so reporting_guideline is not_reported.
“Trial registration ISRCTN28555470.”
“social participation (from Patient Reported Outcomes Measurement Information System, PROMIS) was an intended secondary outcome, but was erroneously not included in any follow-up questionnaires, and therefore cannot be reported as a secondary outcome.”
“The PROP OA trial had some limitations.”
“Trial registration ISRCTN28555470.”
“social participation (from Patient Reported Outcomes Measurement Information System, PROMIS) was an intended secondary outcome, but was erroneously not included in any follow-up questionnaires, and therefore cannot be reported as a secondary outcome.”
“Trial registration ISRCTN28555470.”
“Also, social participation (from Patient Reported Outcomes Measurement Information System, PROMIS) was an intended secondary outcome, but was erroneously not included in any follow-up questionnaires, and therefore cannot be reported as a secondary outcome.”
Registered (1 ID: ISRCTN). No reporting guideline cited.
Broken references and links
None foundReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Checked — nothing surfaced.
Checked 34 references by DOI: 30 verified — 4 no DOI (shown, not verified).
- NO DOIOsteoarthritis in over-16s: diagnosis and managementNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIValidation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or kneeNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIOutcome variables for osteoarthritis clinical trials: The OMERACT-OARSI set of responder criteriaNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIStata Statistical Software: Release 18No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
2 data/code links checked; 2 live.
- datahttps://doi.org/10.21252/9tpn-8970LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://public.flourish.studio/visualisation/26004727/LIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
4 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 4 minor suggestions below.
4 copyedit issues flagged: mostly punctuation, other, consistency.
- MINORotherArticle header before Abstract“392 e086005 e086005”→ Remove the duplicated page/article identifier artifact from the display header.Likely a journal typesetting artifact, but it appears as duplicated text in the visible header.
- MINORpunctuationTable 5 footnote“and the past six months” for the 12 month follow-up questionnaire”→ Use matching quotation marks (e.g., 'past six months').The opening and closing quotation marks are mismatched.
- MINORpunctuationTable 5 footnote“the past six months” for the 12 month follow-up questionnaire”→ Use consistent straight or curly quotation marks: 'the past six months'A stray curly closing quote appears after 'months' where a straight quote would match the opening.
- MINORconsistencyData Availability Statement“https://doi.org/10.21252/9tpn-8970 (10.1093/rheumatology/kew201) .”→ Remove the stray parenthetical DOI '10.1093/rheumatology/kew201' or verify it belongs to the cited reference.A second, unrelated DOI appears appended to the data DOI, likely a reference-citation artifact.
In this post-publication audit, the published trial is methodologically robust and its headline conclusions are supported by the reported estimates; no validity-threatening or integrity concern was identified, so no scientific erratum is warranted. An informed reader should weigh the ethically implied-but-not-named regulatory-framework adherence, the supplementary-only code sharing, and the un-flagged PROMIS protocol deviation, and the minor copyedit artifacts (duplicated header, stray DOI in the data statement) could be cleaned via a correction.
- 1.HIGHethicsAdd an explicit statement of compliance with a named regulatory framework (e.g., 'in accordance with the Declaration of Helsinki' or ICH-GCP) to the Ethical approval section.The named ethics approvals and informed consent are present, but the absence of an explicit framework statement is the only gap that downgraded the ethics dimension to warn.
- 2.MEDIUMreportingReference the CONSORT 2010 checklist (or state it was completed) in the Methods or a reporting statement.A CONSORT-style flow diagram is provided but the reporting guideline is never named, a transparency gap all three reviewers noted.
- 3.MEDIUMdata codeDeposit the Stata analysis code in a version-controlled public repository (e.g., Zenodo or GitHub) with a persistent DOI, or clarify in the Data availability statement that the supplementary files are the version of record.Supplementary-only code sharing is adequate but less reproducible than a version-controlled deposit with a permanent identifier, a concern raised by Reviewer 2.
- 4.MEDIUMreportingFlag the erroneously omitted PROMIS social-participation outcome as an explicit protocol deviation in the Results and discuss its impact on outcome-set completeness.The omission is acknowledged but not framed as a protocol deviation, which a reader must weigh when assessing outcome completeness.
- 5.MEDIUMrigorReconcile the differing denominators in one place: the 6-month analysable data (n=394), the AE denominator (n=185), and the minimum-data-collection questionnaires (n=12 of 197).Readers may be confused by differing denominators across tables; a single reconciliation preempts misinterpretation of the reported numbers.
- 6.MEDIUMcopyeditRemove the duplicated page/article identifier artifact '392 e086005 e086005' from the article header before the Abstract.It appears as duplicated visible text and should be cleaned in a correction.
- 7.MEDIUMcopyeditRemove the stray parenthetical DOI '10.1093/rheumatology/kew201' from the Data Availability Statement, or verify it belongs to a cited reference.A second unrelated DOI appended to the data DOI is a typesetting artifact that could misdirect readers.
- 8.LOWcopyeditFix the mismatched quotation marks in the Table 5 footnote ('the past six months' should use matching quotation marks).Mismatched quotation marks are a minor punctuation inconsistency.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.