(177)Lu-PSMA-617 versus a change of androgen receptor pathway inhibitor therapy for taxane-naive patients with progressive metastatic castration-resistant prostate cancer (PSMAfore): a phase 3, randomised, controlled trial.
Morris MJ, Castellano D, Herrmann K, de Bono JS, Shore ND, Chi KN, Crosby M, Piulats JM, Fléchon A, Wei XX, Mahammedi H, Roubaud G, Študentová H, Nagarajah J, Mellado B, Montesa-Pino Á, Kpamegan E, Ghebremariam S, Kreisl TN, Wilke C, Lehnhoff K, Sartor O, Fizazi K, PSMAfore Investigators
- DOI
- 10.1016/S0140-6736(24)01653-2
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-21
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/e8617547-d674-4e9f-a2cc-0b290de2ba8e is authoritative.
How this rating was calculated
- IntegrityIntegrity concern ×2−1★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary endpoint is radiographic progression-free survival (rPFS), a surrogate for clinical benefit. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking rPFS to overall survival or other hard clinical outcomes in this setting. Overall survival, a hard endpoint, showed no difference (HR 0.98, 95% CI 0.75-1.28).
“The primary endpoint was rPFS, defined as time from randomisation to radiographic disease progression (by BICR as per PCWG3-modified RECIST v1·1), or death.”
- 02Treatment effect not shown to be clinically meaningful
The primary effect is a prolongation of rPFS (median 11.60 vs 5.59 months, HR 0.49). However, rPFS is a surrogate, and the magnitude is not anchored to a minimal clinically important difference or to a hard clinical outcome. Overall survival showed no benefit (HR 0.98). Thus, the clinical meaningfulness of the rPFS effect is not established.
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001); the median rPFS was 9·30 months (95% CI, 6·77–not estimable [NE]) vs 5·55 months (4·04–5·95)”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted phase 3 randomized controlled trial with rigorous design, clear reporting of ethics, demographics, and statistical methods. The main weaknesses are minor reporting gaps: statistical software not named, CONSORT guideline not explicitly mentioned, and a few copyedit issues including inconsistent p-value formatting and an internal contradiction in the number of randomized patients.
Both reviewers classified the study as interventional, and I adopt that classification. The evaluation covered the full text, with verification components checking citations, statistics, reproducibility, preregistration, and integrity. Bench-related criteria (cell lines, antibodies, etc.) were not applicable for this drug trial.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 2 tests: 2 consistent, 0 inconsistent; 2 via agent-written checks.
- CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Primary rPFS hazard ratio p-value from CI
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001)”
Taken as given: The hazard ratio is 0.41 with 95% CI 0.29-0.56.; The CI is two-sided at 95%.; The p-value is two-sided.Method: Compute two-sided p-value from the hazard ratio and its 95% CI using the normal approximation for the log hazard ratio.How we recomputed it: pCI(0.41, 0.29, 0.56, 1) - CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2Updated rPFS hazard ratio p-value from CI
“the updated hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·49 (95% CI, 0·39–0·61)”
Taken as given: The hazard ratio is 0.49 with 95% CI 0.39-0.61.; The CI is two-sided at 95%.; The p-value is two-sided.Method: Compute two-sided p-value from the hazard ratio and its 95% CI using the normal approximation for the log hazard ratio.How we recomputed it: pCI(0.49, 0.39, 0.61, 1) - UNCOMPUTABLEreported p = .440 · recomputed p = .882Reviewer 1Overall survival hazard ratio p-value from CI
“the hazard ratio for overall survival with 177 Lu-PSMA-617 vs ARPI change was 0·98 (95% CI, 0·75–1·28; p<0.44)”
Taken as given: The hazard ratio is 0.98 with 95% CI 0.75-1.28.; The CI is two-sided at 95%.; The p-value is two-sided.Method: Compute two-sided p-value from the hazard ratio and its 95% CI using the normal approximation for the log hazard ratio.How we recomputed it: pCI(0.98, 0.75, 1.28, 1)
- lowinternal contradictionThe abstract reports 468 patients randomised, but the CONSORT diagram mentions one additional patient randomised but excluded due to consent deviation, and one randomised after data cut-off. The total randomised may be 470, but the analysis uses 468.
“Overall, 468/585 patients (80%) met all the eligibility criteria and were randomised between June 15, 2021 and October 7, 2022 to receive either 177 Lu‑PSMA‑617 (n=234) or ARPI change (n=234).”
ResultsFind in source - lowinternal contradictionThe p-value for overall survival is reported as 'p<0.44' in the abstract and results, which is unusual; typically a non-significant p-value is reported as 'p=0.44'.
p<0.44
Abstractreviewer’s wording
Overstated conclusions
2 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
6 major claims checked against the paper's own evidence: all adequately supported.
- supportedReviewers 1, 2177Lu-PSMA-617 prolongs radiographic progression-free survival compared with ARPI change in taxane-naive mCRPC patients.The primary endpoint rPFS is met with HR 0.41 (95% CI 0.29-0.56, p<0.0001) and updated HR 0.49 (95% CI 0.39-0.61), supporting the claim.Evidence: Primary analysis and updated analysis of rPFS with hazard ratios and confidence intervals.
“In the primary analysis, the hazard ratio (HR) for radiographic progression or death for 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% confidence interval [CI], 0·29–0·56; p<0·0001; median rPFS, 9·30 months [95% CI, 6·77–not estimable] vs 5·55 [4·04–5·95]).”
AbstractFind in source - supportedReviewers 1, 2177Lu-PSMA-617 has a favourable safety profile compared with ARPI change.The incidence of grade 3-5 adverse events was lower with 177Lu-PSMA-617 (36%) vs ARPI change (48%), supporting the claim.Evidence: Safety data showing lower grade 3-5 TEAEs in the 177Lu-PSMA-617 group.
“The incidence of grade 3–5 adverse events was lower with 177 Lu-PSMA-617 vs ARPI change (81/227 [36%] vs 112/232 [48%]; grade 3–4, 80/227 [35%] vs 111/232 [48%]).”
AbstractFind in source - supportedReviewers 1, 2Overall survival was similar between groups at the third interim analysis.The HR for OS was 0.98 (95% CI 0.75-1.28, p=0.44), indicating no significant difference, supporting the claim.Evidence: Intention-to-treat analysis of overall survival.
In the intention-to-treat analysis, the hazard ratio for overall survival with 177 Lu-PSMA-617 vs ARPI change was 0·98 (95% CI, 0·75–1·28; p<0.44); the median overall survival was 23·66 months (95% CI, 19·75–NE) vs 23·85 months (20·60–26.55).
Resultsreviewer’s wording - supportedReviewer 1177Lu-PSMA-617 improves patient-reported outcomes including time to worsening in FACT-P and pain.The paper reports longer time to worsening in FACT-P total score (HR 0.61) and BPI-SF pain intensity, supporting the claim.Evidence: Patient-reported endpoints results.
“median time to worsening in Functional Assessment of Cancer Therapy-Prostate (FACT-P) total score was longer with 177 Lu-PSMA-617 vs ARPI change (7·46 months [95% CI, 6·08–8·54] vs 4·27 months [3·45–4·50]; HR, 0·61 [95% CI, 0·50–0·75])”
ResultsFind in source - supportedReviewer 2177Lu-PSMA-617 improves patient-reported outcomes including quality of life and pain.Time to worsening in FACT-P and BPI-SF were longer with 177Lu-PSMA-617.Evidence: Median time to worsening in FACT-P: 7.46 vs 4.27 months (HR 0.61); BPI-SF pain intensity also longer.
“median time to worsening in Functional Assessment of Cancer Therapy-Prostate (FACT-P) total score was longer with 177 Lu-PSMA-617 vs ARPI change (7·46 months [95% CI, 6·08–8·54] vs 4·27 months [3·45–4·50]; HR, 0·61 [95% CI, 0·50–0·75])”
ResultsFind in source - supportedReviewer 2177Lu-PSMA-617 is an effective alternative to ARPI change for delaying disease progression and maintaining quality of life.The primary and secondary endpoints support this conclusion, though OS is not improved.Evidence: rPFS, PSA response, time to symptomatic skeletal events, and quality of life all favored 177Lu-PSMA-617.
“These results support 177 Lu-PSMA-617 as a treatment option for patients with mCRPC who have initially progressed on an ARPI and who are being considered for a change of ARPI as their next therapy.”
DiscussionFind in source
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary endpoint is radiographic progression-free survival (rPFS), a surrogate for clinical benefit. The paper does not demonstrate target engagement at the tested dose (no PK/PD or dose-exposure data) and does not cite validated evidence linking rPFS to overall survival or other hard clinical outcomes in this setting. Overall survival, a hard endpoint, showed no difference (HR 0.98, 95% CI 0.75-1.28).
“The primary endpoint was rPFS, defined as time from randomisation to radiographic disease progression (by BICR as per PCWG3-modified RECIST v1·1), or death.”
- INADEQUATEEffect sizeThe primary effect is a prolongation of rPFS (median 11.60 vs 5.59 months, HR 0.49). However, rPFS is a surrogate, and the magnitude is not anchored to a minimal clinically important difference or to a hard clinical outcome. Overall survival showed no benefit (HR 0.98). Thus, the clinical meaningfulness of the rPFS effect is not established.
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001); the median rPFS was 9·30 months (95% CI, 6·77–not estimable [NE]) vs 5·55 months (4·04–5·95)”
Data authenticity concerns
None foundAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
Checked — nothing surfaced.
Reporting gaps
None foundRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
Checked — nothing surfaced.
The introduction cites VISION and TheraP trials, acknowledges their limitations (post-taxane setting), and provides a logical rationale for testing 177Lu-PSMA-617 in taxane-naive patients. The limitations of prior work are addressed by designing a trial in a different patient population.
“The VISION trial demonstrated the efficacy of 177 Lu-PSMA-617 in this post-taxane mCRPC setting, with significant prolongation of radiographic progression-free survival (rPFS) and overall survival following addition of 177 Lu-PSMA-617 to standard of care vs standard of care alone.”
“Therefore, there remains an unmet need for therapy options among patients who wish to defer taxane-based chemotherapy.”
“The VISION trial demonstrated the efficacy of 177 Lu-PSMA-617 in this post-taxane mCRPC setting, with significant prolongation of radiographic progression-free survival (rPFS) and overall survival following addition of 177 Lu-PSMA-617 to standard of care vs standard of care alone.”
“PSMAfore is a phase 3 trial that was designed to compare 177 Lu-PSMA-617 with a change of ARPI in taxane-naive patients with mCRPC who had progressed once on ARPI as last therapy, and were considered candidates for ARPI change.”
Randomization used interactive response technology with stratification factors. The trial is open-label with a stated rationale (different administration routes and radiation regulations). Power analysis is provided for the primary endpoint. Inclusion/exclusion criteria are detailed. The analysis population (ITT for efficacy, safety population for safety) is defined.
“Randomisation was performed using interactive response technology and was stratified according to previous ARPI use (castration-resistant vs hormone-sensitive prostate cancer), and by pain symptoms (asymptomatic or mildly symptomatic vs symptomatic; score of 0–3 vs >3 on item 3 of the screening Brief Pain Inventory - Short Form [BPI-SF]).”
“The primary analysis of rPFS was prespecified to occur after approximately 156 events in 450 patients, providing 95% power to detect a hazard ratio (HR) of 0·56 at an overall one-sided α of 0·025.”
“Finally, double-blinding was not possible in this trial because of the different administration routes of the trial interventions and because of radiation protection regulations and ethical considerations.”
“Randomisation was performed using interactive response technology and was stratified according to previous ARPI use (castration-resistant vs hormone-sensitive prostate cancer), and by pain symptoms (asymptomatic or mildly symptomatic vs symptomatic; score of 0–3 vs >3 on item 3 of the screening Brief Pain Inventory - Short Form [BPI-SF]).”
“Independent central reviewers were blinded to randomised treatment assignment.”
“The primary analysis of rPFS was prespecified to occur after approximately 156 events in 450 patients, providing 95% power to detect a hazard ratio (HR) of 0·56 at an overall one-sided α of 0·025.”
The study is in prostate cancer, so all participants are male; sex is reported implicitly. Age, race, ECOG status, disease sites, and laboratory values are reported in Table 1. Since both sexes are not applicable (prostate cancer), sex_justified is not applicable. Demographics are adequate.
“Age Median (IQR) – years | 71·0 (12·0) | 72·0 (10·0)”
“ECOG performance status – no. (%) 0 | 146 (62) | 116 (50)”
“Age Median (IQR) – years | 71·0 (12·0) | 72·0 (10·0)”
“OMB category – no. (%) White | 212 (91) | 214 (91)”
“ECOG performance status – no. (%) 0 | 146 (62) | 116 (50)”
The paper states that independent ethical review boards at all sites approved the protocol and all patients provided written informed consent. It also states compliance with Declaration of Helsinki and Good Clinical Practice. This satisfies all applicable criteria.
“All patients provided written informed consent.”
The trial uses a drug (177Lu-PSMA-617) and comparators (abiraterone, enzalutamide). The paper names the drugs, doses, and regimens. Since this is a drug trial, bench criteria are not applicable. Software tools are not described in detail, but the statistical software is not specified; however, this is not a key resource for a clinical trial.
“In the ARPI change group, the median duration of exposure was 6·52 months (IQR, 7·77); 100 patients received abiraterone and 132 patients received enzalutamide.”
“177 Lu-PSMA-617 7·4 GBq (200 mCi) ± 10% once every 6 weeks for six cycles”
“a change of ARPI to abiraterone or enzalutamide as per treating investigator selection”
The paper names the tests (log-rank, Cox proportional hazards, Kaplan-Meier) and provides exact p-values (e.g., p<0.0001) and confidence intervals. Effect sizes are reported as hazard ratios with CIs. Data presentation includes Kaplan-Meier curves and forest plots. Mathematical plausibility is not applicable for large-N continuous outcomes. Software is not explicitly identified, but this is a minor omission.
“Time-to-event endpoints were assessed using the log-rank test stratified by the randomisation factors. Hazard ratios and confidence intervals (CIs) were estimated using the stratified Cox proportional-hazards model.”
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001)”
“Time-to-event endpoints were assessed using the log-rank test stratified by the randomisation factors. Hazard ratios and confidence intervals (CIs) were estimated using the stratified Cox proportional-hazards model.”
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001)”
“the hazard ratio for radiographic progression or death with 177 Lu-PSMA-617 vs ARPI change was 0·41 (95% CI, 0·29–0·56; two-sided p<0·0001)”
The data availability statement names a specific platform (clinicalstudydatarequest.com) and describes the review process. This is a managed-access route, which is adequate for individual patient data. Repository deposit and accession numbers are not applicable for patient-level data. Code sharing is not applicable as no bespoke code is mentioned.
The trial is registered (NCT04689828). Methods are comprehensive. Limitations are explicitly discussed (open-label, crossover, generalizability). Conclusions are proportional to the evidence. Funding and conflicts of interest are disclosed. Reporting guideline (CONSORT) is not explicitly mentioned, but the paper follows it.
“This study has several limitations. Firstly, it did not examine a higher risk population for whom taxane-based chemotherapy was the most appropriate next therapy after progression on an ARPI, therefore, the results cannot be generalised to this population.”
“This trial was funded by Novartis.”
“This study has several limitations. Firstly, it did not examine a higher risk population for whom taxane-based chemotherapy was the most appropriate next therapy after progression on an ARPI, therefore, the results cannot be generalised to this population.”
“This trial was funded by Novartis.”
Registered (7 IDs: ClinicalTrials.gov, Clinical Trials Registry – India). No reporting guideline cited.
Broken references and links
None foundReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Checked — nothing surfaced.
Checked 55 references by DOI: 47 verified — 8 no DOI (shown, not verified).
- NO DOIReal-world treatment patterns in the U.S. and trends pre-post CARD trial among patients with metastatic castration-resistant prostate cancerNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIEAU-EANM-ESTRO-ESUR-ISUP-SIOG guidelines on prostate cancerNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA converts to full approval indication for KEYTRUDA® (pembrolizumab) for certain adult and pediatric patients with advanced microsatellite instability-high (MSI-H) or mismatch repair deficient (dMMR) solid tumorsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIFDA approves Pluvicto for metastatic castration-resistant prostate cancerNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOIProstate-specific membrane antigen expression in normal and malignant human tissuesNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOICorrecting for non-compliance in randomized trials using rank preserving structural failure time modelsNo DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOILBA13 - Phase III trial of [177Lu]Lu-PSMA-617 in taxane-naive patients with metastatic castration-resistant prostate cancer (PSMAfore)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
- NO DOICONTACT-2: phase 3 study of cabozantinib (C) plus atezolizumab (A) vs second novel hormonal therapy (NHT) in patients (pts) with metastatic castration-resistant prostate cancer (mCRPC)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
7 of 8 data/code links checked; 7 live; 1 not probed.
- datahttp://www.clinicalstudydatarequest.com/UNVERIFIEDLiveness indeterminate — content not checked.
- datahttp://clinicaltrials.govLIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT04689828LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT04663997LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT04343885LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT03392428LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT04419402LIVEHTTP 200Resolves, but the content could not be matched to the paper.
- datahttps://clinicaltrials.gov/ct2/show/NCT03511664LIVEHTTP 200Resolves, but the content could not be matched to the paper.
Copyediting
6 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 6 minor suggestions below.
6 copyedit issues flagged: mostly typo, consistency, clarity.
- MINORtypoAbstract, Findings“p<0.44”→ p=0.44Inconsistent use of '<' for a non-significant p-value.
- MINORconsistencyResults, Key secondary endpoint“p<0.44”→ p=0.44Same issue as abstract.
- MINORclarityTable 1 footnote“Percentages may not total 100 because of rounding.”→ Consider adding a note that some percentages are based on non-missing data.Clarification of denominator.
- MINORconsistencyAbstract, Findings“p<0.44”→ Use consistent formatting for p-values (e.g., p=0.44).Inconsistent use of '<' and '=' for p-values.
- MINORtypoTable 1, footnote“OMB category”→ Define OMB (Office of Management and Budget) in the table footnote.Abbreviation not defined in table.
- MINORclarityMethods, Statistical analyses“P values were converted to two-sided for the primary endpoint.”→ Clarify how conversion was performed (e.g., multiply by 2).Could be clearer.
The published work is robust and well-reported. An informed reader should weigh the minor reporting gaps (software not named, CONSORT not mentioned) and the internal contradiction in the number of randomized patients (468 vs 470) as low-severity issues that do not undermine the main conclusions. No erratum is warranted for these minor issues, but the authors may consider clarifying the randomization count and p-value formatting in a correction.
- 1.HIGHreportingClarify the total number of randomized patients: the abstract reports 468, but the CONSORT diagram mentions additional patients randomized but excluded. Specify the exact number randomized and the reasons for exclusion in the CONSORT flow.The internal contradiction between 468 and 470 randomized patients could confuse readers and reviewers; a clear CONSORT flow resolves this.
- 2.HIGHcopyeditCorrect the p-value formatting for the non-significant overall survival result: change 'p<0.44' to 'p=0.44' in the Abstract and Results.Using '<' for a non-significant p-value is inconsistent and could be misread as a threshold; standard reporting uses '=' for exact p-values.
- 3.MEDIUMreportingExplicitly name the statistical software (e.g., SAS version) used for analyses in the Methods, Statistical analyses section.Both reviewers flagged the absence of software identification as a minor reporting gap; naming the software improves reproducibility.
- 4.MEDIUMreportingMention adherence to CONSORT reporting guidelines in the Methods or a separate section.Explicitly stating CONSORT adherence strengthens reporting transparency and is expected for a randomized trial.
- 5.MEDIUMdata codeProvide a link to the full protocol and statistical analysis plan in the Data Sharing statement.Both reviewers suggested this to enhance transparency and allow readers to verify prespecified analyses.
- 6.MEDIUMstatisticsClarify how p-values were converted to two-sided for the primary endpoint in the Methods, Statistical analyses section.The copyedit flagged this as unclear; specifying the conversion method (e.g., multiply by 2) improves methodological clarity.
- 7.MEDIUMreportingDefine the abbreviation 'OMB' (Office of Management and Budget) in the Table 1 footnote.The copyedit noted the abbreviation is not defined; defining it improves readability.
- 8.LOWcopyeditAdd a note to Table 1 that some percentages are based on non-missing data, as suggested in the copyedit.Clarifying the denominator for percentages improves transparency of baseline characteristics.
- 9.LOWreportingConsider reporting the number of patients with HRR mutations if available, to address the limitation regarding generalizability.Reviewer 2 suggested this to strengthen the discussion of generalizability.
- 10.LOWstatisticsClarify the handling of missing data for patient-reported outcomes in the statistical methods.Reviewer 2 raised this as a potential gap; specifying the imputation or analysis method improves reproducibility.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.