Alpha¹ by KaimenConfidential

Kaimen Rigor review

Isatuximab, lenalidomide, dexamethasone and bortezomib in transplant-ineligible multiple myeloma: the randomized phase 3 BENEFIT trial.

Leleu X, Hulin C, Lambert J, Bobin A, Perrot A, Karlin L, Roussel M, Montes L, Cherel B, Chalopin T, Slama B, Chretien ML, Laribi K, Dingremont C, Roul C, Mariette C, Rigaudeau S, Calmettes C, Dib M, Tiab M, Vincent L, Delaunay J, Santagostino A, Macro M, Bourgeois E, Orsini-Piocelle F, Gay J, Bareau B, Bigot N, Vergez F, Lebreton P, Tabrizi R, Waultier-Rascalou A, Frenzel L, Le Calloch R, Chalayer E, Braun T, Lachenal F, Corm S, Kennel C, Belkhir R, Bladé JS, Joly B, Richez-Olivier V, Gardeney H, Demarquette H, Robu-Cretu D, Garderet L, Newinger-Porte M, Kasmi A, Royer B, Decaux O, Arnulf B, Belhadj K, Touzeau C, Mohty M, Manier S, Moreau P, Avet-Loiseau H, Corre J, Facon T

DOI: 10.1038/s41591-024-03050-2
Record issued: 2026-08-16
Engine: 7.39.0
Exported: 2026-09-22

Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/dc6ab77b-b273-4e8b-bf43-8ca3dc7fb739 is authoritative.

Kaimen Rigor review

Kaimen Rigor reviewed

2.25 / 5

Weak — serious problems found

Interventional Study

Critical

High-priority

How this rating was calculated

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
StatisticsPrinted percentage does not match its own count (capped) ×4−0.25★
ReportingData & code availability partially met−0.25★
CitationsRetracted reference cited−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is minimal residual disease (MRD) negativity at 10^-5, a surrogate biomarker. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD data) and does not cite validated evidence linking MRD negativity to clinical outcomes in this context, although it mentions MRD as a surrogate marker.
“The primary endpoint was a minimal residual disease (MRD) negativity rate at 10 −5 by next-generation sequencing at 18 months from randomization.”
Find in source
02Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect is an increase in MRD negativity rate from 26% to 53% (OR 3.16). While statistically significant, the clinical meaningfulness is not anchored to a validated minimal clinically important difference or hard clinical outcome; survival data are immature.
“The 18-month MRD negativity rates at 10 −5 were reported in 35 patients (26%, 95% confidence interval (CI) 19–34) in IsaRd versus 71 (53%, 95% CI 44–61) in Isa-VRd (odds ratio for MRD negativity 3.16, 95% CI 1.89–5.28, P < 0.0001).”
Find in source
03Cites retracted work
highAvailabilityrecomputedFull detail
Retraction
“SAR650984 directly induces multiple myeloma cell death via lysosomal-associated and apoptotic pathways, which is further enhanced by pomalidomide”
Reference 7Find in source
04Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
64% does not match the reported count 13/21
“IsaRd, 21 (64%)”
ResultsFind in source
05Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
52% does not match the reported count 7/13
“Isa-VRd, 13 (52%)”
ResultsFind in source
06Printed percentage does not match its own count
mediumArithmeticrecomputedFull detail
28% does not match the reported count 35/135
“≥ Grade 2 | 35 (28)”
Table 3Find in source

1 further finding of this severity or below — every one is in the sections below, filed under its error type.

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 105AvailabilityBroken references and links 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 3 RCT with strong scientific premise, rigorous design, and transparent reporting. The main weaknesses are a vague data availability statement, lack of code sharing, and minor reporting/copyedit issues including a retracted citation and a typo in Table 3.

Both reviewers classified the study as interventional; no divergence. The statistics verification recomputed only a subset of tests (7 total, 3 consistent, 4 inconsistent but no decision errors); this is a partial check and does not confirm overall statistical correctness. The citation check flagged one retracted reference. Copyedit flagged minor typos and a missing figure reference.

Numerical inconsistencies

2 findings · worst medium

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Printed percentage does not match its own countRecomputed
Internal contradictions in the reported numbersAssessed

Recomputed 3 tests: 3 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 2 via agent-written checks. 4 printed percentages that do not match their own count.

Numeric forensics— values impossible for the reported sample size

PERCENT
64% does not match the reported count 13/21
“IsaRd, 21 (64%)”
ResultsFind in source
PERCENT
52% does not match the reported count 7/13
“Isa-VRd, 13 (52%)”
ResultsFind in source
PERCENT
28% does not match the reported count 35/135
“≥ Grade 2 | 35 (28)”
Table 3Find in source
PERCENT
24% does not match the reported count 34/135
“≥ Grade 2 | 34 (24)”
Table 3Find in source

Agent-written checks— recomputed from reported CIs / ratios by code the agent wrote

CONSISTENTreported p < .001 · recomputed p = <.001
Recomputed HR 1.65 (95% CI 1.27–2.14), reported p=0.0002
“HR 1.65 (95% CI 1.27 to 2.14), P = 0.0002”
Find in source
Taken as given: 1.27–2.14 is a two-sided 95% confidence interval for the HR of 1.65, not a range, an IQR, or a different interval level; the HR is a RATIO measure, so the interval is symmetric on the log scale; p=0.0002 is the p for THIS estimate, not for another comparison in the same sentence
Method: back the two-tailed p out of the log-scale CI width and compare it against the printed p
How we recomputed it: pCI(1.65, 1.27, 2.14, 1)
CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2
Primary endpoint: MRD negativity at 10^-5 at 18 months, OR = 3.16, 95% CI 1.89 to 5.28, P < 0.0001
“The odds ratio (OR) for MRD negativity in the Isa-VRd group compared with the IsaRd group was 3.16 (95% CI 1.89 to 5.28, P < 0.0001)”
Find in source
Taken as given: The OR and 95% CI are from a mixed logistic regression adjusting for stratification factors.; The CI is two-sided at 95%.; The p-value is from a Wald test.
Method: p-value derived from the reported OR and 95% CI using the normal approximation for the log odds ratio.
How we recomputed it: pCI(3.16, 1.89, 5.28, 1)
CONSISTENTreported p < .001 · recomputed p = <.001Reviewers 1, 2
Secondary endpoint: ≥CR rate at 18 months, OR = 2.97, 95% CI 2 to 5, P < 0.0001
“The ≥CR rate was 58% versus 31%, OR 2.97 (95% CI 2 to 5), P < 0.0001”
Find in source
Taken as given: The OR and 95% CI are from a logistic regression model.; The CI is two-sided at 95%.; The p-value is from a Wald test.
Method: p-value derived from the reported OR and 95% CI using the normal approximation for the log odds ratio.
How we recomputed it: pCI(2.97, 2, 5, 1)

lowinternal contradiction
In Table 3, the value for lymphopenia in the IsaRd arm is reported as '38 (280)', which is likely a typo (should be 38 (28) to match the percentage format). This does not affect the overall integrity but is a reporting error.
“Lymphopenia | 38 (280) | 33 (24) | 53 (39) | 44 (33)”
Table 3Find in source
lowinternal contradiction
In Table 3, lymphopenia percentage for IsaRd is reported as 280%, which is impossible.
“Lymphopenia | 38 (280) | 33 (24) | 53 (39) | 44 (33)”
Table 3Find in source

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions only partially backed by the presented evidenceAssessed

7 major claims checked against the paper's own evidence: 2 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

partialReviewer 1
Isa-VRd is a new standard of care for transplant-ineligible NDMM patients aged 65-79 years.
The claim is supported by the primary endpoint and secondary efficacy results, but survival data are immature, and the study is open-label with no blinding. The claim is reasonable but somewhat premature given the lack of survival benefit data.
Evidence: MRD and response rate improvements are shown; survival data are immature.
“The BENEFIT results, along with those of IMROZ , confirm that the quadruplet-based isatuximab combined with VRd regimen is a new SOC regimen for the patients with NDMM that are TI.”
Discussion ¶1Find in source
partialReviewer 2
Isa-VRd is proposed as a new standard of care for transplant-ineligible NDMM patients.
The claim is based on MRD endpoints, but survival data are immature; the claim may be premature.
Evidence: MRD benefit is shown, but no survival difference observed due to immature data.
“This study proposes Isa-VRd as a new SOC for patients with NDMM that are TI.”
DiscussionFind in source
supportedReviewer 1
Isa-VRd significantly improves the 18-month MRD negativity rate at 10^-5 compared with IsaRd.
The primary endpoint result (OR 3.16, 95% CI 1.89-5.28, P<0.0001) directly supports this claim.
Evidence: Primary endpoint analysis: 53% vs 26%, OR 3.16, P<0.0001.
The 18-month MRD negativity rates at 10^-5 were reported in 35 patients (26%, 95% confidence interval (CI) 19–34) in IsaRd versus 71 (53%, 95% CI 44–61) in Isa-VRd (odds ratio for MRD negativity 3.16, 95% CI 1.89–5.28, P < 0.0001).
Abstractreviewer’s wording
supportedReviewers 1, 2
Isa-VRd increases the proportion of patients with complete response or better at 18 months.
The reported ≥CR rate of 58% vs 31% with OR 2.97 and P<0.0001 supports this claim.
Evidence: ≥CR rate: 58% vs 31%, OR 2.97, P<0.0001.
“The ≥CR rate was 58% versus 31%, OR 2.97 (95% CI 2 to 5), P < 0.0001”
ResultsFind in source
supportedReviewers 1, 2
The addition of weekly bortezomib did not significantly affect the relative dose intensity of IsaRd.
The reported relative dose intensities for isatuximab, lenalidomide, and dexamethasone are similar between arms, supporting this claim.
Evidence: Table 2 shows similar relative dose intensities: isatuximab 95.8% vs 96.1%, lenalidomide 91% vs 91.7%, dexamethasone 97.9% vs 95.8%.
“The addition of weekly bortezomib did not significantly affect the relative dose intensity of IsaRd.”
AbstractFind in source
supportedReviewer 1
The MRD benefit of Isa-VRd is consistent across subgroups, including difficult-to-treat populations.
The prespecified subgroup analysis (Figure 2b) shows consistent benefit across most subgroups, including ISS stage III and high-risk cytogenetics.
Evidence: Figure 2b shows a forest plot with consistent ORs across subgroups.
“Prespecified MRD subgroup analyses confirmed a consistent benefit across most subgroups, including some difficult-to-treat populations with worse prognostic factors (Fig. ).”
ResultsFind in source
supportedReviewer 2
Isa-VRd significantly increased the 18-month MRD negativity rate at 10^-5 compared with IsaRd.
The primary endpoint result directly supports this claim.
Evidence: Reported OR 3.16 (95% CI 1.89-5.28, P<0.0001) for MRD negativity.
“The 18-month MRD negativity rates at 10 −5 were reported in 35 patients (26%, 95% confidence interval (CI) 19–34) in IsaRd versus 71 (53%, 95% CI 44–61) in Isa-VRd (odds ratio for MRD negativity 3.16, 95% CI 1.89–5.28, P < 0.0001).”
AbstractFind in source

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

INADEQUATESurrogate endpoint
The primary endpoint is minimal residual disease (MRD) negativity at 10^-5, a surrogate biomarker. The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD data) and does not cite validated evidence linking MRD negativity to clinical outcomes in this context, although it mentions MRD as a surrogate marker.
“The primary endpoint was a minimal residual disease (MRD) negativity rate at 10 −5 by next-generation sequencing at 18 months from randomization.”
Find in source
INADEQUATEEffect size
The primary effect is an increase in MRD negativity rate from 26% to 53% (OR 3.16). While statistically significant, the clinical meaningfulness is not anchored to a validated minimal clinically important difference or hard clinical outcome; survival data are immature.
“The 18-month MRD negativity rates at 10 −5 were reported in 35 patients (26%, 95% confidence interval (CI) 19–34) in IsaRd versus 71 (53%, 95% CI 44–61) in Isa-VRd (odds ratio for MRD negativity 3.16, 95% CI 1.89–5.28, P < 0.0001).”
Find in source

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites the MAIA trial (DRd regimen) as the best standard of care, noting its MRD negativity rate of 28.8% at 10^-5, and identifies the need for quadruplet strategies to deepen responses. It references prior studies on isatuximab and weekly bortezomib schedules, and explicitly states the gap: 'There is no report of the safety and efficacy profiles of a quadruplet-based regimen combining isatuximab with a weekly-based VRd for patients with NDMM that are TI.' The rationale linking the premise to the study objectives is clear, and limitations of prior research (e.g., twice-weekly bortezomib toxicity) are addressed by adopting a weekly schedule.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper clearly establishes its scientific foundation by citing prior work on CD38-targeting immunotherapy and bortezomib-based regimens, providing a logical rationale for the study, and acknowledging limitations of prior research.

Evidence

paraphrase[Introduction, paragraph 1]

“In the MAIA study for patients with NDMM that are TI, the complete response minimal residual disease negativity 10^-5 rate was at best 31% in the DRd arm... Novel quadruplet-based strategies are needed to further deepen responses.”

paraphrase[Introduction, paragraph 2]

“It was shown that in patients with NDMM that are TI... a weekly schedule on days 1, 8 and 15 of regimens based on 28 days was safer and similarly active.”

“There is no report of the safety and efficacy profiles of a quadruplet-based regimen combining isatuximab with a weekly-based VRd for patients with NDMM that are TI.”

Introduction ¶3Find in source

PASSReviewer 2· 90% conf

The study builds on established prior work (MAIA, ALCYONE, IMROZ) and provides a clear rationale for testing the quadruplet Isa-VRd regimen.

Evidence

paraphrase[Introduction, paragraph 1-3]

“In the MAIA study for patients with NDMM that are TI, the complete response minimal residual disease negativity 10 −5 rate was at best 31% in the DRd arm...”

paraphrase[Introduction, paragraph 4]

“We conducted the phase 3 BENEFIT/IFM2020-05 study to demonstrate the efficacy and safety profile of the quadruplet combination CD38-targeting immunotherapy isatuximab with weekly VRd (Isa-VRd...) compared with the triplet combination isatuximab with Rd (IsaRD...)”

“There are limited reports of the MRD negativity rate at the more stringent 10 −6 threshold, a more difficult MRD negativity rate to improve compared with the 10 −5 threshold”

Discussion ¶2Find in source

Randomization was stratified by age, cytogenetic risk, and center type. A power analysis is reported: 'inclusion of 242 patients would give an 80% power to detect an improvement from 15% to 30% in the Isa-VRd arm at a two-sided alpha level of 0.05.' Inclusion and exclusion criteria are extensively listed. The study is open-label, which is stated in the methods. For a human RCT, blinding is not required but the open-label design is transparently reported. The primary endpoint (MRD negativity at 10^-5 at 18 months) is clearly defined, and the analysis population (ITT) is specified.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous for a phase 3 RCT: randomization is stratified, the primary endpoint is clearly defined, a power analysis is provided, and inclusion/exclusion criteria are detailed. Blinding is not applicable as it is an open-label trial, which is stated.

Evidence

“Randomization was stratified by age (<75 and ≥75 years), cytogenetic risk at baseline as assessed by fluorescence in situ hybridization () and type of center (based on volume and teaching status).”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Assuming that 15% of patients would be MRD negative at 18 months in the IsaRd arm... inclusion of 242 patients would give an 80% power to detect an improvement from 15% to 30% in the Isa-VRd arm at a two-sided alpha level of 0.05.”

paraphrase[Methods, Trial design and oversight]

“This open-label, multicenter parallel arms phase 3 trial randomly assigned patients...”

PASSReviewer 2· 95% conf

The trial is well-designed with adequate randomization, blinding (open-label with rationale), power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

“Patients were randomly (1:1 ratio) assigned to Isa-VRd or IsaRd until progression, one cycle being 28 days long. Randomization was stratified by age (<75 and ≥75 years), cytogenetic risk at baseline as assessed by fluorescence in situ hybridization () and type of center (based on volume and teaching status).”

MethodsFind in source

“Assuming that 15% of patients would be MRD negative at 18 months in the IsaRd arm (based on approximated initial results from MAIA), inclusion of 242 patients would give an 80% power to detect an improvement from 15% to 30% in the Isa-VRd arm at a two-sided alpha level of 0.05.”

Statistical analysisFind in source

paraphrase[Methods, Trial design and oversight]

“This open-label, multicenter parallel arms phase 3 trial randomly assigned patients...”

Table 1 reports sex (female/male), median age, age categories, ECOG performance status, eGFR, ISS/R-ISS stage, and cytogenetic risk. Demographics are comprehensive. Since both sexes are enrolled, sex_justified is not applicable. Species/strain and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Biological variables relevant to a human clinical trial are well reported: sex, age, and demographics are provided in Table 1. Sex is reported for both arms, and the study includes both sexes, so sex justification is not applicable.

Evidence

paraphrase[Table 1]

“Sex, n (%) | Female | 64 (47) | 61 (45) | | Male | 71 (53) | 74 (55) | | Median age (IQR), years | 73.6 (71–76) | 73.2 (71–76)”

paraphrase[Table 1]

“ECOG performance status, n (%) b | 0 or 1 | 119 (88) | 125 (93) | | >1 | 16 (12) | 10 (7)”

PASSReviewer 2· 90% conf

Sex, age, and key demographics are reported; species/strain/housing are not applicable for a human trial.

Evidence

“Female | 64 (47) | 61 (45) | | Male | 71 (53) | 74 (55)”

Table 1Find in source

“Median age (IQR), years | 73.6 (71–76) | 73.2 (71–76)”

Table 1Find in source

paraphrase[Table 1]

“ECOG performance status, n (%) b | 0 or 1 | 119 (88) | 125 (93) | >1 | 16 (12) | 10 (7)”

The methods state: 'An independent ethics committee (CPP Est-II, Besancon, France, eudra CT 2020-004602-59) approved the study protocol along with agence nationale de securite du medicament (ANSM).' Informed consent is reported: 'All patients provided written informed consent.' Regulatory compliance is stated: 'The study was conducted in accordance with the International Conference on Harmonization Good Clinical Practice guidelines, the principles originating from the Declaration of Helsinki.'

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are fully reported: a named ethics committee (CPP Est-II) approved the study with a protocol number, written informed consent was obtained, and compliance with ICH-GCP and the Declaration of Helsinki is stated.

Evidence

“An independent ethics committee (CPP Est-II, Besancon, France, eudra CT 2020-004602-59) approved the study protocol along with agence nationale de securite du medicament (ANSM).”

MethodsFind in source

“All patients provided written informed consent.”

MethodsFind in source

“The study was conducted in accordance with the International Conference on Harmonization Good Clinical Practice guidelines, the principles originating from the Declaration of Helsinki.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethics approval by a named committee, informed consent, and regulatory compliance are all reported.

Evidence

“An independent ethics committee (CPP Est-II, Besancon, France, eudra CT 2020-004602-59) approved the study protocol along with agence nationale de securite du medicament (ANSM).”

MethodsFind in source

“All patients provided written informed consent.”

MethodsFind in source

“The study was conducted in accordance with the International Conference on Harmonization Good Clinical Practice guidelines, the principles originating from the Declaration of Helsinki.”

MethodsFind in source

The investigational products are described in detail: isatuximab 10 mg/kg IV, lenalidomide 25 mg orally, bortezomib 1.3 mg/m2 subcutaneously, dexamethasone 20 mg orally. The statistical software is identified: 'All statistical analyses were performed using R software v.4.2.1.' The MRD test uses NGS and flow cytometry, but the specific kits/vendors are not fully detailed (e.g., the NGS panel is described as 'a panel of specific probes targeting regions of interest' without vendor/catalog). However, for a clinical trial, the investigational product identification is the key criterion, and it is adequate. The lack of full vendor details for the NGS panel is a minor gap but does not warrant a warn given the overall adequacy.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Key resources are adequately identified: the investigational products (isatuximab, lenalidomide, bortezomib, dexamethasone) are named with doses and regimens, and the statistical software (R v.4.2.1) is identified. Antibodies, cell lines, and mycoplasma testing are not applicable for this clinical trial.

Evidence

paraphrase[Methods, Trial treatments]

“Isatuximab was given at a dose of 10 mg kg^-1 administered intravenously... Lenalidomide was given orally at 25 mg daily on days 1–21... Dexamethasone was given orally at 20 mg weekly... bortezomib was given at 1.3 mg per m^2, weekly at days 1, 8 and 15, subcutaneously.”

“All statistical analyses were performed using R software v.4.2.1.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

Investigational products (isatuximab, lenalidomide, bortezomib, dexamethasone) are identified with doses and schedules; software is identified.

Evidence

“Isatuximab was given at a dose of 10 mg kg −1 administered intravenously, every week at days 1, 8, 15 and 22 for the first cycle, then every other week at days 1 and 15 from cycle 2 onward, and once monthly (day 1) from cycle 13 to progression.”

MethodsFind in source

“All statistical analyses were performed using R software v.4.2.1.”

Statistical analysisFind in source

The primary analysis uses a Wald test and mixed logistic regression, with OR and 95% CI reported. Exact p-values are provided (e.g., P < 0.0001). Effect sizes with CIs are reported for the primary and key secondary endpoints. The statistical software is identified (R v.4.2.1). Data presentation includes per-group n, 95% CIs, and Kaplan-Meier curves. For a large clinical trial, explicit normality/equal-variance tests are not required; the use of logistic regression and Cox models is standard. The mathematical plausibility check is not applicable for these model-derived statistics.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Statistical analysis is rigorous: tests are named, effect sizes with confidence intervals are reported, exact p-values are given, software is identified, and data presentation includes per-group n and confidence intervals. Assumptions verification is adequate for a large clinical trial using standard methods.

Evidence

paraphrase[Results, Efficacy]

“The odds ratio (OR) for MRD negativity in the Isa-VRd group compared with the IsaRd group was 3.16 (95% CI 1.89 to 5.28, P < 0.0001).”

“All statistical analyses were performed using R software v.4.2.1.”

Statistical analysisFind in source

paraphrase[Results, Efficacy]

“The 18-month MRD negativity rate at 10^-5 was significantly higher in the Isa-VRd arm, with 71 patients (53%, 95% CI 44 to 61) compared with 35 patients (26%, 95% CI 19 to 34) in the IsaRd arm.”

PASSReviewer 2· 90% conf

Statistical tests are named, effect sizes with CIs are reported, and software is identified; p-values are reported as thresholds but this is acceptable for a large trial.

Evidence

“The primary endpoint was compared between treatment groups using a Wald test and treatment effect was assessed by OR and 95% CI using a mixed logistic regression with treatment as the explanatory variable and adjusting for randomization stratification factors.”

Statistical analysisFind in source

“The odds ratio (OR) for MRD negativity in the Isa-VRd group compared with the IsaRd group was 3.16 (95% CI 1.89 to 5.28, P < 0.0001)”

ResultsFind in source

paraphrase[Abstract]

“P < 0.0001”

The data availability statement says: 'Data supporting this article are part of an ongoing clinical trial and are not publicly available. Data will be considered for sharing once the product and indication has been approved... Requests for de-identified patient data by researchers with proposed use of the data can be made to the corresponding author... Response will typically be given in 3 months.' This is reported_but_inadequate because it does not name a managed-access platform or data-access committee with clear conditions. Code sharing is not reported; the paper mentions R software but no custom code repository. The trial is registered (NCT04751877), which is a positive aspect but does not fulfill the data availability criteria.

Sub-criteria

code sharingNOT REPORTED

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 95% conf

A data availability statement is present but is vague ('available on reasonable request' with no platform or timeframe), and no code is shared. The trial is registered, but the data access mechanism is not concrete.

Evidence

paraphrase[Data availability section]

“Data supporting this article are part of an ongoing clinical trial and are not publicly available. Data will be considered for sharing once the product and indication has been approved... Requests for de-identified patient data by researchers with proposed use of the data can be made to the corresponding author... Response will typically be given in 3 months.”

“The IFM eCRF use the V8.2.30 Ennov version. All statistical analyses were performed using R software v.4.2.1.”

Data availabilityFind in source

PASSReviewer 2· 90% conf

Data availability statement is concrete with a managed-access mechanism; code is described (R version) but not shared in a repository.

Evidence

“Requests for de-identified patient data by researchers with proposed use of the data can be made to the corresponding author with specific data needs, analysis plans and dissemination plans. Those requests will be reviewed by a study steering committee (IFM group) and the study sponsor for release upon publication. Response will typically be given in 3 months.”

Data availabilityFind in source

Methods are comprehensive, including trial design, treatments, endpoints, and statistical analysis. The trial is registered at ClinicalTrials.gov (NCT04751877). Limitations are discussed in the Discussion (e.g., upper age limit, intravenous isatuximab, prolonged bortezomib use). Conclusions are proportional: the paper states Isa-VRd as a new SOC but acknowledges immature survival data. Funding (Sanofi) and competing interests are disclosed. A CONSORT flow diagram is provided, but the paper does not explicitly state adherence to a reporting guideline (e.g., 'CONSORT checklist'). This is a minor omission but does not warrant a warn given the overall transparency.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineINADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Reporting is transparent: methods are detailed, the trial is registered, limitations are discussed, conclusions are proportional, and funding/COI are disclosed. A reporting guideline (CONSORT) is implied by the flow diagram but not explicitly referenced.

Evidence

“ClinicalTrials.gov identifier: NCT04751877”

AbstractFind in source

“There are limitations in our BENEFIT study, including restricting the upper age for recruitment to 79 years, the use of intravenous isatuximab, the prolonged use of bortezomib up to 18 months and the treatment schema given as isatuximab and lenalidomide until progression.”

Discussion ¶5Find in source

“This study was funded by Sanofi. Sanofi provided drug supply for Isatuximab.”

AcknowledgementsFind in source

PASSReviewer 2· 95% conf

Trial is registered, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“ClinicalTrials.gov identifier: NCT04751877”

AbstractFind in source

Discussion ¶5Find in source

“This study was funded by Sanofi. Sanofi provided drug supply for Isatuximab.”

AcknowledgementsFind in source

Registered (8 IDs: ClinicalTrials.gov, EudraCT). Reporting guideline cited: CONSORT.

ClinicalTrials.gov

ClinicalTrials.gov

ClinicalTrials.gov

ClinicalTrials.gov

ClinicalTrials.gov

ClinicalTrials.gov

ClinicalTrials.gov

EudraCT

2020-004602-59

Reporting guidelines: CONSORT

Broken references and links

1 finding · worst high

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Cites retracted workRecomputed

Checked 30 references by DOI: 29 verified — 1 retracted.

RETRACTED10.1038/leu.2015.240
SAR650984 directly induces multiple myeloma cell death via lysosomal-associated and apoptotic pathways, which is further enhanced by pomalidomide
Reason: Retraction

7 data/code links checked; 7 live.

datahttps://classic.clinicaltrials.gov/ct2/show/NCT04751877LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT03652064LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT03319667LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT04939844LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT05889221LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT05804032LIVEHTTP 200
Resolves, but the content could not be matched to the paper.
datahttps://clinicaltrials.gov/ct2/show/NCT03836014LIVEHTTP 200
Resolves, but the content could not be matched to the paper.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly typo, consistency, clarity.

MINORtypoResults, Safety, Table 3
“Lymphopenia | 38 (280) | 33 (24) | 53 (39) | 44 (33)”
→ The value '38 (280)' for lymphopenia in IsaRd appears to be a typo; likely should be '38 (28)' to match the percentage format.
The percentage 280% is impossible; this is likely a formatting error.
MINORconsistencyResults, Safety
“There were 164 AEs of grade 2 and above resulting in temporary or permanent discontinuation of bortezomib in the Isa-VRd arm among 79 patients described in Extended Data Table .”
→ Consider rephrasing for clarity: 'Among 79 patients in the Isa-VRd arm, 164 AEs of grade ≥2 led to temporary or permanent discontinuation of bortezomib (Extended Data Table).'
The sentence structure is slightly awkward.
MINORclarityResults, Efficacy
“The overall rates of very good partial response or better (≥VGPR) and complete response or better (≥CR) were higher at 18 months with Isa-VRd than with IsaRd. The ≥CR rate was 58% versus 31%, OR 2.97 (95% CI 2 to 5), P < 0.0001 (Fig. ).”
→ The figure reference is empty; ensure the correct figure number is inserted.
Missing figure reference.
MINORtypoAbstract
“bortzomib”
→ bortezomib
Typo in the abstract.
MINORconsistencyResults, Safety
“38 (280)”
→ 38 (28)
Percentage appears to be a typo; should be 28% not 280%.
MINORgrammarResults, Safety
“developped”
→ developed
Spelling error.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust overall, but an informed reader should weigh the retracted citation, the vague data availability, and the minor reporting errors. A correction or erratum is warranted for the retracted reference and the Table 3 typo; independent re-analysis is not indicated by the evidence.

1.
HIGHrigor
Remove or replace the retracted citation 'SAR650984 directly induces multiple myeloma cell death via lysosomal-associated and apoptotic pathways, which is further enhanced by pomalidomide' (DOI 10.1038/leu.2015.240) with a non-retracted source.
Citing a retracted paper is a serious integrity issue that must be corrected.
2.
HIGHcopyedit
Fix the impossible value '38 (280)' for lymphopenia in Table 3 (IsaRd arm) to '38 (28)'.
A percentage of 280% is impossible and indicates a typo that undermines data credibility.
3.
HIGHdata code
Provide a concrete data access mechanism, e.g., a link to a data request form or a named managed-access platform (Vivli, YODA), in the Data availability section.
The current statement is vague and does not give readers a clear path to request data.
4.
HIGHdata code
Deposit custom analysis code (e.g., R scripts for primary and secondary analyses) in a public repository (GitHub, Zenodo) with a DOI and reference it in the Code availability section.
Sharing code enhances reproducibility and is expected for a data-driven clinical trial.
5.
MEDIUMreporting
Explicitly state adherence to CONSORT reporting guidelines and indicate where the completed checklist can be found (e.g., supplementary material).
The flow diagram implies CONSORT but the guideline is not named, which is a transparency gap.
6.
MEDIUMcopyedit
Fix the typo 'bortzomib' to 'bortezomib' in the Abstract.
Correct spelling is essential for professionalism and searchability.
7.
MEDIUMcopyedit
Insert the correct figure reference in the sentence 'The ≥CR rate was 58% versus 31%, OR 2.97 (95% CI 2 to 5), P < 0.0001 (Fig. ).'
A missing figure reference is a reporting error that confuses readers.
8.
MEDIUMcopyedit
Rephrase the sentence about 164 AEs leading to bortezomib discontinuation for clarity: 'Among 79 patients in the Isa-VRd arm, 164 AEs of grade ≥2 led to temporary or permanent discontinuation of bortezomib (Extended Data Table).'
The current sentence structure is awkward and could be misinterpreted.
9.
MEDIUMcopyedit
Correct the spelling 'developped' to 'developed' in the Results, Safety section.
Spelling errors detract from the manuscript's quality.
10.
LOWreporting
Provide vendor and catalog numbers for the NGS panel and flow cytometry reagents used for MRD assessment in the Methods, Endpoints and assessments section.
Full reagent identification improves reproducibility.
11.
LOWstatistics
Report exact p-values (e.g., P=0.00003) instead of thresholds like P<0.0001 in the Abstract and Results where feasible.
Exact p-values provide more information to readers and reviewers.
12.
LOWreporting
Add a statement on whether the study protocol and statistical analysis plan are publicly available (e.g., as supplementary material or on ClinicalTrials.gov).
Public availability of the protocol enhances transparency and trust.

Full text (52,678 chars)Analyzed: Aug 16, 2026

RigorReviewer 1

RigorReviewer 2

RigorPre-Submission Reviewer

CopyeditAgent Scribe

CitationsCitation Integrity

StatisticsStatistics Consistency

ReproducibilityLink verification (liveness + content)· no model (rule-based)

PreregistrationDeterministic check· no model (rule-based)

The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”

How stars are deducted

Reporting — 8 dimensionseach dimension that fully fails−½★
each dimension partially met−¼★
Statistics · Integrity · Claimseach serious problem−1★
each medium problem−½★
Citationseach retracted or unverifiable reference−¼★
Copyeditonly when the manuscript needs a full edit−½★

The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.

The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.

The eight reporting dimensions

Scientific PremisePrior work, rationale, and how it addresses gaps.

Study Design & RigorRandomization, blinding, power, controls, replication.

Biological VariablesSex, age, species/strain, housing, demographics.

Ethical ApprovalsIRB/IACUC approval, informed consent, regulatory compliance.

Key ResourcesAntibodies, cell lines, organisms, software — identified with persistent IDs.

Statistical ReportingNamed tests, exact p-values, effect sizes, plausible summary stats.

Data & Code AvailabilityAvailability statements, repositories, accession numbers, shared code.

Reporting TransparencyMethods, registration, guidelines, outcomes, limitations, funding/COI.

Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.

This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.

Isatuximab, lenalidomide, dexamethasone and bortezomib in transplant-ineligible multiple myeloma: the randomized phase 3 BENEFIT trial.

DOI

10.1038/s41591-024-03050-2

Record issued

2026-08-16

Engine

7.39.0

Exported

2026-09-22