Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.

Name: Kaimen Rigor review — Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.
Item: Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.
Rating: 39
Author: Alpha1

Liu GY, Ye YF, Jiang YF, Chen GJ, Xia WX, Huang YS, Gao TS, Liu YM, Hou YT, Li JF, Liu JH, Lu N, Chen CL, Ke LR, Liang H, Bei WX, Li WZ, Dong SH, Liu Q, Xie C, Yao HR, Xiang YQ

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 1★ (Critical), 2 critical, 3 high issues for “Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Read alongside

Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.

Liu GY, Ye YF, Jiang YF, Chen GJ, Xia WX, Huang YS, Gao TS, Liu YM, Hou YT, Li JF, Liu JH, Lu N, Chen CL, Ke LR, Liang H, Bei WX, Li WZ, Dong SH, Liu Q, Xie C, Yao HR, Xiang YQ

Read full text (PMC)

DOI

10.1136/bmj-2023-077890

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/2e267a7a-6956-4c0e-a64c-a021f65465ac" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/2e267a7a-6956-4c0e-a64c-a021f65465ac/badge" alt="Kaimen Rigor review — 1★ (Critical), 2 critical, 3 high issues for “Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

3ae1e27f551448deee20e68b1f9655d8285c0652f30fe2d031fc2f7b4110d2d0

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.

Liu GY, Ye YF, Jiang YF, Chen GJ, Xia WX, Huang YS, Gao TS, Liu YM, Hou YT, Li JF, Liu JH, Lu N, Chen CL, Ke LR, Liang H, Bei WX, Li WZ, Dong SH, Liu Q, Xie C, Yao HR, Xiang YQ

Paper source

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 16, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic ×4−4★
IntegrityIntegrity concern−0.5★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No data or code availability links were detected to verify.

Biggest issues4 demonstrable

01Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
98% does not match the reported count 1/41
“1/41 (98%)”
02Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
92.5% does not match the reported count 3/40
“3/40 (92.5%)”
Find in source
03Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
98% does not match the reported count 1/41
“1/41 (98%)”
Results
04Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
92.5% does not match the reported count 3/40
“3/40 (92.5%)”
ResultsFind in source
05Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is progression-free survival (PFS), a surrogate for overall survival. The paper does not demonstrate target engagement at the tested dose (no PK/PD data) and does not cite validated evidence linking PFS to overall survival in this specific disease context. The authors acknowledge that overall survival data are immature and that the correlation between PFS and OS is uncertain, especially with subsequent treatments.
“The overall survival data were still immature for both cohorts at the time of analysis.”
Find in source
06Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect is a median PFS improvement from 7.7 to 11.3 months (HR 0.43). While statistically significant, the clinical meaningfulness is not anchored to a minimal clinically important difference or a validated threshold. The authors claim a 'substantial extension' but do not provide a benchmark for what constitutes a clinically meaningful PFS gain in this setting.
“The nab-TPC regimen showed a substantial extension in progression-free survival compared with the conventional gemcitabine plus cisplatin chemotherapy regimen.”
Find in source

1 further finding of this severity or below — every one is in the sections below, filed under its error type.

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found · partly checked 06Copyedit6 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted phase 3 randomised controlled trial with rigorous design, clear ethical approvals, and appropriate statistical methods. The main weaknesses are the vague data availability statement, lack of explicit reporting guideline adherence, and a slightly overstated conclusion given the interim nature of the analysis.

Both reviewers agreed on all dimensions and study type (interventional). The statistics verification component could only recompute a subset of tests (8 of 12 reported with sufficient detail); the remaining 4 were threshold-only or resampling-based and could not be machine-verified, so no claim of overall statistical correctness is made. The citation check found no retracted or unresolved references.

Numerical inconsistencies

2 findings · worst critical

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Internal contradictions in the reported numbersAssessed

Recomputed 8 tests: 8 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 7 via agent-written checks. 4 reported summary statistics mathematically impossible for the stated N (PERCENT).

Overstated conclusions

3 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions overstated beyond the evidenceAssessed

5 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

The introduction cites the landmark phase 3 trial establishing gemcitabine plus cisplatin as standard, notes the limited median progression-free survival of 7.0-7.7 months, and references prior work on capecitabine maintenance and nab-paclitaxel. The rationale for the study follows logically from these findings. Limitations of prior research are implicitly addressed by the design of a new regimen to improve efficacy.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes the scientific premise by citing prior research on the standard gemcitabine plus cisplatin regimen and the rationale for testing nab-paclitaxel-based triplet therapy.

Evidence

“A phase 3 study has shown that gemcitabine plus cisplatin prolongs progression-free survival and overall survival in comparison with 5-fluorouracil plus cisplatin, which led to the establishment of gemcitabine plus cisplatin as the front line regimen for recurrent or metastatic nasopharyngeal carcinoma.”

Introduction ¶2Find in source

“However, median progression-free survival derived from the gemcitabine plus cisplatin regimen remains limited, ranging from 7.0 to 7.7 months according to data from several prospective clinical studies.”

Introduction ¶3Find in source

“We designed this phase 3, open label, randomised trial to evaluate the efficacy and safety of nab-paclitaxel, cisplatin, and capecitabine (nab-TPC) as first line treatment for recurrent or metastatic nasopharyngeal carcinoma compared with a gemcitabine plus cisplatin regimen.”

Introduction ¶4Find in source

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise by citing prior research, providing a logical rationale, and addressing limitations of prior work.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

“Hence, innovative strategies are needed to enhance clinical benefits while maintaining an acceptable toxicity profile.”

Introduction ¶4Find in source

Randomization used a computer-generated permuted block design with opaque sealed envelopes. The trial was open-label but the independent review committee was masked. A sample size calculation was provided (134 patients, 80% power, HR 0.42). Inclusion/exclusion criteria were specified. The analysis population (ITT) and safety population were defined. Outlier handling is not explicitly described but the analysis population is pre-specified.

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, blinding of the independent review committee, a pre-specified sample size calculation, and defined inclusion/exclusion criteria.

Evidence

“A computer generated random number code was provided for randomisation of enrolled patients at the Sun Yat-sen University Cancer Center. Random distribution sequences were generated using a permuted block of flexible size (2, 4, 6, or 8), with no stratification factors.”

MethodsFind in source

“The therapy assignment was not masked to investigators, patients, and other treating oncologists, but the central evaluation of the imaging data by an independent review committee was done in a masked manner.”

MethodsFind in source

“We calculated that we would need to randomise approximately 134 patients (67 patients per group), providing 80% power to detect the underlying hazard ratio of 0.42 for the primary analysis of progression-free at a two sided α level of 5% with one interim analysis.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The trial design is rigorous with adequate randomization, blinding of outcome assessment, sample size calculation, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

Statistical analysisFind in source

The study reports age, sex, ECOG performance status, histology, smoking status, disease status, number of metastatic organs, and baseline EBV DNA. These are adequate for a human trial. Sex is reported for both groups, and since both sexes are enrolled, sex_justified is not applicable.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Demographic and clinical characteristics are well reported, including age, sex, and disease status.

Evidence

“Male | 34 (83) | 30 (75) | 64 (79)”

Table 1Find in source

“Median (IQR) age, years | 47 (36-57) | 48 (36-56) | 48 (36-57)”

Table 1Find in source

paraphrase[Table 1]

“Disease status: Recurrence with distant metastases | 24 (59) | 28 (70) | 52 (64)”

PASSReviewer 2· 90% conf

Demographic and clinical characteristics are well reported, including age, sex, and disease-related variables.

Evidence

“The median age was 48 (interquartile range 36-57) years, and 79% of patients were male.”

ResultsFind in source

“Baseline demographics and disease characteristics were balanced between the treatment groups ().”

ResultsFind in source

The study was approved by the Chinese Ethics Committee of Registering Clinical Trials (ChiECRCT20190198) and conducted in accordance with Good Clinical Practice and the Declaration of Helsinki. All participants provided written informed consent.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval from a named committee and written informed consent are reported.

Evidence

“This study was approved the Chinese Ethics Committee of Registering Clinical Trials (ChiECRCT20190198) and was conducted in accordance with Good Clinical Practice and the Declaration of Helsinki.”

EthicsFind in source

“All participants provided written informed consent.”

EthicsFind in source

PASSReviewer 2· 95% conf

Ethical approval from a named ethics committee and informed consent are clearly documented.

Evidence

EthicsFind in source

“All participants provided written informed consent.”

EthicsFind in source

The trial uses nab-paclitaxel, cisplatin, capecitabine, and gemcitabine, all named with doses and schedules. This satisfies the reagents_identified criterion for a drug trial. Statistical software (R and SPSS) is identified. No antibodies, cell lines, or organisms are used, so those criteria are not applicable.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational drugs are identified with doses and regimens, and statistical software is identified.

Evidence

“Patients assigned to the nab-TPC cohort received nab-paclitaxel (200 mg/m 2 ) on day 1, cisplatin (60 mg/m 2 ) on day 1, and capecitabine (1000 mg/m 2 twice daily) on days 1-14 of each three week cycle for up to six cycles, followed by capecitabine maintenance for a maximum of two years.”

MethodsFind in source

“We used R software (version 4.0.5) and SPSS (version 24.0) for statistical analyses.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational drugs are adequately identified with doses and regimens; software tools are identified.

Evidence

MethodsFind in source

“We used R software (version 4.0.5) and SPSS (version 24.0) for statistical analyses.”

Statistical analysisFind in source

The paper names the tests used (Mann-Whitney, chi-square, Fisher's exact, Kaplan-Meier, log-rank, Cox proportional hazards). It reports exact p-values (e.g., P=0.002) and effect sizes with 95% CIs. The proportional hazards assumption was checked and found unmet, which is acknowledged. Statistical software is identified. Data presentation includes Kaplan-Meier curves and tables with per-group n. Mathematical plausibility checks were not possible for most statistics due to lack of raw data, but no obvious errors were found.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well described, with exact p-values and effect sizes with confidence intervals.

Evidence

“We presented continuous variables as medians with interquartile ranges and compared them by using the Mann-Whitney test. We assessed categorical variables by using either the χ 2 test or Fisher’s exact test for comparison.”

Statistical analysisFind in source

“The hazard ratio was 0.43 (95% confidence interval 0.25 to 0.73; P=0.002).”

ResultsFind in source

“The proportional hazards assumption for progression-free survival was unmet (supplementary figure A).”

ResultsFind in source

PASSReviewer 2· 85% conf

Statistical methods are appropriate and well described, with exact p-values and effect sizes with confidence intervals.

Evidence

Statistical analysisFind in source

“We verified the assumption of proportional hazards by examining the Schoenfeld residuals.”

Statistical analysisFind in source

“The hazard ratio was 0.43 (95% confidence interval 0.25 to 0.73; P=0.002).”

ResultsFind in source

The data availability statement says the raw database will be deposited on the Research Data Deposit public platform and requests can be made through the corresponding author, but it does not specify the access conditions or timeframe. The statistical code is mentioned as an online supplement, but no repository or permanent identifier is given. Therefore, data_availability_statement is reported_but_inadequate, and code_sharing is reported_but_inadequate.

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositINADEQUATE

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement exists but is vague about the access mechanism, and code is mentioned as an online supplement but not in a public repository.

Evidence

paraphrase[Data availability statement]

“Taking into account patient privacy and relevant regulations in China, we have decided against making the database publicly accessible to all. However, the raw database will be securely deposited on the Research Data Deposit public platform ( www.researchdata.org.cn ). Researchers interested in using the raw data for scientific research purposes may request access through our corresponding author and database administrator.”

“The codes used for analysis are provided as an online supplement.”

Statistical analysisFind in source

WARNReviewer 2· 80% conf

A data availability statement exists but is vague; code is provided as an online supplement but not in a public repository.

Evidence

paraphrase[Data availability statement]

“The codes used for analysis are provided as an online supplement.”

Statistical analysisFind in source

The trial is registered (ChiCTR1900027112). Methods are detailed enough for replication. Limitations are explicitly discussed. Conclusions are proportional to the evidence, with appropriate caveats about overall survival. Funding sources and competing interests are declared. No reporting guideline is explicitly mentioned, but the paper follows CONSORT-like structure.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“Trial registration Chinese Clinical Trial Registry ChiCTR1900027112.”

AbstractFind in source

“This trial has some inevitable limitations. Firstly, as all participants were sourced from endemic areas in China where non-keratinising nasopharyngeal carcinoma comprises more than 95% of cases, whether the findings can be extrapolated to non-endemic regions without further validation remains uncertain.”

LimitationsFind in source

“Funding: This study was supported by the Guangdong Basic and Applied Basic Research Foundation (grant No 2021B1515120013), the National Natural Science Foundation of China (Nos 82203755, 62220106006, and 82303338), the China Postdoctoral Science Foundation (CPSF) (2023T160749 and 2023T160146), and the Postdoctoral Fellowship Programme of CPSF (GZB20230179).”

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent with trial registration, funding/COI statements, and limitations discussed.

Evidence

“Trial registration Chinese Clinical Trial Registry ChiCTR1900027112.”

AbstractFind in source

LimitationsFind in source

FundingFind in source

Registered (1 ID: Chinese Clinical Trial Registry). No reporting guideline cited.

Broken references and links

None found · partly checked

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.

Checked 21 references by DOI: 21 verified.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly consistency, typo, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust and generally trustworthy, but an informed reader should weigh the interim-analysis context, the immature overall survival data, and the slightly overstated conclusion. The vague data/code availability and minor copyedit errors (e.g., a likely typo in the disease control rate) are worth noting but do not undermine the core findings.

1.
CRITICALstatistics
Correct or explain the statistically impossible value: PERCENT: 98% does not match the reported count 1/41
Demonstrable critical failure — blocks the verdict from passing.
2.
CRITICALstatistics
Correct or explain the statistically impossible value: PERCENT: 92.5% does not match the reported count 3/40
Demonstrable critical failure — blocks the verdict from passing.
3.
HIGHreporting
In the Conclusion, temper the claim that nab-TPC 'should be considered the standard first line treatment' to reflect that the trial was stopped at interim analysis, overall survival data are immature, and the sample size is small (81 patients).
The claim audit and Reviewer 2 both flagged this as overstated; over-claiming is a common reviewer objection and could undermine reader trust.
4.
HIGHdata code
In the Data availability statement, specify the access conditions and timeframe for requesting the raw database from the Research Data Deposit platform, and provide a persistent identifier (DOI or accession number) once available.
The current statement is vague about how and when data can be accessed, which limits reproducibility.
5.
HIGHdata code
Deposit the statistical code in a public repository (e.g., Zenodo, GitHub) with a DOI and link it in the Methods/Statistical analysis section.
The code is only mentioned as an online supplement without a stable link, making it difficult for readers to access and verify the analyses.
6.
MEDIUMreporting
In the Methods, explicitly state adherence to the CONSORT reporting guideline for randomised trials and provide the CONSORT checklist as a supplement.
Reporting guidelines improve transparency and are expected for clinical trials; the paper currently does not mention one.
7.
MEDIUMstatistics
In the Methods/Statistical analysis, clarify the handling of missing data and any imputation methods used for the primary analysis.
Missing data handling is not described, which is a common reviewer concern for trial analyses.
8.
MEDIUMstatistics
In the Results, report the number of patients with missing data for each endpoint and how they were handled in the analysis.
Transparency about missing data is essential for assessing the robustness of the results.
9.
MEDIUMreporting
In the Discussion, expand on the implications of the unmet proportional hazards assumption for the interpretation of the hazard ratio.
The paper notes the assumption was unmet but does not discuss what this means for the validity of the HR estimate.
10.
MEDIUMreporting
In the Methods, specify the exact version of the trial protocol and where it can be accessed (e.g., supplementary material).
Providing the protocol version and location enhances transparency and reproducibility.
11.
MEDIUMdata code
In the Data availability statement, clarify whether the statistical code is included in the online supplement or available separately.
The current statement is ambiguous about the code's availability.
12.
MEDIUMreporting
In the Methods, state whether any data monitoring committee charter or statistical analysis plan is publicly available.
Public availability of these documents strengthens the trial's transparency.
13.
MEDIUMcopyedit
In the Abstract, Results, correct the dose unit 'g/m 2' to 'mg/m 2' for nab-paclitaxel.
The unit is missing the 'm' for milligram, which is a factual error that could mislead readers.
14.
MEDIUMcopyedit
In the Methods, Procedures, change 'to evaluated' to 'to evaluate'.
Incorrect verb form after 'to' is a grammatical error that should be fixed.
15.
MEDIUMcopyedit
In the Results, Efficacy, correct the disease control rate numbers from '1/41 (98%) v 3/40 (92.5%)' to '40/41 (98%) v 37/40 (92.5%)'.
The numerator appears to be missing a digit; the percentages indicate the correct values.
16.
LOWcopyedit
In the Discussion, Comparison with other studies, clarify that the '20% improvement' in objective response rate is an absolute difference in percentage points, not a relative improvement.
The phrase could be misinterpreted as a relative improvement, which would be misleading.
17.
LOWcopyedit
In the Discussion, ensure consistency between the percentages reported (82.9% v 62.5%) and those in the abstract/results (83% v 63%).
Minor rounding differences could confuse readers; standardize the decimal places.

Full text (38,882 chars)Analyzed: Aug 16, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.

Liu GY, Ye YF, Jiang YF, Chen GJ, Xia WX, Huang YS, Gao TS, Liu YM, Hou YT, Li JF, Liu JH, Lu N, Chen CL, Ke LR, Liang H, Bei WX, Li WZ, Dong SH, Liu Q, Xie C, Yao HR, Xiang YQ

Read full text (PMC)

DOI

10.1136/bmj-2023-077890

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/2e267a7a-6956-4c0e-a64c-a021f65465ac" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/2e267a7a-6956-4c0e-a64c-a021f65465ac/badge" alt="Kaimen Rigor review — 1★ (Critical), 2 critical, 3 high issues for “Nab-paclitaxel, cisplatin, and capecitabine versus cisplatin and gemcitabine as first line chemotherapy in patients with recurrent or metastatic nasopharyngeal carcinoma: randomised phase 3 clinical trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

3ae1e27f551448deee20e68b1f9655d8285c0652f30fe2d031fc2f7b4110d2d0

Verify via API

Issued Aug 16, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

1 / 5

Critical — a demonstrable failure

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

StatisticsImpossible or misreported statistic ×4−4★
IntegrityIntegrity concern−0.5★
ClaimsOverstated claim−0.5★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ClaimsTreatment effect not shown to be clinically meaningful−0.5★
ReportingData & code availability partially met−0.25★

A demonstrable critical failure caps the rating at the minimum, regardless of the deductions above.

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

No data or code availability links were detected to verify.

Biggest issues4 demonstrable

01Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
98% does not match the reported count 1/41
“1/41 (98%)”
02Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
92.5% does not match the reported count 3/40
“3/40 (92.5%)”
Find in source
03Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
98% does not match the reported count 1/41
“1/41 (98%)”
Results
04Printed percentage does not match its own countdemonstrable
criticalArithmeticrecomputedFull detail
92.5% does not match the reported count 3/40
“3/40 (92.5%)”
ResultsFind in source
05Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary endpoint is progression-free survival (PFS), a surrogate for overall survival. The paper does not demonstrate target engagement at the tested dose (no PK/PD data) and does not cite validated evidence linking PFS to overall survival in this specific disease context. The authors acknowledge that overall survival data are immature and that the correlation between PFS and OS is uncertain, especially with subsequent treatments.
“The overall survival data were still immature for both cohorts at the time of analysis.”
Find in source
06Treatment effect not shown to be clinically meaningful
highOverreachreviewer-assessedFull detail
The primary effect is a median PFS improvement from 7.7 to 11.3 months (HR 0.43). While statistically significant, the clinical meaningfulness is not anchored to a minimal clinically important difference or a validated threshold. The authors claim a 'substantial extension' but do not provide a benchmark for what constitutes a clinically meaningful PFS gain in this setting.
“The nab-TPC regimen showed a substantial extension in progression-free survival compared with the conventional gemcitabine plus cisplatin chemotherapy regimen.”
Find in source

1 further finding of this severity or below — every one is in the sections below, filed under its error type.

Findings by category

201ArithmeticNumerical inconsistencies 302OverreachOverstated conclusions 03AuthenticityNone found 104DisclosureReporting gaps 05AvailabilityNone found · partly checked 06Copyedit6 minor suggestions

Numerical inconsistencies

2 findings · worst critical

Summary statistic impossible for the stated N (GRIM/GRIMMER)Recomputed
Internal contradictions in the reported numbersAssessed

Overstated conclusions

3 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Treatment effect not shown to be clinically meaningfulAssessed
Conclusions overstated beyond the evidenceAssessed

5 major claims checked against the paper's own evidence: 1 not fully backed by the presented evidence (unsupported or overstated).

Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.

Data authenticity concerns

None found

Checked — nothing surfaced.

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The study clearly establishes the scientific premise by citing prior research on the standard gemcitabine plus cisplatin regimen and the rationale for testing nab-paclitaxel-based triplet therapy.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

Introduction ¶4Find in source

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise by citing prior research, providing a logical rationale, and addressing limitations of prior work.

Evidence

Introduction ¶2Find in source

Introduction ¶3Find in source

“Hence, innovative strategies are needed to enhance clinical benefits while maintaining an acceptable toxicity profile.”

Introduction ¶4Find in source

Sub-criteria

controlsN/A

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingADEQUATE

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial design is rigorous with clear randomization, blinding of the independent review committee, a pre-specified sample size calculation, and defined inclusion/exclusion criteria.

Evidence

MethodsFind in source

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The trial design is rigorous with adequate randomization, blinding of outcome assessment, sample size calculation, and pre-specified inclusion/exclusion criteria.

Evidence

MethodsFind in source

Statistical analysisFind in source

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

Demographic and clinical characteristics are well reported, including age, sex, and disease status.

Evidence

“Male | 34 (83) | 30 (75) | 64 (79)”

Table 1Find in source

“Median (IQR) age, years | 47 (36-57) | 48 (36-56) | 48 (36-57)”

Table 1Find in source

paraphrase[Table 1]

“Disease status: Recurrence with distant metastases | 24 (59) | 28 (70) | 52 (64)”

PASSReviewer 2· 90% conf

Demographic and clinical characteristics are well reported, including age, sex, and disease-related variables.

Evidence

“The median age was 48 (interquartile range 36-57) years, and 79% of patients were male.”

ResultsFind in source

“Baseline demographics and disease characteristics were balanced between the treatment groups ().”

ResultsFind in source

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approval from a named committee and written informed consent are reported.

Evidence

EthicsFind in source

“All participants provided written informed consent.”

EthicsFind in source

PASSReviewer 2· 95% conf

Ethical approval from a named ethics committee and informed consent are clearly documented.

Evidence

EthicsFind in source

“All participants provided written informed consent.”

EthicsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The investigational drugs are identified with doses and regimens, and statistical software is identified.

Evidence

MethodsFind in source

“We used R software (version 4.0.5) and SPSS (version 24.0) for statistical analyses.”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational drugs are adequately identified with doses and regimens; software tools are identified.

Evidence

MethodsFind in source

“We used R software (version 4.0.5) and SPSS (version 24.0) for statistical analyses.”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 85% conf

Statistical methods are appropriate and well described, with exact p-values and effect sizes with confidence intervals.

Evidence

Statistical analysisFind in source

“The hazard ratio was 0.43 (95% confidence interval 0.25 to 0.73; P=0.002).”

ResultsFind in source

“The proportional hazards assumption for progression-free survival was unmet (supplementary figure A).”

ResultsFind in source

PASSReviewer 2· 85% conf

Statistical methods are appropriate and well described, with exact p-values and effect sizes with confidence intervals.

Evidence

Statistical analysisFind in source

“We verified the assumption of proportional hazards by examining the Schoenfeld residuals.”

Statistical analysisFind in source

“The hazard ratio was 0.43 (95% confidence interval 0.25 to 0.73; P=0.002).”

ResultsFind in source

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositINADEQUATE

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 80% conf

A data availability statement exists but is vague about the access mechanism, and code is mentioned as an online supplement but not in a public repository.

Evidence

paraphrase[Data availability statement]

“The codes used for analysis are provided as an online supplement.”

Statistical analysisFind in source

WARNReviewer 2· 80% conf

A data availability statement exists but is vague; code is provided as an online supplement but not in a public repository.

Evidence

paraphrase[Data availability statement]

“The codes used for analysis are provided as an online supplement.”

Statistical analysisFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineNOT REPORTED

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 90% conf

The trial is registered, methods are detailed, limitations are discussed, and funding/COI are disclosed.

Evidence

“Trial registration Chinese Clinical Trial Registry ChiCTR1900027112.”

AbstractFind in source

LimitationsFind in source

FundingFind in source

PASSReviewer 2· 90% conf

The manuscript is transparent with trial registration, funding/COI statements, and limitations discussed.

Evidence

“Trial registration Chinese Clinical Trial Registry ChiCTR1900027112.”

AbstractFind in source

LimitationsFind in source

FundingFind in source

Registered (1 ID: Chinese Clinical Trial Registry). No reporting guideline cited.

Broken references and links

None found · partly checked

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.

Checked 21 references by DOI: 21 verified.

Copyediting

6 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 6 minor suggestions below.

6 copyedit issues flagged: mostly consistency, typo, grammar.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
CRITICALstatistics
Correct or explain the statistically impossible value: PERCENT: 98% does not match the reported count 1/41
Demonstrable critical failure — blocks the verdict from passing.
2.
CRITICALstatistics
Correct or explain the statistically impossible value: PERCENT: 92.5% does not match the reported count 3/40
Demonstrable critical failure — blocks the verdict from passing.
3.
HIGHreporting
In the Conclusion, temper the claim that nab-TPC 'should be considered the standard first line treatment' to reflect that the trial was stopped at interim analysis, overall survival data are immature, and the sample size is small (81 patients).
The claim audit and Reviewer 2 both flagged this as overstated; over-claiming is a common reviewer objection and could undermine reader trust.
4.
HIGHdata code
In the Data availability statement, specify the access conditions and timeframe for requesting the raw database from the Research Data Deposit platform, and provide a persistent identifier (DOI or accession number) once available.
The current statement is vague about how and when data can be accessed, which limits reproducibility.
5.
HIGHdata code
Deposit the statistical code in a public repository (e.g., Zenodo, GitHub) with a DOI and link it in the Methods/Statistical analysis section.
The code is only mentioned as an online supplement without a stable link, making it difficult for readers to access and verify the analyses.
6.
MEDIUMreporting
In the Methods, explicitly state adherence to the CONSORT reporting guideline for randomised trials and provide the CONSORT checklist as a supplement.
Reporting guidelines improve transparency and are expected for clinical trials; the paper currently does not mention one.
7.
MEDIUMstatistics
In the Methods/Statistical analysis, clarify the handling of missing data and any imputation methods used for the primary analysis.
Missing data handling is not described, which is a common reviewer concern for trial analyses.
8.
MEDIUMstatistics
In the Results, report the number of patients with missing data for each endpoint and how they were handled in the analysis.
Transparency about missing data is essential for assessing the robustness of the results.
9.
MEDIUMreporting
In the Discussion, expand on the implications of the unmet proportional hazards assumption for the interpretation of the hazard ratio.
The paper notes the assumption was unmet but does not discuss what this means for the validity of the HR estimate.
10.
MEDIUMreporting
In the Methods, specify the exact version of the trial protocol and where it can be accessed (e.g., supplementary material).
Providing the protocol version and location enhances transparency and reproducibility.
11.
MEDIUMdata code
In the Data availability statement, clarify whether the statistical code is included in the online supplement or available separately.
The current statement is ambiguous about the code's availability.
12.
MEDIUMreporting
In the Methods, state whether any data monitoring committee charter or statistical analysis plan is publicly available.
Public availability of these documents strengthens the trial's transparency.
13.
MEDIUMcopyedit
In the Abstract, Results, correct the dose unit 'g/m 2' to 'mg/m 2' for nab-paclitaxel.
The unit is missing the 'm' for milligram, which is a factual error that could mislead readers.
14.
MEDIUMcopyedit
In the Methods, Procedures, change 'to evaluated' to 'to evaluate'.
Incorrect verb form after 'to' is a grammatical error that should be fixed.
15.
MEDIUMcopyedit
In the Results, Efficacy, correct the disease control rate numbers from '1/41 (98%) v 3/40 (92.5%)' to '40/41 (98%) v 37/40 (92.5%)'.
The numerator appears to be missing a digit; the percentages indicate the correct values.
16.
LOWcopyedit
In the Discussion, Comparison with other studies, clarify that the '20% improvement' in objective response rate is an absolute difference in percentage points, not a relative improvement.
The phrase could be misinterpreted as a relative improvement, which would be misleading.
17.
LOWcopyedit
In the Discussion, ensure consistency between the percentages reported (82.9% v 62.5%) and those in the abstract/results (83% v 63%).
Minor rounding differences could confuse readers; standardize the decimal places.

Full text (38,882 chars)Analyzed: Aug 16, 2026