Intense simplified strategy for newly diagnosed type 2 diabetes in patients with severe hyperglycaemia: multicentre, open label, randomised trial.
Liu L, Ke W, Li H, Li F, Fan G, Kuang J, Ma J, Zhang X, Ji B, Li S, Du Y, Xue Y, Lyu Z, Gao L, Qu S, Shi Y, Yan L, Deng W, Xu C, Dai P, Xu L, Liu J, Wan X, Wei G, Yu S, Hong S, Zhang P, Huang Z, Cao X, Liao Z, Xiao H, Mu Y, Handelsman Y, Li Y
- DOI
- 10.1136/bmj-2024-080122
- Record issued
- 2026-08-16
- Engine
- 7.39.0
- Exported
- 2026-09-20
Prepared by Alpha1. This document is confidential: it is intended for the recipient it was shared with and must not be redistributed. The live record at alpha1science.com/verify/52badf78-74b2-4b35-a3aa-07343a728e6e is authoritative.
How this rating was calculated
- IntegrityIntegrity concern ×3−1.5★
- ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
- ClaimsTreatment effect not shown to be clinically meaningful−0.5★
- ReportingStudy design partially met−0.25★
- ReportingData & code availability partially met−0.25★
- The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 49 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.
- No data or code availability links were detected to verify.
- 01Efficacy rests on an unvalidated surrogate endpoint
The primary efficacy endpoint is HbA1c <7.0% at week 48, which is a surrogate biomarker for long-term clinical outcomes (microvascular and macrovascular complications). The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD or dose-exposure relationship) nor does it cite validated evidence linking HbA1c reduction to the specific clinical outcomes in this population. Although HbA1c is a widely accepted surrogate, the manuscript does not provide the required validation link.
“The primary outcome was the percentage of participants achieving HbA 1c <7.0% at week 48 after SIIT.”
- 02Treatment effect not shown to be clinically meaningful
The primary effect is the proportion achieving HbA1c <7.0%: 80% in the linagliptin plus metformin group vs 60% in control (absolute difference 20%, OR 2.78). While statistically significant, the clinical meaningfulness is not explicitly anchored to a minimal clinically important difference or long-term complication risk reduction. The effect is presented as a positive result without explicit anchor to clinical meaningfulness beyond statistical significance.
“80% (78/97), 72% (63/88), and 73% (69/95) of patients in the linagliptin plus metformin, linagliptin, and metformin groups, respectively, achieved HbA 1c <7.0%, compared with 60% (56/93) in the control group (P=0.02 overall; P=0.003 for linagliptin plus…”
This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.
This is a well-conducted and transparently reported multicentre randomised controlled trial with a clear scientific premise, adequate ethical approvals, and detailed reporting of biological variables and key resources. The main weaknesses are incomplete descriptions of randomization and blinding, a vague data availability statement, and minor internal inconsistencies in reporting (rounding and terminology).
Both reviewers independently classified the study as interventional and agreed on all eight dimension statuses, with minor divergence on sub-criteria (power analysis, demographics, repository/code applicability) that did not change the overall statuses. The statistics verification recomputed 4 reported tests, all consistent; the citation check found no retracted or unresolved references; the copyedit and integrity blocks flagged minor wording and rounding issues.
Numerical inconsistencies
1 finding · worst lowValues that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.
- Internal contradictions in the reported numbersAssessed
Recomputed 4 tests: 4 consistent, 0 inconsistent; 1 recomputed directly from the reported test statistics, 3 via agent-written checks.
- CONSISTENTreported p = .005 · recomputed p = .005Recomputed odds ratio 2.78 (95% CI 1.37–5.65), reported p=0.005
“odds ratio 2.78, 95% confidence interval 1.37 to 5.65; P=0.005”
Taken as given: 1.37–5.65 is a two-sided 95% confidence interval for the odds ratio of 2.78, not a range, an IQR, or a different interval level; the odds ratio is a RATIO measure, so the interval is symmetric on the log scale; p=0.005 is the p for THIS estimate, not for another comparison in the same sentenceMethod: back the two-tailed p out of the log-scale CI width and compare it against the printed pHow we recomputed it: pCI(2.78, 1.37, 5.65, 1) - CONSISTENTreported p = .005 · recomputed p = .002Reviewers 1, 2Primary outcome comparison: linagliptin plus metformin vs control for HbA1c <7.0% at week 48.
“80% (78/97) in the linagliptin plus metformin group ... 60% (56/93) in the control group (P=0.02 overall; P=0.003 for linagliptin plus metformin versus control)”
Taken as given: The numbers 78 and 97 are the event count and group total for the linagliptin plus metformin group.; The numbers 56 and 93 are the event count and group total for the control group.; The test used is Pearson's chi-square test for a 2x2 table.Method: Pearson's chi-square test on the 2x2 table (78, 19, 56, 37) to compute the two-tailed p-value.How we recomputed it: pChi2x2(78, 97-78, 56, 93-56) - CONSISTENTreported p = .120 · recomputed p = .107Reviewers 1, 2Primary outcome comparison: linagliptin vs control for HbA1c <7.0% at week 48.
“72% (63/88) in the linagliptin group ... 60% (56/93) in the control group (P=0.12 for linagliptin versus control)”
Taken as given: The numbers 63 and 88 are the event count and group total for the linagliptin group.; The numbers 56 and 93 are the event count and group total for the control group.; The test used is Pearson's chi-square test for a 2x2 table.Method: Pearson's chi-square test on the 2x2 table (63, 25, 56, 37) to compute the two-tailed p-value.How we recomputed it: pChi2x2(63, 88-63, 56, 93-56) - CONSISTENTreported p = .090 · recomputed p = .071Reviewers 1, 2Primary outcome comparison: metformin vs control for HbA1c <7.0% at week 48.
“73% (69/95) in the metformin group ... 60% (56/93) in the control group (P=0.09 for metformin versus control)”
Taken as given: The numbers 69 and 95 are the event count and group total for the metformin group.; The numbers 56 and 93 are the event count and group total for the control group.; The test used is Pearson's chi-square test for a 2x2 table.Method: Pearson's chi-square test on the 2x2 table (69, 26, 56, 37) to compute the two-tailed p-value.How we recomputed it: pChi2x2(69, 95-69, 56, 93-56)
- lowinternal contradictionThe abstract reports 80% (78/97) for the linagliptin plus metformin group achieving HbA1c <7.0%, while the results text reports 80.4% (78/97) and the discussion reports 80.4%. This is a minor rounding inconsistency.
80% (78/97) ... in the linagliptin plus metformin group ... achieved HbA 1c <7.0%
Abstractreviewer’s wording
Overstated conclusions
3 findings · worst highConclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.
- Efficacy rests on an unvalidated surrogate endpointAssessed
- Treatment effect not shown to be clinically meaningfulAssessed
- Conclusions only partially backed by the presented evidenceAssessed
4 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.
- partialReviewers 1, 2The intense simplified strategy provides an effective, safe, and affordable approach for patients with newly diagnosed type 2 diabetes and significant hyperglycaemia.The study demonstrates efficacy and safety, but affordability is not directly assessed in the trial; it is inferred from the use of generic drugs. The claim is partially supported.Evidence: Efficacy and safety results, but no cost-effectiveness analysis.
Taken together, the intense simplified strategy provides an effective, safe, and affordable approach for patients with newly diagnosed type 2 diabetes and significant hyperglycaemia.
Discussionreviewer’s wording - supportedReviewers 1, 2The intense simplified strategy using subsequent oral therapies post-SIIT, especially the linagliptin plus metformin combination, sustainably improved glycaemic control and β cell function in patients with newly diagnosed type 2 diabetes mellitus and severe hyperglycaemia.The primary endpoint (HbA1c <7.0% at week 48) was significantly higher in the linagliptin plus metformin group compared to control (OR 2.78, 95% CI 1.37-5.65, P=0.005), and β cell function indices (ISSI-2) improved significantly. The evidence supports the claim.Evidence: Primary outcome results and ISSI-2 improvements at week 48.
“The intense simplified strategy using subsequent oral therapies post-SIIT, especially the linagliptin plus metformin combination, sustainably improved glycaemic control and β cell function in patients with newly diagnosed type 2 diabetes mellitus and severe hyperglycaemia.”
ConclusionFind in source - supportedReviewers 1, 2The linagliptin plus metformin group showed the most significant improvement in fasting plasma glucose and β cell function indices.The results show the linagliptin plus metformin group had the lowest fasting plasma glucose and highest ISSI-2 at week 48, with significant differences compared to control. The evidence supports the claim.Evidence: Table 2 and Figure 6 show FPG and ISSI-2 improvements.
“Moreover, the linagliptin plus metformin group showed the most significant improvement in fasting plasma glucose and β cell function indices.”
AbstractFind in source - supportedReviewers 1, 2All treatments were well tolerated.The safety results report no severe hypoglycaemia, low rates of adverse events, and few withdrawals due to side effects. The evidence supports the claim.Evidence: Safety section reports no severe hypoglycaemia and low adverse event rates.
“All treatments were well tolerated.”
AbstractFind in source
Premise concern: surrogate not validated for clinical benefit; effect size not shown to be clinically meaningful.
- INADEQUATESurrogate endpointThe primary efficacy endpoint is HbA1c <7.0% at week 48, which is a surrogate biomarker for long-term clinical outcomes (microvascular and macrovascular complications). The paper does not demonstrate target engagement at the tested dose (e.g., PK/PD or dose-exposure relationship) nor does it cite validated evidence linking HbA1c reduction to the specific clinical outcomes in this population. Although HbA1c is a widely accepted surrogate, the manuscript does not provide the required validation link.
“The primary outcome was the percentage of participants achieving HbA 1c <7.0% at week 48 after SIIT.”
- INADEQUATEEffect sizeThe primary effect is the proportion achieving HbA1c <7.0%: 80% in the linagliptin plus metformin group vs 60% in control (absolute difference 20%, OR 2.78). While statistically significant, the clinical meaningfulness is not explicitly anchored to a minimal clinically important difference or long-term complication risk reduction. The effect is presented as a positive result without explicit anchor to clinical meaningfulness beyond statistical significance.
“80% (78/97), 72% (63/88), and 73% (69/95) of patients in the linagliptin plus metformin, linagliptin, and metformin groups, respectively, achieved HbA 1c <7.0%, compared with 60% (56/93) in the control group (P=0.02 overall; P=0.003 for linagliptin plus metformin versus control”
Data authenticity concerns
1 finding · worst lowAn adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.
- Methods and results do not matchAssessed
3 integrity concerns flagged (0 high).
- lowmethod result mismatchThe statistical analysis section states 'we used a logistic regression model to calculate the risk ratio', but logistic regression typically yields odds ratios, and the results report odds ratios. This is a minor methodological wording issue.
we used a logistic regression model to calculate the risk ratio in the primary endpoint between the treatment groups.
Statistical analysisreviewer’s wording - lowmethod result mismatchThe Methods state that a logistic regression model was used to calculate the risk ratio, but the Results report odds ratios. This is a terminology inconsistency.
Methods: 'used a logistic regression model to calculate the risk ratio in the primary endpoint' ; Results: 'odds ratio 2.78, 95% confidence interval (CI) 1.37 to 5.65'
Statistical analysisreviewer’s wording
Reporting gaps
2 findings · worst mediumRequired detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.
- Data/code availability incompleteAssessed
- Study-design details incomplete (controls, blinding, power)Assessed
The introduction cites the International Diabetes Federation prevalence data, the legacy effect, the UK Prospective Diabetes Study, and prior SIIT studies, acknowledging both benefits and the decline in remission over time. The rationale for the intense simplified strategy is clearly articulated, and the hypothesis follows logically from the cited evidence. Limitations of prior research (e.g., declining remission rates) are explicitly addressed as the motivation for the study.
“As discovered recently by the 24 year follow-up of the UK Prospective Diabetes Study, early intensive glycaemic control provides a near lifelong reduction in the risk of death and of microvascular and macrovascular complications.”
“This provides a rationale for investigating whether simplified oral regimens subsequent to SIIT could help to maintain the good glycaemic control induced by SIIT by persistently avoiding the detrimental effects of glucotoxicity and circumventing the disadvantages of intricate glucose lowering regimens.”
“Nevertheless, the remission rate declined over time, from 70% immediately after SIIT to roughly 50% at the end of the first year and around 40% at the end of the second year.”
“As discovered recently by the 24 year follow-up of the UK Prospective Diabetes Study, early intensive glycaemic control provides a near lifelong reduction in the risk of death and of microvascular and macrovascular complications.”
“We hypothesised that this strategy could improve glycaemic control and preserve β cell function in patients with newly diagnosed type 2 diabetes and severe hyperglycaemia.”
“Nevertheless, the remission rate declined over time, from 70% immediately after SIIT to roughly 50% at the end of the first year and around 40% at the end of the second year.”
Randomization used sealed envelopes prepared by a statistician, but the method of sequence generation (e.g., random number generator) is not stated, and allocation concealment is not fully described. The trial is open-label with no blinding of participants or investigators, though the rationale is partially addressed in the limitations. The power analysis is reported with a type I error of 2.5% one-sided, but the sample size calculation appears to use a one-sided test while the primary analysis uses two-sided tests, which is a minor inconsistency. Inclusion/exclusion criteria are well-defined, and the analysis population (full analysis set, per protocol) is pre-specified. Outlier handling is not explicitly described, but missing data handling via multiple imputation is reported.
“A statistician not involved in the study encoded and prepared random envelopes, which were then distributed to each centre and stored by the file administrator.”
“This is an open label, nationwide, multicentre, randomised controlled trial conducted across 15 centres in China.”
“This calculation assumed that 75% of participants in the intervention group and 55% in the control group would achieve this endpoint with a type I error of 2.5% in the one sided test.”
“A statistician not involved in the study encoded and prepared random envelopes, which were then distributed to each centre and stored by the file administrator.”
“This is an open label, nationwide, multicentre, randomised controlled trial conducted across 15 centres in China.”
“Sample size estimation suggested that 89 participants per group could provide 80% power to detect a 20% higher probability of achieving HbA 1c <7.0% in the linagliptin plus metformin group versus the control group at week 48.”
Sex is reported for all participants (75% male, 25% female), and age, BMI, and health status are reported in baseline characteristics. Since both sexes are enrolled, a scientific justification for single-sex is not applicable. Demographics include age, sex, and disease duration, but race/ethnicity is not reported (though the study is in China). Species/strain and housing conditions are not applicable for a human trial.
“The participants had an average age of 46.8 (standard deviation (SD) 11.2) years, a mean body mass index of 25.8 (2.9)”
“Among the randomised participants, 75% (311/412) had a disease duration of less than six months and 25% (101/412) had a duration of six months or more”
“The participants had an average age of 46.8 (standard deviation (SD) 11.2) years, a mean body mass index of 25.8 (2.9)”
The study was approved by the research ethics board of First Affiliated Hospital of Sun Yat-sen University (protocol number 2016-146). Written informed consent was obtained from all participants. The trial followed the Declaration of Helsinki and Good Clinical Practice guidelines. All applicable criteria are met.
“This study was approved by the research ethics board of First Affiliated Hospital of Sun Yat-sen University (2016-146).”
“Written informed consent was obtained from all participants.”
“The trial followed the principles of the Declaration of Helsinki and Good Clinical Practice guidelines of the International Conference for Harmonization.”
“This study was approved by the research ethics board of First Affiliated Hospital of Sun Yat-sen University (2016-146).”
“Written informed consent was obtained from all participants.”
“The trial followed the principles of the Declaration of Helsinki and Good Clinical Practice guidelines of the International Conference for Harmonization.”
The investigational products (linagliptin and metformin) are identified with brand names and manufacturers. The insulin pump and biochemical assays are identified with manufacturers. Statistical software (SPSS and GraphPad Prism) is identified with versions. Antibodies, cell lines, and mycoplasma testing are not applicable as this is a clinical trial without wet-lab assays.
“linagliptin (5 mg/day; Trajenta, Boehringer-Ingelheim, Germany) and metformin (1000 mg/day; Glucophage, Merck Serono, Switzerland)”
“We used SPSS version 19.0 and GraphPad Prism version 9.0 for statistical procedures.”
“participants randomised to the linagliptin plus metformin group received both linagliptin (5 mg/day; Trajenta, Boehringer-Ingelheim, Germany) and metformin (1000 mg/day; Glucophage, Merck Serono, Switzerland)”
“We used SPSS version 19.0 and GraphPad Prism version 9.0 for statistical procedures.”
Statistical tests are named (χ² test, Fisher's exact test, ANOVA, Kruskal-Wallis, GEE, log-rank, logistic regression). Effect sizes with confidence intervals are reported for the primary outcome. Software is identified. Data presentation includes per-group n and confidence intervals. Exact p-values are reported for many comparisons, but some are reported as thresholds (e.g., P<0.001). Assumptions are not explicitly verified, but the use of standard methods and large sample size makes this acceptable. Mathematical plausibility checks were not possible for most continuous outcomes, but no obvious errors were found.
“we applied generalised linear models for continuous variables and used the χ 2 test or Fisher’s exact test for categorical variables.”
“odds ratio 2.78, 95% confidence interval (CI) 1.37 to 5.65; P=0.005”
“P<0.001 for linagliptin plus metformin versus control”
“For comparisons of trial outcomes among treatment groups, we applied generalised linear models for continuous variables and used the χ 2 test or Fisher’s exact test for categorical variables.”
“the linagliptin plus metformin group (odds ratio 2.78, 95% confidence interval (CI) 1.37 to 5.65; P=0.005)”
“P=0.02 overall; P=0.003 for linagliptin plus metformin versus control”
The data availability statement says data can be requested from the corresponding author, with de-identified participant data and other datasets available on request, but does not specify a platform, conditions, or timeframe. This is reported_but_inadequate. No repository deposit or accession numbers are provided, which is acceptable for patient-level data. No custom code is mentioned.
“Data from this study can be requested from the corresponding author (liyb@mail.sysu.edu.cn) after its publication.”
“Data from this study can be requested from the corresponding author (liyb@mail.sysu.edu.cn) after its publication. Requests can be made for de-identified participant data, the data dictionary, and other specified datasets.”
The trial is registered (NCT03194945). Funding sources and competing interests are declared. Limitations are discussed, including lack of blinding and higher-than-expected attrition. Conclusions are proportional to the evidence. Methods are detailed enough for replication. No reporting guideline (e.g., CONSORT) is explicitly mentioned, but the paper follows a structured format.
“Trial registration ClinicalTrials.gov NCT03194945”
“The intervention was not blinded. Nevertheless, the fact that the primary and secondary endpoints were generated from biochemical measurements by blinded technical staff reduces potential bias.”
“Trial registration ClinicalTrials.gov NCT03194945 (https://clinicaltrials.gov/ct2/show/NCT03194945)”
“The intervention was not blinded. Nevertheless, the fact that the primary and secondary endpoints were generated from biochemical measurements by blinded technical staff reduces potential bias.”
Registered (1 ID: ClinicalTrials.gov). No reporting guideline cited.
Broken references and links
None found · partly checkedReferences checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.
Nothing surfaced — but not everything feeding this category ran (missing: data/code link verification), so read this as a partial clean bill.
Checked 34 references by DOI: 33 verified — 1 no DOI (shown, not verified).
- NO DOIChinese guideline for the prevention and treatment of type 2 diabetes mellitus (2020 edition)No DOI in the reference — shown for manual review; not independently verifiable (not a fabrication signal).
Copyediting
5 minorWording, consistency and formatting errors that need correcting before submission.
No major wording or formatting errors. 5 minor suggestions below.
5 copyedit issues flagged: mostly consistency, clarity, typo.
- MINORtypoAuthor affiliations“Shenzen”→ ShenzhenMisspelling of city name.
- MINORconsistencyResults, HbA1c control“80% (78/97)”→ 80.4% (78/97)Abstract reports 80%, results text reports 80.4% for the same group; consider consistent rounding.
- MINORclarityMethods, Statistical analysis“we used a logistic regression model to calculate the risk ratio”→ we used a logistic regression model to calculate the odds ratioLogistic regression typically yields odds ratios, not risk ratios; clarify.
- MINORconsistencyAbstract and Results“80% (78/97)”→ 80.4% (78/97)Abstract reports 80% while Discussion reports 80.4%; consider consistent rounding.
- MINORclarityMethods, Statistical analysis“We compared Kaplan-Meier curves with log-rank tests and used a logistic regression model to calculate the risk ratio in the primary endpoint between the treatment groups.”→ Clarify that logistic regression was used to calculate odds ratios, not risk ratios.The text says 'risk ratio' but the results report odds ratios.
The published work is robust and generally trustworthy, but an informed reader should weigh the incomplete randomization/blinding descriptions and the vague data availability statement as minor limitations. The minor internal inconsistencies (80% vs 80.4%, 'risk ratio' vs 'odds ratio') are cosmetic and do not undermine the conclusions, but they would warrant a correction or clarification if the authors wish to maintain the highest reporting standards.
- 1.HIGHreportingIn the Methods (Randomisation and masking), specify the random sequence generation method (e.g., computer-generated random numbers) and describe allocation concealment in more detail.The current description of sealed envelopes lacks the sequence generation method, which is a CONSORT requirement and a common reviewer concern.
- 2.HIGHreportingIn the Methods (Study design and participants), add a rationale for the open-label design or state why blinding was not feasible.The open-label design is a potential source of bias, and an explicit rationale would strengthen the reporting.
- 3.HIGHstatisticsIn the Methods (Statistical analysis), clarify whether the sample size calculation used a one-sided or two-sided test and align it with the primary analysis.The power analysis uses a one-sided test while the primary analysis uses two-sided tests, which is an inconsistency that could affect interpretation of the study's power.
- 4.HIGHdata codeIn the Data availability statement, provide a concrete access mechanism (e.g., a data access committee or a repository like Vivli) and specify a timeframe for responding to requests.The current 'on request' statement is vague and does not meet the standard for clinical trial data sharing.
- 5.MEDIUMcopyeditIn the Methods (Statistical analysis), correct the terminology from 'risk ratio' to 'odds ratio' to match the reported results.Logistic regression yields odds ratios, and the current wording is inconsistent with the results and could confuse readers.
- 6.MEDIUMcopyeditIn the Abstract and Results, standardize the rounding of the primary outcome percentage (80% vs 80.4%) to a single consistent value.The inconsistent rounding between the abstract and results text is a minor but avoidable inconsistency.
- 7.MEDIUMreportingIn the Methods or a supplementary file, include a completed CONSORT checklist and a statement of adherence to the guideline.No reporting guideline is mentioned, and a CONSORT checklist would improve transparency and reproducibility.
- 8.MEDIUMstatisticsIn the Methods (Statistical analysis), explicitly state how test assumptions (normality, equal variance) were checked or why they were not.The assumptions_verified sub-criterion is currently reported_but_inadequate, and adding this detail would strengthen the statistical reporting.
- 9.MEDIUMstatisticsIn the Results, report exact p-values for all comparisons where possible, rather than thresholds like P<0.001.Threshold-only p-values are less informative and reduce transparency.
- 10.MEDIUMreportingIn the Discussion, add a note on the generalizability of the findings to other ethnic populations, as the study was conducted only in China.The lack of racial/ethnic diversity is a limitation that should be acknowledged for readers applying the results to other populations.
- 11.LOWcopyeditIn the Author affiliations, correct the misspelling of 'Shenzen' to 'Shenzhen'.This is a minor typo that should be fixed for professionalism.
- 12.LOWdata codeConsider depositing the statistical analysis plan and protocol in a public repository (e.g., ClinicalTrials.gov already has the registration, but a protocol repository would be helpful).This would enhance transparency and allow readers to verify the pre-specified analyses.
The star rating is the report’s one-glance summary. Every paper starts at 5★ and loses stars for the concrete problems the review finds — so a rating is never a vague average, it’s a running total you can read line by line under “How this rating was calculated.”
- Reporting — 8 dimensionseach dimension that fully fails−½★
- each dimension partially met−¼★
- Statistics · Integrity · Claimseach serious problem−1★
- each medium problem−½★
- Citationseach retracted or unverifiable reference−¼★
- Copyeditonly when the manuscript needs a full edit−½★
The rating never drops below 1★, and a demonstrable critical failure (an impossible statistic, a proven ethics violation) caps it at 1★ on its own — so the stars can never look healthy when the verdict is CRITICAL.
The rating draws on a panel of agents. Three independent Kaimen Rigor reviewers grade the eight dimensions below across several independent passes (the shown verdict is their majority vote — steadier than any single run), isolate the paper’s major claims and check its own evidence backs them, and flag integrity concerns. Alongside them, a citation agent resolves every reference against Crossref, OpenAlex, and Retraction Watch; a statistics agent recomputes reported tests; and rule-based checks verify that declared data/code links actually resolve. Full text is required — an abstract-only submission is not analyzed.
Graded against NIH, MDAR, ARRIVE 2.0, CONSORT, EQUATOR, and RRID guidelines. A dimension that doesn’t apply to the study type is skipped, never penalized.
This Kaimen Rigor review is model-assisted and is not a substitute for formal expert review. It complements human evaluation by surfacing potential methodological concerns — verify each finding against the source.