Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.

Name: Kaimen Rigor review — Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.
Item: Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.
Rating: 96
Author: Alpha1

Pasqua MR, Tsoukas MA, Kobayati A, Aboznadah W, Jafar A, Haidar A

Paper source

Read full text (PMC)

Embed this Rigor badge

Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 4 high issues for “Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.”

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Read alongside

Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.

Pasqua MR, Tsoukas MA, Kobayati A, Aboznadah W, Jafar A, Haidar A

Read full text (PMC)

DOI

10.1038/s41591-024-03463-z

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/f1f7aa98-048a-4919-a9c7-59c7033cc002" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/f1f7aa98-048a-4919-a9c7-59c7033cc002/badge" alt="Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 4 high issues for “Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d4910b1960b2135493902ea5dd14479bfd5b4ca370614b6e22cc613758ac10c5

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Alpha¹ by Kaimen

Fetching the latest research

Kaimen Rigor reviewed

Rigor-Reviewed Manuscript

Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.

Pasqua MR, Tsoukas MA, Kobayati A, Aboznadah W, Jafar A, Haidar A

Paper source

Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.

Read full text (PMC)

Embed this Rigor badge

Links back to this Kaimen Rigor review.

Alpha1 Editorial

This rigor review was examined and confirmed by Alpha1 Editorial · August 15, 2026

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

Statistics were not checked: no recomputable values were found in this text — no test statistic reported with its degrees of freedom, no effect estimate printed with both a 95% CI and a p-value, and no percentage printed with both its count and its denominator.
The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 52 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on time in range (TIR), a continuous glucose monitoring metric, which is a surrogate for glycemic control. Although the paper cites consensus guidelines that TIR is associated with HbA1c and clinical outcomes, it does not demonstrate target engagement of semaglutide at the tested dose (e.g., pharmacokinetic/pharmacodynamic data) nor provide a validated link between the observed TIR improvement and hard clinical outcomes such as microvascular complications. The improvement in TIR is presented as a clinical benefit without direct evidence that it translates to reduced long-term complications.
“The primary outcome was the percentage of time spent in the target glucose range of 3.9–10.0 mmol l −1 during the last 4 weeks of each intervention.”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

This Kaimen Rigor review uses Kaimen Rigor reviewers trained on a curated corpus of high-fidelity and retracted papers, with expert supervision and curation. It can still make mistakes; verify each finding against the source before relying on it.

This is a well-conducted and well-reported randomized crossover trial with strong methodological rigor across most dimensions. The main weakness is the data and code availability, which is vague and conditional, and there are minor internal inconsistencies in the reported numbers that warrant correction.

Both reviewers agreed on study type (interventional) and on all dimension statuses except minor sub-criterion differences (outlier handling, data statement adequacy). The statistics verification component had limited coverage (0 tests recomputed), so statistical correctness is not fully verified. The copyedit and integrity checks flagged minor internal inconsistencies.

Numerical inconsistencies

1 finding · worst low

Values that contradict each other or are impossible for the stated sample: recomputed p-values and test statistics, GRIM/GRIMMER checks on summary numbers, percentages against their own counts, totals against their parts, and estimates against their own confidence intervals.

Internal contradictions in the reported numbersAssessed

Overstated conclusions

2 findings · worst high

Conclusions that reach past what the paper's own results support — including a significance claim that no longer holds when the statistic is recomputed, and efficacy resting on an unvalidated surrogate endpoint.

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit.

Data authenticity concerns

1 finding · worst low

An adversarial read for patterns associated with data that may not be genuine: results that look too clean, implausibly large effects, duplicated data or images, and methods that do not match the results reported.

Implausibly large reported effectAssessed

2 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Required detail the manuscript never states — study design, biological variables, ethics approval and consent, key resources, statistical reporting, data and code availability, and overall transparency.

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Prior work is cited extensively, including references on AID limitations (refs 5-7), obesity in T1D (refs 8-14), and semaglutide's glycemic/weight benefits in T2D (refs 16-18). The rationale linking semaglutide's potential to improve postprandial control and weight in T1D is clearly stated. Limitations of prior research (e.g., no clinical trials of semaglutide in T1D, only retrospective data) are acknowledged, and the study addresses this gap.

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The paper clearly establishes the scientific premise by citing prior work on automated insulin delivery limitations, obesity in T1D, and semaglutide's benefits in T2D, with a logical rationale linking these to the study objectives.

Evidence

paraphrase[Main, paragraph 1-2]

“However, in large randomized trials assessing AID use, 34–53% of participants were still not able to achieve an HbA1c of less than 7%... Semaglutide has demonstrated glycemic, weight and cardiac benefits in those with and without type 2 diabetes (T2D).”

“The aim of this study was to assess whether semaglutide, versus placebo, improves glycemic control and other nonglycemic outcomes in those with T1D while using AID.”

Main, paragraph 2Find in source

paraphrase[Main, paragraph 2]

“Although semaglutide has not yet been assessed in T1D in clinical trials, retrospective data of off-label use has suggested benefits...”

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise, citing prior work on AID limitations and semaglutide benefits in T2D, and provides a logical rationale for the trial.

Evidence

“However, in large randomized trials assessing AID use, 34–53% of participants were still not able to achieve an HbA1c of less than 7%”

Main, paragraph 1Find in source

“The aim of this study was to assess whether semaglutide, versus placebo, improves glycemic control and other nonglycemic outcomes in those with T1D while using AID.”

Main, paragraph 2Find in source

“Although semaglutide has not yet been assessed in T1D in clinical trials, retrospective data of off-label use has suggested benefits”

Main, paragraph 2Find in source

Randomization method (block randomization with random block sizes) and unit (participant) are reported. Blinding is double-blind with clear masking procedures (research pharmacy unblinded, participants/investigators blinded). A priori power analysis is provided (23 participants for 80% power, 28 recruited for 20% dropout). Inclusion/exclusion criteria are detailed. Outlier handling is not explicitly described but the analysis uses a linear mixed model which is robust; no specific outlier handling is reported. Controls are appropriate (placebo). Independent replication is not applicable for a single pivotal trial. Replicate distinction is not applicable for a human RCT.

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingNOT REPORTED

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and inclusion/exclusion criteria. Applicable sub-criteria are well-reported.

Evidence

paraphrase[Methods, Randomization and masking]

“Block randomization was performed with randomly selected block sizes of 4, 6 or 8 by a researcher uninvolved with participants using the Sealed Envelope Ltd online tool.”

“Participants, investigators and other research personnel were blinded to allocation.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Assuming an s.d. of 10% in the difference... 23 participants would provide 80% power to detect this difference at a 5% significance level. To account for a 20% dropout rate, 28 participants were recruited.”

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, crossover, with block randomization, a priori power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

paraphrase[Methods, Randomization and masking]

“Block randomization was performed with randomly selected block sizes of 4, 6 or 8 by a researcher uninvolved with participants using the Sealed Envelope Ltd online tool.”

“Participants, investigators and other research personnel were blinded to allocation.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Assuming an s.d. of 10% in the difference, 23 participants would provide 80% power to detect this difference at a 5% significance level.”

Sex is reported (61% female). Age, weight (BMI), and health status (HbA1c, C-peptide) are reported. Demographics including age, sex, race/ethnicity (not explicitly reported but Canadian context), and comorbidities (obesity, retinopathy) are provided. Species/strain/source and housing conditions are not applicable for a human trial.

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Biological variables are well-reported for a human trial, including sex, age, BMI, and other demographics. Sex justification is not applicable as both sexes are enrolled.

Evidence

paraphrase[Table 1]

“Female sex (n (%)) 17 (61) | Age in years (mean (s.d.)) 45 (14)”

paraphrase[Table 1]

“BMI (kg m−2) 32.2 (5.1) | HbA1c in % (mean (s.d.)) 7.4 (0.8)”

PASSReviewer 2· 90% conf

Biological variables are well reported: sex, age, BMI, diabetes duration, and other demographics are provided in Table 1.

Evidence

paraphrase[Results, Participant disposition]

“28 participants (61% female, aged 45 (s.d. = 14) years, with an HbA1c of 7.4% (0.8%); Table 1)”

paraphrase[Table 1]

“BMI (kg m−2) | 32.2 (5.1)”

The protocol was approved by the research ethics board of the McGill University Health Centre and Health Canada. Informed consent is explicitly mentioned ('written informed consent was obtained and documented'). Regulatory compliance is implied through ethics board approval and Health Canada authorization. The study is registered on ClinicalTrials.gov.

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are adequately reported: a named ethics board approved the study, informed consent was obtained, and regulatory compliance is stated.

Evidence

paraphrase[Methods, Study design]

“The protocol was approved by the research ethics board of the McGill University Health Centre and Health Canada.”

“At the initial visit, study procedures began after written informed consent was obtained and documented.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethics approval and informed consent are clearly documented.

Evidence

“The protocol was approved by the research ethics board of the McGill University Health Centre and Health Canada”

MethodsFind in source

“At the initial visit, study procedures began after written informed consent was obtained and documented.”

MethodsFind in source

The investigational product (semaglutide) is identified by name and manufacturer (Novo Nordisk implied). Placebo (saline) is described. Software tools are identified: MATLAB v.R2024a, SPSS v.29.0.1.1, Sealed Envelope online tool. Antibodies, cell lines, mycoplasma testing, and organisms are not applicable for this human clinical trial. Reagents are not applicable beyond the drug.

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Key resources are adequately identified: the investigational product (semaglutide/placebo) is described, and software tools are identified with versions.

Evidence

paraphrase[Methods, Procedures]

“Semaglutide or placebo (saline) in sterile amber glass vials were given to participants, along with insulin syringes, dispensed by the research pharmacy.”

“Data processing was performed using MATLAB (v.R2024a); statistical analysis were performed with SPSS (v.29.0.1.1).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (semaglutide) and key devices are identified, and software is named with versions.

Evidence

paraphrase[Methods, Procedures]

“The system included an Ypsomed pump (Ypsomed), Dexcom G6 CGM (Dexcom) and a Pixel 2 smartphone with an application running the McGill insulin dosing algorithm.”

“Data processing was performed using MATLAB (v.R2024a); statistical analysis were performed with SPSS (v.29.0.1.1).”

Statistical analysisFind in source

Tests are named (linear mixed model, Wilcoxon signed-rank, chi-squared). Assumptions are verified (residuals examined for normality). Exact p-values are reported (e.g., P=0.006). Effect sizes with confidence intervals are provided (e.g., mean difference 4.8 (7.6) percentage points). Software is identified. Data presentation includes individual data points in scatterplots (Extended Data Fig. 2) and per-group n stated. Mathematical plausibility is not independently verifiable for all outcomes but no obvious errors are detected.

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Statistical analysis is rigorous: tests are named, assumptions are verified, exact p-values are reported, effect sizes with confidence intervals are provided, and data presentation is adequate.

Evidence

paraphrase[Methods, Statistical analysis]

“A linear mixed effects model was used to assess the effects of treatment while adjusting for the order of interventions. ... Residual values were examined for normality and, if skewed, a Wilcoxon signed-rank test was used.”

“Target 3.9–10.0 | 69.4 (10.4) | 74.2 (9.7) | 4.8 (7.6) | 0.006”

Table 2Find in source

PASSReviewer 2· 85% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with CIs; no arithmetic errors detected.

Evidence

“A two-sided linear mixed model was used for the parametric analyses, while a Wilcoxon signed-ranked test was used for the nonparametric analysis.”

Table 2Find in source

paraphrase[Results, Primary outcome]

“a difference of 4.8 (7.6) percentage points (P = 0.006)”

paraphrase[Table 2]

“Total insulin (U day−1) | 62.1 [38.8, 85.1] | 46.1 [32.7, 62.7] | −11.3 [−23.6, −4.9] | <0.001”

Data availability statement is present but vague: raw data cannot be made publicly available due to consent/ethics limitations, but can be shared on request subject to ethics board approval. This is reported_but_inadequate because no platform or timeframe is specified (though 'within 3 months' is mentioned after approval). Code availability is conditional on data sharing, which is inadequate. Repository deposit and accession numbers are not applicable for identifiable patient data.

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 95% conf

A data availability statement is present but vague ('available on reasonable request' with no platform or timeframe), and code availability is conditional on data sharing, which is inadequate.

Evidence

“All raw data collected from the study cannot be made publicly available given limitations from the informed consent form and ethics board approval. The raw data can be shared by the corresponding authors without cost for unrestricted noncommercial purposes; however, the use will be subject to approval from the Research Ethics Board of the McGill University Health Centre.”

Data availabilityFind in source

paraphrase[Code availability]

“The code used for data processing will be made available when the raw data are shared as per the 'Data availability' statement.”

WARNReviewer 2· 90% conf

Data availability statement is present but vague; code availability is conditional on data sharing.

Evidence

“The raw data can be shared by the corresponding authors without cost for unrestricted noncommercial purposes; however, the use will be subject to approval from the Research Ethics Board of the McGill University Health Centre.”

Data availabilityFind in source

“The code used for data processing will be made available when the raw data are shared as per the ‘Data availability’ statement.”

Data availabilityFind in source

Methods are detailed enough for replication. Trial registration is provided (NCT05205928). CONSORT flow chart is included (reporting guideline). All pre-specified outcomes are reported, including negative/null results (e.g., no difference in hypoglycemia). Limitations are discussed (sample size, crossover design, generalizability). Conclusions are proportional (acknowledges need for larger studies). Funding and COI are stated.

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Reporting is transparent: methods are detailed, trial is registered, a reporting guideline is referenced, all outcomes are reported, limitations are discussed, conclusions are proportional, and funding/COI are stated.

Evidence

“ClinicalTrials.gov registration: NCT05205928”

AbstractFind in source

“The Consolidated Standards of Reporting Trials (CONSORT) flow chart is depicted in Fig.”

ResultsFind in source

“First, the study size and length were not sufficient to assess long-term efficacy and safety.”

DiscussionFind in source

PASSReviewer 2· 90% conf

Reporting is transparent: trial registered, CONSORT flow diagram, limitations discussed, conclusions proportional, funding and COI disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05205928”

AbstractFind in source

“First, the study size and length were not sufficient to assess long-term efficacy and safety.”

Discussion ¶7Find in source

“This study was funded by the Canada Research Chair in Artificial Pancreas Systems held by A.H.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 48 references by DOI: 1 verified — 47 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

The published work is robust overall, but readers should weigh the vague data/code availability and the minor internal inconsistencies (C-peptide counts, triglyceride CI) when interpreting results. These issues are not validity threats but warrant correction or clarification, possibly through an erratum.

1.
HIGHdata code
Deposit the custom data-processing code in a public repository (e.g., Zenodo or GitHub with a DOI) and provide a direct link in the Code Availability statement, independent of data sharing.
The current code availability is conditional on data sharing, which is inadequate for reproducibility.
2.
HIGHdata code
Clarify the data access mechanism in the Data Availability statement by specifying a managed-access platform (e.g., Vivli) or a clear request process with a defined review timeline and contact email.
The current statement is vague and lacks a concrete platform or timeframe, making it difficult for readers to request data.
3.
HIGHrigor
Reconcile the discrepancy in the number of participants with detectable C-peptide at baseline: Table 1 reports 8 (29%) while the Results text reports 6 (25%).
This internal contradiction undermines data integrity and could confuse readers; it should be corrected in an erratum.
4.
HIGHstatistics
Verify and correct the triglyceride confidence interval in Table 3, which has a negative lower bound (1.17 [−0.63, 1.33]) that is implausible for a concentration.
An impossible confidence interval suggests a data entry or calculation error that needs correction.
5.
MEDIUMreporting
Add an explicit statement in the Methods that the study followed the Declaration of Helsinki and/or ICH-GCP guidelines.
Strengthens the regulatory compliance reporting, which is currently only implied.
6.
MEDIUMreporting
Explicitly state in the Methods that the CONSORT reporting guideline was followed, in addition to including the flow diagram.
Makes adherence to reporting guidelines explicit and unambiguous.
7.
MEDIUMother
Describe how outliers were defined and handled in the statistical analysis, or state that no outliers were excluded.
Outlier handling is not explicitly reported, which is a minor reporting gap.
8.
MEDIUMcopyedit
Fix the subject-verb agreement error in the Methods: 'statistical analysis were performed' should be 'statistical analysis was performed'.
Minor grammatical error that should be corrected for professionalism.
9.
MEDIUMstatistics
Clarify in the Methods whether the Wilcoxon signed-rank test was used for the primary analysis or only as a sensitivity analysis when residuals were skewed.
The current wording is ambiguous about the role of the nonparametric test in the analysis plan.
10.
LOWreporting
Add a statement on race/ethnicity demographics to the baseline table or participant disposition to improve generalizability assessment.
Race/ethnicity is not reported, which limits the ability to assess external validity.
11.
LOWdata code
Consider depositing de-identified aggregate data or derived metrics in a public repository to enhance transparency, if ethically permissible.
Would improve data availability beyond the current on-request model.

Full text (49,867 chars)Analyzed: Aug 15, 2026

Start the discussion on JRNLClub

Community discussion on jrnlclub.com

Read alongside

Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.

Pasqua MR, Tsoukas MA, Kobayati A, Aboznadah W, Jafar A, Haidar A

Read full text (PMC)

DOI

10.1038/s41591-024-03463-z

Share this Kaimen Rigor review

Post on X Share on LinkedIn Share via Email

Embed this Rigor badge

<a href="https://alpha1science.com/verify/f1f7aa98-048a-4919-a9c7-59c7033cc002" target="_blank" rel="noopener">
  <img src="https://alpha1science.com/verify/f1f7aa98-048a-4919-a9c7-59c7033cc002/badge" alt="Kaimen Rigor review — 3.25★ (Adequate), 0 critical, 4 high issues for “Subcutaneous weekly semaglutide with automated insulin delivery in type 1 diabetes: a double-blind, randomized, crossover trial.”" width="440" height="104" style="max-width:100%;height:auto" />
</a>

Every embed links back to this Kaimen Rigor review.

Record fingerprint

d4910b1960b2135493902ea5dd14479bfd5b4ca370614b6e22cc613758ac10c5

Verify via API

Issued Aug 15, 2026Engine 7.39.0

Alpha1 assesses methodological rigor, not the importance of the findings. See how we calibrate →

Kaimen Rigor review

Kaimen Rigor reviewed

3.25 / 5

Adequate — real issues to address

Interventional Study

Critical

High-priority

How this rating was calculated▸

Started at 5★ — deductions

IntegrityIntegrity concern ×2−1★
ClaimsEfficacy rests on an unvalidated surrogate endpoint−0.5★
ReportingData & code availability partially met−0.25★

Model-reported confidence: highReviewer agreement: highEngine: 7.39.0Source: full text

Not verified in this report

Statistics were not checked: no recomputable values were found in this text — no test statistic reported with its degrees of freedom, no effect estimate printed with both a 95% CI and a p-value, and no percentage printed with both its count and its denominator.
The numeric-impossibility checks (GRIM/GRIMMER/DEBIT/SPRITE) did not run: 52 reported means were read, and their group size is not stated where the values are printed (this source has no machine-readable table structure). These checks need the count the mean was averaged over, so none was performed.

Biggest issues

01Efficacy rests on an unvalidated surrogate endpoint
highOverreachreviewer-assessedFull detail
The primary efficacy claim is based on time in range (TIR), a continuous glucose monitoring metric, which is a surrogate for glycemic control. Although the paper cites consensus guidelines that TIR is associated with HbA1c and clinical outcomes, it does not demonstrate target engagement of semaglutide at the tested dose (e.g., pharmacokinetic/pharmacodynamic data) nor provide a validated link between the observed TIR improvement and hard clinical outcomes such as microvascular complications. The improvement in TIR is presented as a clinical benefit without direct evidence that it translates to reduced long-term complications.
“The primary outcome was the percentage of time spent in the target glucose range of 3.9–10.0 mmol l −1 during the last 4 weeks of each intervention.”
Find in source

Findings by category

101ArithmeticNumerical inconsistencies 202OverreachOverstated conclusions 103AuthenticityData authenticity concerns 104DisclosureReporting gaps 05AvailabilityNone found 06Copyedit5 minor suggestions

Numerical inconsistencies

1 finding · worst low

Internal contradictions in the reported numbersAssessed

Overstated conclusions

2 findings · worst high

Efficacy rests on an unvalidated surrogate endpointAssessed
Conclusions only partially backed by the presented evidenceAssessed

9 major claims checked against the paper's own evidence: 1 only partially supported (evidence backs part of the claim; gaps or caveats remain); the rest adequately supported.

Premise concern: surrogate not validated for clinical benefit.

Data authenticity concerns

1 finding · worst low

Implausibly large reported effectAssessed

2 integrity concerns flagged (0 high).

Reporting gaps

1 finding · worst medium

Data/code availability incompleteAssessed

Eight Dimensions7 pass · 1 warn

Sub-criteria

prior work citedADEQUATE

premise rationaleADEQUATE

limitations addressedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Evidence

paraphrase[Main, paragraph 1-2]

“The aim of this study was to assess whether semaglutide, versus placebo, improves glycemic control and other nonglycemic outcomes in those with T1D while using AID.”

Main, paragraph 2Find in source

paraphrase[Main, paragraph 2]

“Although semaglutide has not yet been assessed in T1D in clinical trials, retrospective data of off-label use has suggested benefits...”

PASSReviewer 2· 90% conf

The study clearly establishes the scientific premise, citing prior work on AID limitations and semaglutide benefits in T2D, and provides a logical rationale for the trial.

Evidence

“However, in large randomized trials assessing AID use, 34–53% of participants were still not able to achieve an HbA1c of less than 7%”

Main, paragraph 1Find in source

“The aim of this study was to assess whether semaglutide, versus placebo, improves glycemic control and other nonglycemic outcomes in those with T1D while using AID.”

Main, paragraph 2Find in source

“Although semaglutide has not yet been assessed in T1D in clinical trials, retrospective data of off-label use has suggested benefits”

Main, paragraph 2Find in source

Sub-criteria

controlsADEQUATE

power analysisADEQUATE

blinding levelsADEQUATE

outlier handlingNOT REPORTED

randomization unitADEQUATE

inclusion exclusionADEQUATE

randomization methodADEQUATE

replicate distinctionN/A

independent replicationN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

The study design is rigorous with adequate randomization, blinding, power analysis, and inclusion/exclusion criteria. Applicable sub-criteria are well-reported.

Evidence

paraphrase[Methods, Randomization and masking]

“Block randomization was performed with randomly selected block sizes of 4, 6 or 8 by a researcher uninvolved with participants using the Sealed Envelope Ltd online tool.”

“Participants, investigators and other research personnel were blinded to allocation.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

PASSReviewer 2· 95% conf

The trial design is rigorous: randomized, double-blind, crossover, with block randomization, a priori power analysis, and pre-specified inclusion/exclusion criteria.

Evidence

paraphrase[Methods, Randomization and masking]

“Block randomization was performed with randomly selected block sizes of 4, 6 or 8 by a researcher uninvolved with participants using the Sealed Envelope Ltd online tool.”

“Participants, investigators and other research personnel were blinded to allocation.”

MethodsFind in source

paraphrase[Methods, Statistical analysis]

“Assuming an s.d. of 10% in the difference, 23 participants would provide 80% power to detect this difference at a 5% significance level.”

Sub-criteria

demographicsADEQUATE

sex reportedADEQUATE

sex justifiedN/A

age weight healthADEQUATE

housing conditionsN/A

species strain sourceN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Biological variables are well-reported for a human trial, including sex, age, BMI, and other demographics. Sex justification is not applicable as both sexes are enrolled.

Evidence

paraphrase[Table 1]

“Female sex (n (%)) 17 (61) | Age in years (mean (s.d.)) 45 (14)”

paraphrase[Table 1]

“BMI (kg m−2) 32.2 (5.1) | HbA1c in % (mean (s.d.)) 7.4 (0.8)”

PASSReviewer 2· 90% conf

Biological variables are well reported: sex, age, BMI, diabetes duration, and other demographics are provided in Table 1.

Evidence

paraphrase[Results, Participant disposition]

“28 participants (61% female, aged 45 (s.d. = 14) years, with an HbA1c of 7.4% (0.8%); Table 1)”

paraphrase[Table 1]

“BMI (kg m−2) | 32.2 (5.1)”

Sub-criteria

iacuc statementN/A

informed consentADEQUATE

irb ethics statementADEQUATE

regulatory complianceADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Ethical approvals are adequately reported: a named ethics board approved the study, informed consent was obtained, and regulatory compliance is stated.

Evidence

paraphrase[Methods, Study design]

“The protocol was approved by the research ethics board of the McGill University Health Centre and Health Canada.”

“At the initial visit, study procedures began after written informed consent was obtained and documented.”

MethodsFind in source

PASSReviewer 2· 95% conf

Ethics approval and informed consent are clearly documented.

Evidence

“The protocol was approved by the research ethics board of the McGill University Health Centre and Health Canada”

MethodsFind in source

“At the initial visit, study procedures began after written informed consent was obtained and documented.”

MethodsFind in source

Sub-criteria

mycoplasma testingN/A

reagents identifiedADEQUATE

organisms identifiedN/A

antibodies identifiedN/A

cell line authenticationN/A

software tools identifiedADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Key resources are adequately identified: the investigational product (semaglutide/placebo) is described, and software tools are identified with versions.

Evidence

paraphrase[Methods, Procedures]

“Semaglutide or placebo (saline) in sterile amber glass vials were given to participants, along with insulin syringes, dispensed by the research pharmacy.”

“Data processing was performed using MATLAB (v.R2024a); statistical analysis were performed with SPSS (v.29.0.1.1).”

Statistical analysisFind in source

PASSReviewer 2· 90% conf

The investigational product (semaglutide) and key devices are identified, and software is named with versions.

Evidence

paraphrase[Methods, Procedures]

“The system included an Ypsomed pump (Ypsomed), Dexcom G6 CGM (Dexcom) and a Pixel 2 smartphone with an application running the McGill insulin dosing algorithm.”

“Data processing was performed using MATLAB (v.R2024a); statistical analysis were performed with SPSS (v.29.0.1.1).”

Statistical analysisFind in source

Sub-criteria

tests namedADEQUATE

exact p valuesADEQUATE

effect sizes ciADEQUATE

data presentationADEQUATE

software identifiedADEQUATE

assumptions verifiedADEQUATE

mathematical plausibilityN/A

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Statistical analysis is rigorous: tests are named, assumptions are verified, exact p-values are reported, effect sizes with confidence intervals are provided, and data presentation is adequate.

Evidence

paraphrase[Methods, Statistical analysis]

“Target 3.9–10.0 | 69.4 (10.4) | 74.2 (9.7) | 4.8 (7.6) | 0.006”

Table 2Find in source

PASSReviewer 2· 85% conf

Statistical methods are appropriate and well-described, with exact p-values and effect sizes with CIs; no arithmetic errors detected.

Evidence

“A two-sided linear mixed model was used for the parametric analyses, while a Wilcoxon signed-ranked test was used for the nonparametric analysis.”

Table 2Find in source

paraphrase[Results, Primary outcome]

“a difference of 4.8 (7.6) percentage points (P = 0.006)”

paraphrase[Table 2]

“Total insulin (U day−1) | 62.1 [38.8, 85.1] | 46.1 [32.7, 62.7] | −11.3 [−23.6, −4.9] | <0.001”

Sub-criteria

code sharingINADEQUATE

accession numbersN/A

repository depositN/A

data availability statementINADEQUATE

Per reviewer (2) — the votes behind the verdict

WARNReviewer 1· 95% conf

A data availability statement is present but vague ('available on reasonable request' with no platform or timeframe), and code availability is conditional on data sharing, which is inadequate.

Evidence

Data availabilityFind in source

paraphrase[Code availability]

“The code used for data processing will be made available when the raw data are shared as per the 'Data availability' statement.”

WARNReviewer 2· 90% conf

Data availability statement is present but vague; code availability is conditional on data sharing.

Evidence

Data availabilityFind in source

“The code used for data processing will be made available when the raw data are shared as per the ‘Data availability’ statement.”

Data availabilityFind in source

Sub-criteria

funding coiADEQUATE

trial registrationADEQUATE

reporting guidelineADEQUATE

methods completenessADEQUATE

all outcomes reportedADEQUATE

limitations discussedADEQUATE

conclusions proportionalADEQUATE

Per reviewer (2) — the votes behind the verdict

PASSReviewer 1· 95% conf

Evidence

“ClinicalTrials.gov registration: NCT05205928”

AbstractFind in source

“The Consolidated Standards of Reporting Trials (CONSORT) flow chart is depicted in Fig.”

ResultsFind in source

“First, the study size and length were not sufficient to assess long-term efficacy and safety.”

DiscussionFind in source

PASSReviewer 2· 90% conf

Reporting is transparent: trial registered, CONSORT flow diagram, limitations discussed, conclusions proportional, funding and COI disclosed.

Evidence

“ClinicalTrials.gov registration: NCT05205928”

AbstractFind in source

“First, the study size and length were not sufficient to assess long-term efficacy and safety.”

Discussion ¶7Find in source

“This study was funded by the Canada Research Chair in Artificial Pancreas Systems held by A.H.”

AcknowledgementsFind in source

Registered (1 ID: ClinicalTrials.gov). Reporting guideline cited: CONSORT.

Broken references and links

None found

References checked against Crossref, OpenAlex and Retraction Watch for retractions and resolvability, plus declared data and code links probed for whether they resolve to content matching the paper.

Checked — nothing surfaced.

Checked 48 references by DOI: 1 verified — 47 no DOI (shown, not verified).

2 data/code links checked; 2 live.

Copyediting

5 minor

Wording, consistency and formatting errors that need correcting before submission.

No major wording or formatting errors. 5 minor suggestions below.

5 copyedit issues flagged: mostly consistency, clarity.

Kaimen Rigor Action ItemsFinal pass before journal submission

1.
HIGHdata code
Deposit the custom data-processing code in a public repository (e.g., Zenodo or GitHub with a DOI) and provide a direct link in the Code Availability statement, independent of data sharing.
The current code availability is conditional on data sharing, which is inadequate for reproducibility.
2.
HIGHdata code
Clarify the data access mechanism in the Data Availability statement by specifying a managed-access platform (e.g., Vivli) or a clear request process with a defined review timeline and contact email.
The current statement is vague and lacks a concrete platform or timeframe, making it difficult for readers to request data.
3.
HIGHrigor
Reconcile the discrepancy in the number of participants with detectable C-peptide at baseline: Table 1 reports 8 (29%) while the Results text reports 6 (25%).
This internal contradiction undermines data integrity and could confuse readers; it should be corrected in an erratum.
4.
HIGHstatistics
Verify and correct the triglyceride confidence interval in Table 3, which has a negative lower bound (1.17 [−0.63, 1.33]) that is implausible for a concentration.
An impossible confidence interval suggests a data entry or calculation error that needs correction.
5.
MEDIUMreporting
Add an explicit statement in the Methods that the study followed the Declaration of Helsinki and/or ICH-GCP guidelines.
Strengthens the regulatory compliance reporting, which is currently only implied.
6.
MEDIUMreporting
Explicitly state in the Methods that the CONSORT reporting guideline was followed, in addition to including the flow diagram.
Makes adherence to reporting guidelines explicit and unambiguous.
7.
MEDIUMother
Describe how outliers were defined and handled in the statistical analysis, or state that no outliers were excluded.
Outlier handling is not explicitly reported, which is a minor reporting gap.
8.
MEDIUMcopyedit
Fix the subject-verb agreement error in the Methods: 'statistical analysis were performed' should be 'statistical analysis was performed'.
Minor grammatical error that should be corrected for professionalism.
9.
MEDIUMstatistics
Clarify in the Methods whether the Wilcoxon signed-rank test was used for the primary analysis or only as a sensitivity analysis when residuals were skewed.
The current wording is ambiguous about the role of the nonparametric test in the analysis plan.
10.
LOWreporting
Add a statement on race/ethnicity demographics to the baseline table or participant disposition to improve generalizability assessment.
Race/ethnicity is not reported, which limits the ability to assess external validity.
11.
LOWdata code
Consider depositing de-identified aggregate data or derived metrics in a public repository to enhance transparency, if ethically permissible.
Would improve data availability beyond the current on-request model.

Full text (49,867 chars)Analyzed: Aug 15, 2026