NCT06935253

Brief Summary

This study evaluates the impact of large language models (LLMs) versus traditional decision support tools on clinical decision-making in cardiology. General cardiologists will be randomized to manage real patient cases from a cardiovascular genetic cardiomyopathy clinic, with or without AI assistance. Each case will be assessed by two cardiologists, and their responses will be graded by blinded subspecialty experts using a standardized evaluation rubric.

Trial Health

57
Monitor

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Trial has exceeded expected completion date
Enrollment
12

participants targeted

Target at below P25 for not_applicable

Timeline
Completed

Started Jan 2025

Geographic Reach
1 country

1 active site

Status
recruiting

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

Study Start

First participant enrolled

January 10, 2025

Completed
3 months until next milestone

First Submitted

Initial submission to the registry

April 11, 2025

Completed
9 days until next milestone

First Posted

Study publicly available on registry

April 20, 2025

Completed
7 months until next milestone

Primary Completion

Last participant's last visit for primary outcome

November 1, 2025

Completed
1 month until next milestone

Study Completion

Last participant's last visit for all outcomes

December 1, 2025

Completed
Last Updated

May 15, 2025

Status Verified

May 1, 2025

Enrollment Period

10 months

First QC Date

April 11, 2025

Last Update Submit

May 13, 2025

Conditions

Keywords

Large language modelsCardiology

Outcome Measures

Primary Outcomes (1)

  • Subspecialist Preference

    The primary outcome is the preference of the subspecialist between answers provided by a) Cardiologist with access to Large Language Model vs. b) Cardiologist without access to Large Language Model.

    Subspecialist evaluation will occur within 1 month of participant completing their assessment

Secondary Outcomes (1)

  • Participants perspective on use of Large Language model

    Within one-hour

Study Arms (2)

Large Language Model

ACTIVE COMPARATOR

This group will be given access to a Large Language Model

Other: Large Language Model

Usual resources

NO INTERVENTION

Group will not be given access to a Large Language Model but will be encouraged to use any resources they usually use in their practice besides large language models (UpToDate, Dynamed etc).

Interventions

The intervention is a Large Language Model.

Also known as: AMIE (Articulate Medical Intelligence Explorer)
Large Language Model

Eligibility Criteria

Age18 Years+
Sexall
Healthy VolunteersNo
Age GroupsAdult (18-64), Older Adult (65+)

You may qualify if:

  • Board certified or board eligible Cardiologist.

You may not qualify if:

  • Not currently practicing clinically

Contact the study team to confirm eligibility.

Sponsors & Collaborators

Study Sites (1)

Stanford

Palo Alto, California, 94303, United States

RECRUITING

MeSH Terms

Conditions

Cardiomyopathy, HypertrophicCardiomyopathiesGenetic Diseases, Inborn

Interventions

Large Language Models

Condition Hierarchy (Ancestors)

Heart DiseasesCardiovascular DiseasesAortic Stenosis, SubvalvularAortic Valve StenosisAortic Valve DiseaseHeart Valve DiseasesCongenital, Hereditary, and Neonatal Diseases and Abnormalities

Intervention Hierarchy (Ancestors)

Deep LearningMachine LearningArtificial IntelligenceAlgorithmsMathematical ConceptsNeural Networks, Computer

Study Officials

  • Euan A Ashley, BSc, MB ChB, DPhil

    Stanford University

    PRINCIPAL INVESTIGATOR

Central Study Contacts

Jack W O'Sullivan, MBBS, DPhil

CONTACT

Euan A Ashley, BSc, MB ChB, DPhil

CONTACT

Study Design

Study Type
interventional
Phase
not applicable
Allocation
RANDOMIZED
Masking
SINGLE
Who Masked
OUTCOMES ASSESSOR
Masking Details
The evaluation of responses will be performed by assessors blinded to participant identity and treatment assignment.
Purpose
SUPPORTIVE CARE
Intervention Model
PARALLEL
Sponsor Type
OTHER
Responsible Party
PRINCIPAL INVESTIGATOR
PI Title
Postdoctoral Fellow

Study Record Dates

First Submitted

April 11, 2025

First Posted

April 20, 2025

Study Start

January 10, 2025

Primary Completion

November 1, 2025

Study Completion

December 1, 2025

Last Updated

May 15, 2025

Record last verified: 2025-05

Data Sharing

IPD Sharing
Will share

The patient cases that will be used in this study will be deidentified and made publicly available. The code to conduct the statistical analysis will also be made available.

Shared Documents
STUDY PROTOCOL, ANALYTIC CODE
Time Frame
The deidentified patient cases and statistical analysis code will be made available within 6 months of study completion.
Access Criteria
It will be made publicly available and accessible by all.
More information

Locations