Evaluation of AI-Generated Clinical Advice by Physicians
A Study on the Evaluation of Artificial Intelligence-Generated Clinical Advisory Outputs in Medical Professional Contexts
1 other identifier
interventional
8
1 country
2
Brief Summary
This study examines how artificial intelligence systems interact with medical professionals. Researchers will compare physician responses to different AI-generated outputs in simulative medical scenarios.
Trial Health
Trial Health Score
Automated assessment based on enrollment pace, timeline, and geographic reach
participants targeted
Target at below P25 for not_applicable
Started May 2025
2 active sites
Health score is calculated from publicly available data and should be used for screening purposes only.
Trial Relationships
Click on a node to explore related trials.
Study Timeline
Key milestones and dates
First Submitted
Initial submission to the registry
April 28, 2025
CompletedStudy Start
First participant enrolled
May 15, 2025
CompletedFirst Posted
Study publicly available on registry
May 20, 2025
CompletedPrimary Completion
Last participant's last visit for primary outcome
May 22, 2025
CompletedStudy Completion
Last participant's last visit for all outcomes
May 23, 2025
CompletedMay 20, 2025
May 1, 2025
7 days
April 28, 2025
May 12, 2025
Conditions
Outcome Measures
Primary Outcomes (1)
Physician Response to AI-Generated Medical Content
Participants will rate their level of agreement with AI-generated clinical suggestions presented in simulated medical scenarios. Responses will be recorded using a standardized rating scale (range 1-5, where higher scores indicate better agreement).
Through study completion, an average of 1 week
Secondary Outcomes (1)
Physician Perception of Communication Quality in AI-Generated Content
Through study completion, an average of 1 week
Study Arms (2)
control group
NO INTERVENTIONParticipants evaluate clinical recommendations generated by Language Model A (LLM-A), with subsequent assessments of communication style characteristics using rating scales.
intervention group
EXPERIMENTALParticipants evaluate clinical recommendations generated by Language Model B (LLM-B), followed by evaluations of communication style characteristics through metric instruments.
Interventions
An artificial intelligence system generating clinical recommendations using prompts, designed to simulate clinical advisory outputs. The protocol focuses on structured medical language generation.
Eligibility Criteria
You may qualify if:
- Age ≥ 18 years old;
- Licensed physician or medical professional qualified to perform clinical evaluations;
- Willing to sign informed consent and commit time to participate in the study.
You may not qualify if:
- Unable to dedicate sufficient time to complete the study tasks;
- Unable or unwilling to understand and follow study instructions.
Contact the study team to confirm eligibility.
Sponsors & Collaborators
Study Sites (2)
Tsinghua University
Beijing, Beijing Municipality, 100084, China
Shanghai Health and Medical Center
Wuxi, Jiangsu, 214065, China
MeSH Terms
Interventions
Intervention Hierarchy (Ancestors)
Central Study Contacts
Study Design
- Study Type
- interventional
- Phase
- not applicable
- Allocation
- RANDOMIZED
- Masking
- SINGLE
- Who Masked
- PARTICIPANT
- Purpose
- OTHER
- Intervention Model
- CROSSOVER
- Sponsor Type
- OTHER
- Responsible Party
- PRINCIPAL INVESTIGATOR
- PI Title
- Vice-Provost and Senior Vice-Chancellor
Study Record Dates
First Submitted
April 28, 2025
First Posted
May 20, 2025
Study Start
May 15, 2025
Primary Completion
May 22, 2025
Study Completion
May 23, 2025
Last Updated
May 20, 2025
Record last verified: 2025-05