Evaluating Decision-making Using ChatGPT-4 Among Trainees in Surgery

NCT06921447 | Not Yet Recruiting

• 1 other identifier: AI-Surgical training
• Study Type: observational
• Target: 35
• Locations: 1 country
• Sites: 1

Brief Summary

This study aims to assess whether ChatGPT-4 can support surgical trainees in clinical decision-making. By comparing the performance of ChatGPT-4 with junior residents, senior residents, and attending surgeons on standardized clinical scenarios, the study seeks to understand the potential role of large language models in surgical education. The ultimate goal is to evaluate whether ChatGPT-4 can be safely integrated as a supplementary educational tool to aid junior residents in developing critical thinking and surgical judgment.

Conditions

Artificial Intelligence (AI); Training; Surgery

Keywords

artificial intelligence; surgery; training; oncology; emergency

Outcome Measures

Primary Outcomes (1)

• Proportion of correct responses

  Binary outcome (correct vs. incorrect decision)

  Baseline

Secondary Outcomes (3)

• Comparison of accuracy across experience levels

  Baseline

• Confidence level

  Baseline

• Percentage of use of AI for clinical cases evaluation

  Baseline

Study Arms (3)

Residents

Junior and Senior Residents in General Surgery

Other: Clinical Cases

Consultants

Senior General Surgeons

Other: Clinical Cases

ChatGPT 4

Artificial Intelligence System

Other: Clinical Cases

Interventions

Clinical Cases OTHER

Seven clinical cases that have to be analysed

ChatGPT 4; Consultants; Residents

Eligibility Criteria

• Sex: all
• Healthy Volunteers: No
• Age Groups: Child (0-17), Adult (18-64), Older Adult (65+)
• Sampling Method: Non-Probability Sample

Study Population

The study population will consist of general surgery trainees and faculty members from a single academic surgical department. Participants will be stratified into three groups based on their level of training and experience: Junior Residents: Postgraduate Year (PGY) 1-2; Senior Residents: PGY 3 and above; Attending Surgeons: Board-certified general surgeons with independent clinical practice

You may qualify if:

• Actively enrolled or employed in the general surgery residency or department at the participating institution
• Willingness to participate and complete all clinical case scenarios
• Consent to participate in the study

You may not qualify if:

• Incomplete responses
• Use of external assistance (e.g., internet search, AI tools) when answering scenarios, as self-reported in instructions

Sponsors & Collaborators

• Ospedali Riuniti Trieste: lead

Study Sites (1)

University of Trieste

Trieste, Italy

Location

MeSH Terms

Conditions

Neoplasms; Emergencies

Condition Hierarchy (Ancestors)

Disease Attributes; Pathologic Processes; Pathological Conditions, Signs and Symptoms

Central Study Contacts

Manuela Mastronardi

CONTACT

0403994152; manuela.mastronardi@gmail.com

Study Design

• Study Type: observational
• Observational Model: COHORT
• Time Perspective: PROSPECTIVE
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: Medical Doctor

Study Record Dates

• First Submitted: April 2, 2025
• First Posted: April 10, 2025
• Study Start: April 10, 2025
• Primary Completion: April 25, 2025
• Study Completion: April 30, 2025
• Last Updated: April 10, 2025

Record last verified: 2025-04

Data Sharing

• IPD Sharing: Will not share

Locations

IT (1)