Performance Comparison of Large Language Models in TAP Block Ultrasound Interpretation

NCT07261436 | Recruiting

• 1 other identifier: SUCCESS OF LLMs in TAP BLOCK
• Study Type: observational
• Target: 40
• Locations: 1 country
• Sites: 1

Brief Summary

The goal of this study is to learn how accurately two artificial intelligence (AI) models, Gemini 2.5 Pro and ChatGPT-5.1, can interpret ultrasound videos of the Transversus Abdominis Plane (TAP) block, a regional anesthesia technique used for pain control after surgery. The main questions this study aims to answer are: How accurately can each AI model identify anatomical structures on TAP block ultrasound videos? Can the AI models correctly evaluate the spread of local anesthetic and determine whether the block is successful? How closely do the AI models' answers match the evaluations of expert anesthesiologists? No additional procedures will be performed on patients. TAP blocks will be done as part of routine clinical care, and the ultrasound videos will be recorded and de-identified. Participants will not need to do anything extra for the study. Experienced anesthesiologists will review the videos and provide expert answers. The AI models will be given the same videos and asked the same questions. A second expert, who does not know which answers came from humans or AI, will compare all responses. The results will help researchers understand whether advanced AI systems can safely support clinicians in interpreting ultrasound-guided regional anesthesia procedures and improve education and decision-making in anesthesia practice.

Conditions

Artificial Intelegence

Keywords

artificial intelligence

Outcome Measures

Primary Outcomes (1)

• Anatomical Interpretation Accuracy

  For each ultrasound video, the ability of both AI models (ChatGPT-5.1 and Gemini 2.5 Pro) to correctly identify key anatomical structures of the lateral TAP block (internal oblique, transversus abdominis, fascial plane, needle tip) will be evaluated. The accuracy of each model will be compared with the expert-defined reference answer.

  At the time of video analysis

Secondary Outcomes (7)

• Block Success Interpretation

  At the time of video analysis.

• Needle Plane Evaluation

  At the time of video analysis.

• Dermatomal Level Prediction

  At the time of video analysis.

• Risk Awareness Assessment

  At the time of video analysis.

• Recommendation Quality

  At the time of video analysis.

Interventions

Gemini 2.5 Pro Evaluation OTHER

Analysis of de-identified ultrasound videos by the Gemini 2.5 Pro artificial intelligence model. The model receives standardized prompts and provides anatomical interpretation, block success assessment, and clinical suggestion outputs.

ChatGPT-5.1 Evaluation OTHER

Analysis of de-identified ultrasound videos by the ChatGPT-5.1 artificial intelligence model. The model receives the same standardized questions and produces anatomical and clinical interpretations for comparison.

Eligibility Criteria

• Age: 18 Years - 85 Years
• Sex: all
• Healthy Volunteers: No
• Age Groups: Adult (18-64), Older Adult (65+)
• Sampling Method: Probability Sample

Study Population

This study will include adult surgical patients who receive a lateral Transversus Abdominis Plane (L-TAP) block as part of routine anesthesia practice during elective operations. The population consists only of patients whose block procedures are already clinically indicated and performed by experienced anesthesiologists. No additional procedures are carried out for research purposes. Ultrasound videos obtained during standard block practice are de-identified and analyzed. The study does not involve patient follow-up or any change in clinical management.

You may qualify if:

• Adults aged 18-85 years
• ASA I-III physical status
• Undergoing elective surgery with a lateral TAP block performed as part of routine anesthesia care
• Complete ultrasound-guided block procedure recorded on video
• Able to provide written informed consent

You may not qualify if:

• Unsuccessful or incomplete TAP block procedure
• Poor-quality ultrasound video (needle tip or anesthetic spread not visible)
• Missing demographic or clinical data
• Withdrawal of consent at any time

Sponsors & Collaborators

• Kanuni Sultan Suleyman Training and Research Hospital: lead

Study Sites (1)

Health Science University İstanbul Kanuni Sultan Süleyman Education and Training Hospital

Istanbul, Istanbul, 34303, Turkey (Türkiye)

RECRUITING

Central Study Contacts

Engin ihsan Turan, principal investigator

CONTACT

+905382431114; enginihsan@hotmail.com

Study Design

• Study Type: observational
• Observational Model: OTHER
• Time Perspective: PROSPECTIVE
• Target Duration: 1 Day
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: principal investigator

Study Record Dates

• First Submitted: November 21, 2025
• First Posted: December 3, 2025
• Study Start: January 15, 2026
• Primary Completion: April 30, 2026
• Study Completion: May 1, 2026
• Last Updated: February 4, 2026

Record last verified: 2025-11

Locations

TU (1)