Comparative Analysis of Diagnostic Accuracy and Case Difficulty Assessment of Three Large Language Models

NCT07732985 | Not Yet Recruiting

• 1 other identifier: New ENDO7.1.1
• Study Type: observational
• Target: 342
• Locations: 0 countries
• Sites: N/A

Brief Summary

This prospective, blinded diagnostic accuracy study aims to compare the performance of three large language models-ChatGPT (GPT-5.5 Pro), Gemini 3.1 Pro, and Claude Opus 4.7-in endodontic diagnosis and case difficulty assessment. The models will be evaluated against expert consensus as the reference standard using standardized clinical data and periapical radiographs. Diagnostic accuracy, sensitivity, specificity, and agreement with expert consensus will be assessed to determine the potential of LLMs as clinical decision-support tools in endodontics.

Conditions

Pulp and Periapical Tissue Disease

Outcome Measures

Primary Outcomes (1)

• Diagnostic accuracy of ChatGPT (GPT-5.5 Pro), Gemini 3.1 Pro, and Claude Opus 4.7 for pulpal and periapical diagnosis

  Diagnostic performance of each large language model compared with the expert consensus reference standard. Accuracy, sensitivity, specificity, and agreement (Cohen's kappa) will be calculated according to the American Association of Endodontists (AAE) diagnostic criteria

  At baseline

Secondary Outcomes (1)

• Accuracy of ChatGPT (GPT-5.5 Pro), Gemini 3.1 Pro, and Claude Opus 4.7 in endodontic case difficulty assessment

  At baseline

Interventions

ChatGPT (GPT-5.5 Pro), Gemini 3.1 Pro, Claude Opus 4.7 DEVICE

Large language model used to analyze standardized clinical information and periapical radiographs to provide pulpal and periapical diagnosis and endodontic case difficulty assessment according to AAE criteria

Eligibility Criteria

• Age: 16 Years+
• Sex: all
• Healthy Volunteers: Yes
• Age Groups: Child (0-17), Adult (18-64), Older Adult (65+)
• Sampling Method: Probability Sample

Study Population

Systemically healthy adult patients (≥16 years) requiring primary endodontic treatment or retreatment at the Endodontic Department, Faculty of Dentistry, Cairo University, who provide informed consent.

You may qualify if:

• Age above 16 years old.
• Systemically healthy patient (ASA I or II).
• Requiring endodontic treatment or retreatment
• Patient's acceptance to participate in the study

You may not qualify if:

• Medically compromised patients.
• Pregnant women.
• Traumatic dental injuries
• Low quality periapical radiograph

Sponsors & Collaborators

• Cairo University: lead

Central Study Contacts

Mariam Ahmed Hossam

CONTACT

00201110913251; mariam.ahmed.hosam@dentistry.cu.edu.eg

Study Design

• Study Type: observational
• Observational Model: OTHER
• Time Perspective: PROSPECTIVE
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: PhD Candidate

Study Record Dates

• First Submitted: July 10, 2026
• First Posted: July 29, 2026
• Study Start (Estimated): September 1, 2026
• Primary Completion (Estimated): December 1, 2026
• Study Completion (Estimated): January 1, 2027
• Last Updated: July 29, 2026

Record last verified: 2026-07