Al to Improve the Diagnosis of Rare Rheumatic Diseases

NCT06748170 | Completed

• 1 other identifier: 24-221 ANZ
• Study Type: interventional
• Target: 68
• Locations: 1 country
• Sites: 1

Brief Summary

This trial aims to assess the impact of providing medical students with access to ChatGPT, a state-of-the-art large language model, in comparison to conventional diagnostic decision support tools, on their diagnostic accuracy for rare rheumatic diseases.

Conditions

Rheumatic Diseases

Keywords

Large language models; Diagnostic decision support; Clinical reasoning; rheumatology

Outcome Measures

Primary Outcomes (1)

• Diagnostic accuracy of top diagnosis

  Participants in each group will make at least one disease suggestion (top diagnosis) and up to a total of a maximum of 5 suggestions. Percentage of exact matches of the top suggestion with the actual diagnosis will be analyzed

  during evaluation

Secondary Outcomes (4)

• Diagnostic accuracy of top 5 suggestions

  during evaluation

• Diagnostic reasoning

  during evaluation

• Diagnostic confidence

  during evaluation

• Time spent for diagnosis

  during evaluation

Study Arms (2)

Intervention group

ACTIVE COMPARATOR

Group will be given access to ChatGPT and standardized initial prompt

Other: ChatGPT

Control group

NO INTERVENTION

Group will not be given access to any LLMs including ChatGPT but will be motivated to use other resources (such as online search enginges, Pubmed)

Interventions

ChatGPT OTHER

OpenAI's ChatGPT language model with chat interface.

Intervention group

Eligibility Criteria

• Age: 18 Years+
• Sex: all
• Healthy Volunteers: Yes
• Age Groups: Adult (18-64), Older Adult (65+)

You may qualify if:

• Medical students having started with clinical subjects (Internal medicine)

You may not qualify if:

• Not being a medical student

Sponsors & Collaborators

• Philipps University Marburg: lead

Study Sites (1)

Institute for Digital Medicine, University Hospital of Giessen and Marburg, Philipps University Marburg

Marburg, 35043, Germany

Location

MeSH Terms

Conditions

Rheumatic Diseases

Condition Hierarchy (Ancestors)

Musculoskeletal Diseases; Connective Tissue Diseases; Skin and Connective Tissue Diseases

Study Design

• Study Type: interventional
• Phase: not applicable
• Allocation: RANDOMIZED
• Masking: SINGLE
• Who Masked: OUTCOMES ASSESSOR
• Purpose: DIAGNOSTIC
• Intervention Model: PARALLEL
• Sponsor Type: OTHER
• Responsible Party: SPONSOR

Model Details: The trial will be designed as a randomized, two-arm, single-blind parallel group study.

Study Record Dates

• First Submitted: December 16, 2024
• First Posted: December 27, 2024
• Study Start: January 7, 2025
• Primary Completion: March 30, 2025
• Study Completion: March 30, 2025
• Last Updated: May 29, 2025

Record last verified: 2025-05

Data Sharing

• IPD Sharing: Will not share

Locations

DE (1)