ChatGPT Versus Physical Medicine and Rehabilitation Residents

NCT06775938 | Completed

• 1 other identifier: 31.12.2024-2873
• Study Type: observational
• Target: 314
• Locations: 1 country
• Sites: 1

Brief Summary

The aim of this study was to assess the performance of ChatGPT on examinations administered to physical medicine and rehabilitation (PMR) residents.

Conditions

Artificial Intelligence (AI); Resident Education

Keywords

Artificial Intelligence; ChatGPT; Educational Technology; Physical and Rehabilitation Medicine; Rehabilitation

Outcome Measures

Primary Outcomes (1)

• The comparison of resident exam results and ChatGPT answers to the same questions

  In May 2024, the exam results of residents in training and research hospitals affiliated with the Health Sciences University across Türkiye will be compared with the answers and rankings given by ChatGPT to the same questions. ChatGPT accuracy rate and response time to questions will be determined. The minimum score to be obtained from this exam is 0 and the maximum score is 100.

  through study completion, an average of 10 days

Study Arms (2)

Physical medicine and rehabilitation residents

The residents enrolled in the PMR specialization training program held throughout Turkey in May 2024

Other: resident exam

ChatGPT

A new user was created for the free version of the ChatGPT-4o application, and a series of questions belonging to four distinct education levels were posed to it, one by one. For each question, ChatGPT was instructed to select only one option out of five.

Other: resident exam

Interventions

resident exam OTHER

Resident exam in May 2024.

ChatGPT; Physical medicine and rehabilitation residents

Eligibility Criteria

• Sex: all
• Healthy Volunteers: No
• Age Groups: Child (0-17), Adult (18-64), Older Adult (65+)
• Sampling Method: Non-Probability Sample

Study Population

The study used exam questions taken by the majority of residents enrolled in the PMR specialization training program held throughout Turkey in May 2024. These exam questions were selected from a pool of questions developed by lecturers affiliated with the PMR departments of hospitals affiliated with the University of Health Sciences. The exam questions were structured to cover four different difficulty levels.

You may qualify if:

• Physical medicine and rehabilitation residents exam results in May 2024

Sponsors & Collaborators

• Sisli Hamidiye Etfal Training and Research Hospital: lead

Study Sites (1)

Şişli Hamidiye Etfal Training and Research Hospital

Istanbul, Sarıyer, Turkey (Türkiye)

Location

Study Design

• Study Type: observational
• Observational Model: OTHER
• Time Perspective: CROSS SECTIONAL
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: Medical Doctor, Physiatrist

Study Record Dates

• First Submitted: January 2, 2025
• First Posted: January 15, 2025
• Study Start: January 1, 2025
• Primary Completion: January 10, 2025
• Study Completion: January 10, 2025
• Last Updated: January 15, 2025

Record last verified: 2025-01

Locations

TU (1)