Comparing Physician and Artificial Intelligence Chatbot Responses to Frequently Asked Questions From Osteoarthritis Patients

NCT07202286 | Completed

• 1 other identifier: 075-2023
• Study Type: observational
• Target: 286
• Locations: 1 country
• Sites: 1

Brief Summary

This study aimed to compare the patient acceptability (preference, length, and difficulty) and accuracy of Chat-Generative Pre-Trained Transformer (ChatGPT) responses to questions from people with osteoarthritis (OA) with physician responses.

Conditions

Osteo Arthritis Knee and Hip; Artificial Intelligence (AI); Acceptability; Accuracy; Chatbot

Keywords

chatGPT; Osteoarthritis; Acceptability; Accuracy; Artificial Intelligence; Cross-sectional

Outcome Measures

Primary Outcomes (1)

• Preferred response

  Binary outcome, chatbot or physician response. This was an average based on the preferences on the 7 FAQs.

  From invitation until the end of the study at two weeks

Secondary Outcomes (3)

• Rating of length

  From invitation until the end of the study at two weeks

• Rating of difficulty

  From invitation until the end of the study at two weeks

• Accuracy

  From invitation until the end of the study at two weeks

Other Outcomes (1)

• Number of words of the responses

  This was determined before the study started

Eligibility Criteria

• Sex: all
• Healthy Volunteers: No
• Age Groups: Child (0-17), Adult (18-64), Older Adult (65+)
• Sampling Method: Non-Probability Sample

Study Population

There were two groups of participants: 1) a panel of people with OA evaluating the preference, length, and difficulty, and 2) a panel of experts in the field of OA evaluating the accuracy of the responses

You may qualify if:

• all individuals visiting the Department of Orthopedics in the Canisius Wilhelmina Hospital, a district general hospital in Nijmegen, The Netherlands, diagnosed with knee or hip OA between March 2023 and March 2024

You may not qualify if:

• partly completion of the questionnaire

Sponsors & Collaborators

• Canisius-Wilhelmina Hospital: lead

Study Sites (1)

Canisius Wilhelmina Hospital

Nijmegen, Netherlands

Location

MeSH Terms

Conditions

Osteoarthritis

Condition Hierarchy (Ancestors)

Arthritis; Joint Diseases; Musculoskeletal Diseases; Rheumatic Diseases

Study Design

• Study Type: observational
• Observational Model: OTHER
• Time Perspective: CROSS SECTIONAL
• Sponsor Type: OTHER
• Responsible Party: SPONSOR

Study Record Dates

• First Submitted: September 30, 2025
• First Posted: October 1, 2025
• Study Start: May 22, 2024
• Primary Completion: June 5, 2024
• Study Completion: June 5, 2024
• Last Updated: October 6, 2025

Record last verified: 2025-10

Locations

NL (1)