NCT05945004

Brief Summary

The goal of this study is to evaluate the performance of large language models i.e. ChatGPT, in making preoperative visit sheets using clinical records. The main questions it aims to answer are:

  • Can large language models read clinical records and make preoperative visit sheets same as physicians?
  • Can physicians distinguish preoperative visit sheets made by physicians and models? Participants' records will be generated using ChatGPT-4, and read by both ChatGPT-4 and physicians to make 2 separate preoperative visit sheets, and form 2 groups, GPT group and physician group respectively. A group of professionals will compare result of above mentioned 2 groups to see if ChatGPT can afford to write preoperative visit sheets.

Trial Health

35
At Risk

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Trial has exceeded expected completion date
Enrollment
120

participants targeted

Target at P50-P75 for all trials

Timeline
Completed

Started Aug 2023

Shorter than P25 for all trials

Status
unknown

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

First Submitted

Initial submission to the registry

June 30, 2023

Completed
14 days until next milestone

First Posted

Study publicly available on registry

July 14, 2023

Completed
18 days until next milestone

Study Start

First participant enrolled

August 1, 2023

Completed
14 days until next milestone

Primary Completion

Last participant's last visit for primary outcome

August 15, 2023

Completed
17 days until next milestone

Study Completion

Last participant's last visit for all outcomes

September 1, 2023

Completed
Last Updated

July 14, 2023

Status Verified

July 1, 2023

Enrollment Period

14 days

First QC Date

June 30, 2023

Last Update Submit

July 11, 2023

Conditions

Preoperative Care

Outcome Measures

Primary Outcomes (2)

  • Familiarity to human writing

    Based on professionals' subjective evaluation, familiarity is a binary result indicating weather professionals think the preoperative visit sheet was written by physicians or ChatGPT, where 0 indicates "not written by human" and 1 indicates "written by human".

    Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.

  • Satisfaction for clinical use

    A grading score of 1-10 indicating weather the professionals think the preoperative visit sheet is suitable in clinical use.

    Each record will be screened for 6 minutes at most and results will be given in 8 minutes after receiving a record.

Study Arms (2)

Experiment

Other: ChatGPT-4

Control

Other: Clinician

Interventions

ChatGPT-4OTHER

Subjects' clinical records will be read by ChatGPT-4 to write preoperative visit sheets.

Experiment
ClinicianOTHER

Subjects' clinical records will be read by clinicians to write preoperative visit sheets.

Control

Eligibility Criteria

Sexall
Healthy VolunteersNo
Age GroupsChild (0-17), Adult (18-64), Older Adult (65+)
Sampling MethodProbability Sample
Study Population

No restictions are applied to population.

You may qualify if:

  • Any as records are generated using ChatGPT-4.

You may not qualify if:

  • Any as records are generated using ChatGPT-4.

Contact the study team to confirm eligibility.

Sponsors & Collaborators

MeSH Terms

Interventions

Nurse Clinicians

Intervention Hierarchy (Ancestors)

Nurse SpecialistsNursesHealth PersonnelHealth Care Facilities Workforce and Services

Study Design

Study Type
observational
Observational Model
COHORT
Time Perspective
CROSS SECTIONAL
Sponsor Type
INDUSTRY
Responsible Party
SPONSOR

Study Record Dates

First Submitted

June 30, 2023

First Posted

July 14, 2023

Study Start

August 1, 2023

Primary Completion

August 15, 2023

Study Completion

September 1, 2023

Last Updated

July 14, 2023

Record last verified: 2023-07