Impact of GPT Use on Essay Writing Performance and Cognitive Abilities
A Randomized Controlled Trial on the Impact of Using Generative Artificial Intelligence on Analytical Writing Performance and Cognitive Abilities
1 other identifier
interventional
160
1 country
1
Brief Summary
The goal of this randomized controlled lab experiment is to examine if using generated artificial intelligence (AI) technology will affect people's academic performance and cognitive abilities in the context of analytical writing among college students. The main questions it aims to answer are:
- 1.Does using the technology affect students' writing performance?
- 2.Does using the technology affect students' cognitive effort during the writing process?
- 3.Read learning materials on analytical writing techniques.
- 4.Based on the previously provided materials, complete an analytical writing assignment that will take approximately 30 minutes either with or without the aid of ChatGPT.
- 5.Answer survey questions about their experience with the writing assignment, attitudes on using ChatGPT, and demographic backgrounds.
Trial Health
Trial Health Score
Automated assessment based on enrollment pace, timeline, and geographic reach
participants targeted
Target at P75+ for not_applicable
Started Jul 2024
Shorter than P25 for not_applicable
1 active site
Health score is calculated from publicly available data and should be used for screening purposes only.
Trial Relationships
Click on a node to explore related trials.
Study Timeline
Key milestones and dates
First Submitted
Initial submission to the registry
July 15, 2024
CompletedStudy Start
First participant enrolled
July 18, 2024
CompletedFirst Posted
Study publicly available on registry
July 19, 2024
CompletedPrimary Completion
Last participant's last visit for primary outcome
February 20, 2025
CompletedStudy Completion
Last participant's last visit for all outcomes
February 20, 2025
CompletedJuly 9, 2025
July 1, 2025
7 months
July 15, 2024
July 4, 2025
Conditions
Outcome Measures
Primary Outcomes (2)
Writing Performance
The essay writing task is derived from the Analytical Writing section in the Graduate Record Examinations (GRE), which is a worldwide and standardized computer-based exam developed by the Educational Testing Service (ETS). The participants' essays will be scored on a scale from 0 to 6 by an automatic and validated third-party scoring tool that is also developed by ETS.
1.5 hours
Cognitive Effort Measured by Pupil Size
Cognitive effort is quantified by monitoring changes in pupil size. To achieve this, pupil diameters are recorded throughout the writing task using a near-infrared eye tracker, specifically the Tobii Pro Fusion model. At the start of the experiment, individual baseline pupil diameters are measured during a 30-second relaxation task.
1.5 hours
Secondary Outcomes (8)
Self-Perception of Writing Performance
1.5 hours
Self-Perception of Cognitive Effort
1.5 hours
Cognitive Effort Measured by Cortical Hemodynamic Activity in the Frontal Lobe
1.5 hours
Self-Perception of Stress
1.5 hours
Self-Perception of Challenge
1.5 hours
- +3 more secondary outcomes
Study Arms (2)
Intervention arm
EXPERIMENTALIn the intervention arm, participants are instructed to use ChatGPT for assistance to complete an analytical writing task.
Control arm
NO INTERVENTIONIn the control arm, participants are instructed to complete an analytical writing task independently without access to any technology assistance.
Interventions
The computer interface used for the essay writing task follows a split-screen design. The writing instructions and text input field are administered on a survey platform, placed on the left half of the screen. ChatGPT is placed on the right half of the screen for technology assistance.
Eligibility Criteria
You may qualify if:
- Full-time university student.
- Able to read and write in English.
- Use the computer most days of the week.
- Have not taken, nor currently preparing for, the Graduate Record Examinations (GRE).
- Do not wear glasses (contact lenses are allowed).
- Have no eye impairment.
- Not currently taking any opioids, epinephrine, or anti-hypertensive drugs.
- During the experiment, not wearing any makeup around the eyes.
Contact the study team to confirm eligibility.
Sponsors & Collaborators
Study Sites (1)
Core Facility for Neuroscience of Self-Regulation, Heidelberg University
Heidelberg, Germany
Related Publications (1)
Chen Y, Wang Y, Wustenberg T, Kizilcec RF, Fan Y, Li Y, Lu B, Yuan M, Zhang J, Zhang Z, Geldsetzer P, Chen S, Barnighausen T. Effects of generative artificial intelligence on cognitive effort and task performance: study protocol for a randomized controlled experiment among college students. Trials. 2025 Jul 11;26(1):244. doi: 10.1186/s13063-025-08950-3.
PMID: 40646586DERIVED
MeSH Terms
Conditions
Condition Hierarchy (Ancestors)
Study Officials
- PRINCIPAL INVESTIGATOR
Till Bärnighausen
Heidelberg Institute of Global Health
Study Design
- Study Type
- interventional
- Phase
- not applicable
- Allocation
- RANDOMIZED
- Masking
- SINGLE
- Who Masked
- PARTICIPANT
- Purpose
- OTHER
- Intervention Model
- PARALLEL
- Sponsor Type
- OTHER
- Responsible Party
- PRINCIPAL INVESTIGATOR
- PI Title
- Professor
Study Record Dates
First Submitted
July 15, 2024
First Posted
July 19, 2024
Study Start
July 18, 2024
Primary Completion
February 20, 2025
Study Completion
February 20, 2025
Last Updated
July 9, 2025
Record last verified: 2025-07