NCT03850431

Brief Summary

"No-shows," or missed visits are a persistent problem in all health care systems. They contribute to worsened patient access, longer wait times, and inefficient use limited health care resources. The VA's no-show rate has shown no improvement in years, resulting in a staggering 9 million ambulatory no-shows in Fiscal Year (FY) 2015. Appointment reminders are an essential and proven element to addressing no-shows but major research gaps exist. Behavioral economics (BE) and allied fields offer key insights that are relevant to developing innovation in the field of appointment reminders. Adding "nudges" informed by concepts such as social norms, behavioral intentions, clear instructions, and potential negative consequences to the Veteran and others is a novel but evidence-based way to create enhanced appointment reminders. Seemingly small changes to appointment letters can create measurable shifts in appointment attendance and no-shows. Even more, these behavioral nudges can produce large benefits when taken to scale and compounded across a population. This project will address several aims, including: developing BE-informed messages to incorporate into enhanced appointment reminders; evaluating the effect of several versions of enhanced appointment reminders; and identifying potential barriers and facilitators to widespread implementation of enhanced appointment reminder messages.

Trial Health

87
On Track

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Enrollment
34,516

participants targeted

Target at P75+ for not_applicable

Timeline
Completed

Started Dec 2019

Typical duration for not_applicable

Geographic Reach
1 country

1 active site

Status
completed

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

First Submitted

Initial submission to the registry

February 19, 2019

Completed
2 days until next milestone

First Posted

Study publicly available on registry

February 21, 2019

Completed
10 months until next milestone

Study Start

First participant enrolled

December 17, 2019

Completed
1.8 years until next milestone

Primary Completion

Last participant's last visit for primary outcome

October 14, 2021

Completed
Same day until next milestone

Study Completion

Last participant's last visit for all outcomes

October 14, 2021

Completed
2.5 years until next milestone

Results Posted

Study results publicly available

April 19, 2024

Completed
Last Updated

April 19, 2024

Status Verified

October 1, 2023

Enrollment Period

1.8 years

First QC Date

February 19, 2019

Results QC Date

September 19, 2022

Last Update Submit

October 13, 2023

Conditions

Keywords

Behavioral EconomicsMental HealthVeteransVeterans HealthPrimary CareAppointments and Schedules

Outcome Measures

Primary Outcomes (1)

  • No-Show Rate

    The percentage of total appointments that are classified as a no-show, relative to the total number of appointments scheduled. The numerator ("no-shows") consists of appointments marked as a no-show and appointments canceled by the patient or clinic after the appointment time. The denominator ("total appointments") consists of no-shows and completed appointments. For calculation of missed appointments, canceled appointments are not included in the number of units analyzed. The numerator is multiplied by 100 to arrive at a percentage.

    1 year

Secondary Outcomes (1)

  • Cancellation Rate

    1 year

Study Arms (5)

Social Norms + Behavioral Instructions

EXPERIMENTAL

Clinics assigned a letter with two types of nudges (Social Norms + Behavioral Instructions)

Behavioral: Social Norms + Behavioral Instructions

Caring + Consequences for Others + Behavioral Instructions

EXPERIMENTAL

Clinics assigned a letter with three types of nudges (Caring + Consequences for Others + Behavioral Instructions)

Behavioral: Caring + Consequences for Others + Behavioral Instructions

Caring + Consequences for Self + Behavioral Instructions

EXPERIMENTAL

Clinics assigned a letter with three types of nudges (Caring + Consequences for Self + Behavioral Instructions)

Behavioral: Caring + Consequences for Self + Behavioral Instructions

Combination of all Nudges

EXPERIMENTAL

Clinics assigned a letter with a combination of all types of nudges (Behavioral: Caring + Consequences for Others + Consequences for Self + Social Norms + Behavioral Instructions)

Behavioral: Caring + Consequences for Others + Consequences for Self + Social Norms + Behavioral Instructions

Usual Care

NO INTERVENTION

Clinics assigned to usual care. Usual care consisted of a letter with basic appointment information on date, location, and phone number(s) for scheduling changes

Interventions

A letter with two types of nudges. One points out the common behavior of attending appointments. And one provides clear, specific instructions for making appointment changes. The appointment reminder also includes usual care (basic appointment information on date, location, and phone number(s) for scheduling changes).

Social Norms + Behavioral Instructions

A letter with three types of nudges. One suggests that the institution cares about the patient. One highlights a potential negative consequence for others if the patient no-shows. And one provides clear, specific instructions for making appointment changes. The appointment reminder also includes usual care (basic appointment information on date, location, and phone number(s) for scheduling changes).

Caring + Consequences for Others + Behavioral Instructions

A letter with three types of nudges. One suggests that the institution cares about the patients. One highlights potential negative consequences for the patient if s/he no-shows. And one provides clear, specific instructions for making appointment changes. The appointment reminder also includes usual care (basic appointment information on date, location, and phone number(s) for scheduling changes).

Caring + Consequences for Self + Behavioral Instructions

A letter with all types of nudges combined. One suggests that the institution cares about the patients. One highlights a potential negative consequence for others if the patient no-shows. One highlights potential negative consequences for the patient if s/he no-shows. One points out the common behavior of attending appointments. And one provides clear, specific instructions for making appointment changes. The appointment reminder also includes usual care (basic appointment information on date, location, and phone number(s) for scheduling changes).

Combination of all Nudges

Eligibility Criteria

Age18 Years+
Sexall
Healthy VolunteersYes
Age GroupsAdult (18-64), Older Adult (65+)

You may qualify if:

  • All subjects will be a minimum of 18 years old.
  • All subjects will be patients with scheduled outpatient appointments (either primary care or mental health) in the VA Portland Health Care System.

You may not qualify if:

  • None

Contact the study team to confirm eligibility.

Sponsors & Collaborators

Study Sites (1)

VA Portland Health Care System, Portland, OR

Portland, Oregon, 97239, United States

Location

Related Publications (4)

  • Teo AR, Metcalf EE, Strange W, Call AA, Tuepker A, Dobscha SK, Kaboli PJ. Enhancing Usability of Appointment Reminders: Qualitative Interviews of Patients Receiving Care in the Veterans Health Administration. J Gen Intern Med. 2021 Jan;36(1):121-128. doi: 10.1007/s11606-020-06183-5. Epub 2020 Sep 9.

  • Zikmund-Fisher BJ, Tuepker A, Metcalf EE, Strange W, Teo AR. Applying user-centered design in the development of nudges for a pragmatic trial to reduce no-shows among veterans. Patient Educ Couns. 2022 Jun;105(6):1620-1627. doi: 10.1016/j.pec.2021.10.024. Epub 2021 Oct 23.

  • Lafferty M, Strange W, Kaboli P, Tuepker A, Teo AR. Patient Sense of Belonging in the Veterans Health Administration: A Qualitative Study of Appointment Attendance and Patient Engagement. Med Care. 2022 Sep 1;60(9):726-732. doi: 10.1097/MLR.0000000000001749. Epub 2022 Jul 26.

  • Teo AR, Niederhausen M, Handley R, Metcalf EE, Call AA, Jacob RL, Zikmund-Fisher BJ, Dobscha SK, Kaboli PJ. Using Nudges to Reduce Missed Appointments in Primary Care and Mental Health: a Pragmatic Trial. J Gen Intern Med. 2023 Jul;38(Suppl 3):894-904. doi: 10.1007/s11606-023-08131-5. Epub 2023 Jun 20.

MeSH Terms

Conditions

Psychological Well-Being

Condition Hierarchy (Ancestors)

Personal SatisfactionBehavior

Results Point of Contact

Title
Dr. Alan Teo
Organization
Center to Improve Veteran Involvement in Care (CIVIC), HSR&D Center of Innovation, VA Portland Health Care System

Study Officials

  • Alan R. Teo, MD MS

    VA Portland Health Care System, Portland, OR

    PRINCIPAL INVESTIGATOR

Publication Agreements

PI is Sponsor Employee
Yes

Study Design

Study Type
interventional
Phase
not applicable
Allocation
RANDOMIZED
Masking
NONE
Masking Details
The intervention arms were assigned letters and the statistician was blinded for analysis.
Purpose
HEALTH SERVICES RESEARCH
Intervention Model
PARALLEL
Model Details: The primary objective is to systematically develop and test the effectiveness of a series of changes to appointment letters in a cluster RCT with the goal of reducing no-shows and increasing access. First, the investigators will iteratively obtain feedback and refine messages in draft interventions (Aim 1). Then evaluate the effects of four enhanced appointment reminder interventions informed by BE and the Theory of Planned Behavior, and compare them to usual care and each other (Aims 2 and 3). Appointments will be randomly allocated to one of the four interventions or usual care at the provider-level, with providers blinded to allocation. The trial will be conducted at eight locations across VAPORHCS in both mental health and primary care. The investigators will also conduct a qualitative assessment with key informants (Aim 4) to provide data that will be useful for future implementation (if intervention is effective) or suggest modifications to the intervention (if ineffective).
Sponsor Type
FED
Responsible Party
SPONSOR

Study Record Dates

First Submitted

February 19, 2019

First Posted

February 21, 2019

Study Start

December 17, 2019

Primary Completion

October 14, 2021

Study Completion

October 14, 2021

Last Updated

April 19, 2024

Results First Posted

April 19, 2024

Record last verified: 2023-10

Data Sharing

IPD Sharing
Will not share

Locations