NCT06795477

Brief Summary

Pharmacists currently perform an independent double-check to identify drug-selection errors before they can reach the patient. However, the use of machine intelligence (MI) to support this cognitive decision-making work by pharmacists does not exist in practice. This research is being conducted to examine the effectiveness machine intelligence (MI) advice on to determine if its impact on pharmacists' work performance and cognitive demand.

Trial Health

87
On Track

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Enrollment
30

participants targeted

Target at below P25 for not_applicable

Timeline
Completed

Started Feb 2023

Shorter than P25 for not_applicable

Geographic Reach
1 country

1 active site

Status
completed

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

Study Start

First participant enrolled

February 1, 2023

Completed
3 months until next milestone

Primary Completion

Last participant's last visit for primary outcome

May 12, 2023

Completed
Same day until next milestone

Study Completion

Last participant's last visit for all outcomes

May 12, 2023

Completed
1.7 years until next milestone

First Submitted

Initial submission to the registry

January 21, 2025

Completed
7 days until next milestone

First Posted

Study publicly available on registry

January 28, 2025

Completed
Last Updated

January 28, 2025

Status Verified

January 1, 2025

Enrollment Period

3 months

First QC Date

January 21, 2025

Last Update Submit

January 21, 2025

Conditions

Machine Intelligence in the Pharmacy

Outcome Measures

Primary Outcomes (3)

  • Cognitive effort

    Difference in cognitive effort measured by duration of fixation and fixation count

    1 day - Single study visit

  • Decision accuracy

    Difference in detection rate measured by number of medication verification errors

    1 day - Single study visit

  • Trust change

    Difference in trust as measured by visual analog scale will be calculated based on AI advice accuracy. Participants will indicate their level of trust in the AI advice after every trial on a scale from 1-100, with higher scores indicating greater levels of trust.

    1 day - Single study visit

Secondary Outcomes (1)

  • Reaction time

    1 day - Single study visit

Study Arms (2)

Interpretable MI

EXPERIMENTAL

Participants receive interpretable machine intelligence to complete the medication verification task.

Behavioral: No MI HelpBehavioral: Interpretable MI

Uninterpretable MI

EXPERIMENTAL

Participants receive uninterpretable (i.e., black-box) machine intelligence to complete the medication verification task.

Behavioral: No MI HelpBehavioral: Uninterpretable MI

Interventions

No MI HelpBEHAVIORAL

Participants will complete the medication verification task without any MI help

Interpretable MIUninterpretable MI
Interpretable MIBEHAVIORAL

Participants receive interpretable machine intelligence assistance to complete the medication verification tasks.

Interpretable MI
Uninterpretable MIBEHAVIORAL

Participants receive uninterpretable (i.e., black-box) machine intelligence assistance to complete the medication verification tasks.

Uninterpretable MI

Eligibility Criteria

Age18 Years+
Sexall
Healthy VolunteersNo
Age GroupsAdult (18-64), Older Adult (65+)

You may qualify if:

  • Licensed pharmacist in the United States
  • Age 18 years and older at screening
  • PC/Laptop with Microsoft Windows 10 or Mac (Macbook, iMac) with MacOS with Google Chrome or Firefox web browser installed on the device
  • Screen resolution of 1024x968 pixels or more
  • A laptop integrated webcam or USB webcam is also required for the eye tracking purpose.

You may not qualify if:

  • Eyeglasses with more than one power (bifocals, trifocals, progressives, layered lenses, or regression lenses)
  • Cataracts, intraocular implants, glaucoma, or permanently dilated pupil
  • Require a screen reader/magnifier or other assistive technology to use the computer
  • Eye surgery (e.g., corneal)
  • Eye movement or alignment abnormalities (lazy eye, strabismus, nystagmus)

Contact the study team to confirm eligibility.

Sponsors & Collaborators

Study Sites (1)

University of Michigan

Ann Arbor, Michigan, 48109, United States

Location

Related Publications (1)

  • Tsai CC, Kim JY, Chen Q, Rowell B, Yang XJ, Kontar R, Whitaker M, Lester C. Effect of Artificial Intelligence Helpfulness and Uncertainty on Cognitive Interactions with Pharmacists: Randomized Controlled Trial. J Med Internet Res. 2025 Jan 31;27:e59946. doi: 10.2196/59946.

    PMID: 39888668DERIVED

Study Design

Study Type
interventional
Phase
not applicable
Allocation
RANDOMIZED
Masking
NONE
Purpose
OTHER
Intervention Model
PARALLEL
Sponsor Type
OTHER
Responsible Party
SPONSOR INVESTIGATOR
PI Title
Assistant Professor of Clinical Pharmacy

Study Record Dates

First Submitted

January 21, 2025

First Posted

January 28, 2025

Study Start

February 1, 2023

Primary Completion

May 12, 2023

Study Completion

May 12, 2023

Last Updated

January 28, 2025

Record last verified: 2025-01

Locations

US(1)