Project 3 Example: Human-AI Collaboration Tester (HAICT) Exp. 7

NCT05272189 | Completed Results

• 2 other identifiers: 2007P000646-BR01CA207490
• Study Type: interventional
• Target: 12
• Locations: 1 country
• Sites: 1

Brief Summary

The study is one part of a "bundle" of experiments that constitute Project Three of a National Eye Institute grant. Project Three includes a series of experiments that investigate how changing the input from a simulated AI can affect the decisions made by human observers in a two-alternative forced choice task (like the decision to recall a woman for further examination in mammography). HAICT 7, the experiment described here, investigates how changing prevalence affects human performance when AI is used as a Second Reader.

Conditions

Decision Making; Computer Aided Diagnosis

Keywords

Signal detection; VIsual Perception; BESH

Outcome Measures

Primary Outcomes (2)

• D'

  D' (d-prime) is the signal detection theory measure of the level of performance on a task. It is computed by calculating the proportion of true positive responses =(true positive trials)/(true positive + false negative trials) = p(TP) and by calculating the proportion of false positive responses =(false positive trials)/(false positive + true negative trials) = p(FP). These values are transformed into 'z-scores' (for example, using NORMSINV in Excel to calculate the inverse of the standard normal distribution). D' is defined as Z(TP)-Z(FP). Its range is from 0 for cases where no signal can be discriminated from the noise, to \~4.0. The upper limit is not defined, but 4 would mean that and observer is essentially perfect at discriminating signal from noise.

  Data are collected within a session of about an hour.

• Criterion

  Criterion, like D' (see above) is calculated from z(TP) and z(FP). Criterion ( c ) = (z(TP)+z(FP))/-2. A value of zero means that the observer is equally likely to make a positive (e.g. 'target present') response as a negative (absent) response. Positive values mean that the observer is more likely to say "absent" (a "conservative" criterion). Negative values mean the observer is more likely to say "present" (a "liberal" criterion). Liberal and conservative have no political connotations in this case. Criterion values almost always fall between -2 and 2.

  Data are collected within a session of about an hour.

Secondary Outcomes (1)

• Reaction Time

  Data are collected within a session of about an hour.

Study Arms (1)

Experiment

EXPERIMENTAL

All participants are tested in all conditions of this experiment.

Behavioral: Simulated Second Reader AI; Behavioral: Target Prevalence

Interventions

Simulated Second Reader AI BEHAVIORAL

In this experiment, in some conditions, the participant makes their decision in the presence of information about a simulated artificial intelligence decision.

Experiment

Target Prevalence BEHAVIORAL

The frequency with which targets are presented varies from 10% to 90%

Also known as: Base Rate

Experiment

Eligibility Criteria

• Age: 18 Years+
• Sex: all
• Healthy Volunteers: Yes
• Age Groups: Adult (18-64), Older Adult (65+)

You may qualify if:

• \- All welcome to enroll on line

You may not qualify if:

• Must pass the Ishihara color vision screening test
• /25 vision (with correction)

Sponsors & Collaborators

• Brigham and Women's Hospital: lead
• National Cancer Institute (NCI): collaborator

Study Sites (1)

Visual Attention Lab / Brigham and Women's Hospital

Boston, Massachusetts, 02215, United States

Location

Results Point of Contact

• Title: Jeremy M Wolfe, Professor and Principle Investigator
• Organization: Brigham & Women's Hospital

jwolfe@bwh.harvard.edu

6178511166

Study Officials

• Jeremy M Wolfe, PhD

  Brigham and Women's Hospital

  PRINCIPAL INVESTIGATOR

Publication Agreements

• PI is Sponsor Employee: Yes

Study Design

• Study Type: interventional
• Phase: not applicable
• Allocation: NA
• Masking: NONE
• Masking Details: Participants are naive to the purposes of the study but they are not blinded to the conditions.
• Purpose: BASIC SCIENCE
• Intervention Model: SINGLE GROUP
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: Professor

Study Record Dates

• First Submitted: February 18, 2022
• First Posted: March 9, 2022
• Study Start: January 1, 2020
• Primary Completion: August 1, 2024
• Study Completion: November 4, 2025
• Last Updated: January 20, 2026
• Results First Posted: January 20, 2026

Record last verified: 2025-12

Data Sharing

• IPD Sharing: Will share
• Shared Documents: STUDY PROTOCOL, SAP, ICF
• Time Frame: Materials will be available when requested
• Access Criteria: essentially unrestricted

Locations

US (1)