Improving Engagement With a Process Measure Dashboard Through Precision Feedback

NCT06465667 | Completed

• 1 other identifier: HUM00248876
• Study Type: interventional
• Target: 100
• Locations: 1 country
• Sites: 1

Brief Summary

The study seeks to assess the impact of e-mailing specific, targeted, practice-pattern based information ("precision feedback") on provider engagement with a dashboard for a quality process measure (showing stent omission after pre-stented ureteroscopy), compared with generic information ("one size fits most" feedback).

Conditions

Behavior

Keywords

Ureteral stent omission; Ureteral stent placement; Behavior change; Dashboard; Precision feedback

Outcome Measures

Primary Outcomes (1)

• Clickthrough rate to the online dashboard

  Clickthrough is defined as a link ever being clicked in the three months following e-mail send date, at which point in time a new e-mail will be sent. Clickthrough rate will be calculated as the number of clickthroughs divided by number of links sent (i.e., opportunities for clickthrough).

  Every 3 months up to 15 months

Secondary Outcomes (6)

• Total number of dashboard visits

  15 months

• Cumulative time (minutes) spent on the dashboard

  15 months

• Urologist opt-out rate

  15 months

• Helpful/not helpful rate

  15 months

• Stent rate for pre-stented ureteroscopy

  15 months

Study Arms (4)

Group 1 dashboard (3 months) then dashboard with Precision feedback (12 months)

EXPERIMENTAL

Months 0-3 dashboard only, months 3-15 months dashboard with Precision feedback.

Behavioral: Dashboard; Behavioral: Precision Feedback Push

Group 2 dashboard (6 months) then dashboard with Precision feedback (6 months)

EXPERIMENTAL

Months 0-6 dashboard only, months 6-15 months dashboard with Precision feedback.

Behavioral: Dashboard; Behavioral: Precision Feedback Push

Group 3 dashboard (9 months) then dashboard with Precision feedback (6 months)

EXPERIMENTAL

Months 0-9 dashboard only, months 9-15 months dashboard with Precision feedback.

Behavioral: Dashboard; Behavioral: Precision Feedback Push

Group 4 dashboard (12 months) then dashboard with Precision feedback (3 months)

EXPERIMENTAL

Months 0-12 dashboard only, months 12-15 months dashboard with Precision feedback.

Behavioral: Dashboard; Behavioral: Precision Feedback Push

Interventions

Dashboard BEHAVIORAL

The Dashboard intervention, representing current standard of care, will consist of a standard e-mail message with a link to the dashboard and text explanation. No performance data will be included in the e-mail, and links will not be monitored for clickthrough with repeat e-mail.

Group 1 dashboard (3 months) then dashboard with Precision feedback (12 months); Group 2 dashboard (6 months) then dashboard with Precision feedback (6 months); Group 3 dashboard (9 months) then dashboard with Precision feedback (6 months); Group 4 dashboard (12 months) then dashboard with Precision feedback (3 months)

Precision Feedback Push BEHAVIORAL

The experimental intervention, precision feedback e-mail messaging, will consist of an e-mail with a link to the dashboard along with tailored information about a participant's performance in the quality process measure of interest. For example, e-mail subject lines may read "You have room for improvement in stent omission," accompanied by a visual display in the body of the e-mail showing a participant's performance relative to a top performing peer. The behavior change intervention delivery component will also involve modifications to existing procedures. Namely, performance feedback will be reported directly in the e-mail as either plain text, or an embedded or attached image with graphed data.

Group 1 dashboard (3 months) then dashboard with Precision feedback (12 months); Group 2 dashboard (6 months) then dashboard with Precision feedback (6 months); Group 3 dashboard (9 months) then dashboard with Precision feedback (6 months); Group 4 dashboard (12 months) then dashboard with Precision feedback (3 months)

Eligibility Criteria

• Age: 18 Years+
• Sex: all
• Healthy Volunteers: No
• Age Groups: Adult (18-64), Older Adult (65+)

You may qualify if:

• Urologists participating in MUSIC that were in the top one hundred individuals in annual case volume from 2023 for "pre-stented ureteroscopy", the case for which the dashboard contents are most relevant.

You may not qualify if:

• \- Urologists that are not in the top one hundred individuals in annual "pre-stented ureteroscopy" case volume, urologists in the study team, or that opt out from the study at the individual or site level.

Sponsors & Collaborators

• University of Michigan: lead

Study Sites (1)

University of Michigan

Ann Arbor, Michigan, 48109, United States

Location

Related Publications (2)

• Lewicki P, Clark S, Shoemaker E, Wang B, Ross J, Daignault-Newton S, Carlozzi N, Martin-Schwarze A, Meurer W, Sales A, Ghani K, Dauw C, Stensland K. Rationale and protocol for a prospective clinical trial enrollment improvement hybrid study within a trial. Contemp Clin Trials Commun. 2025 Sep 20;48:101548. doi: 10.1016/j.conctc.2025.101548. eCollection 2025 Dec.

  PMID: 41050879 BACKGROUND

• Lewicki P, Salka B, Daignault-Newton S, Ross J, Krumm A, Ghani KR, Dauw C, Landis-Lewis Z, Stensland KD; Michigan Urological Surgery Improvement Collaborative. Rapid cycle, randomised testing of precision feedback to improve engagement with a process measure dashboard amongst urologists: study protocol for a hybrid trial. BMJ Open. 2025 May 6;15(5):e092742. doi: 10.1136/bmjopen-2024-092742.

  PMID: 40335130 DERIVED

MeSH Terms

Conditions

Behavior

Interventions

Dashboard Systems

Intervention Hierarchy (Ancestors)

Database Management Systems; Management Information Systems; Organization and Administration; Health Services Administration

Study Officials

• Kristian Stensland, MD

  University of Michigan

  PRINCIPAL INVESTIGATOR

Study Design

• Study Type: interventional
• Phase: not applicable
• Allocation: RANDOMIZED
• Masking: NONE
• Purpose: OTHER
• Intervention Model: CROSSOVER
• Sponsor Type: OTHER
• Responsible Party: PRINCIPAL INVESTIGATOR
• PI Title: Assistant Professor of Urology

Model Details: This is be a stepped wedge randomized controlled trial of precision feedback. One hundred urologists will be randomized into four groups, stratified by case volume. The trial will consist of four steps of three months each, at the beginning of which one group will cross over from control to intervention arm. This is preceded by a three-month pre-rollout period, comprising a total study length of 15 months. The duration of the trial was chosen based on a desire to deliver "rapid" results to inform the scale-up of the intervention, and to mirror the period of time over which a typical dashboard project may be conceived, designed, and delivered. Case volume may predict dashboard engagement, stenting practices, and privileged awareness of ongoing study efforts, and is therefore suitable for stratification.

Study Record Dates

• First Submitted: June 13, 2024
• First Posted: June 20, 2024
• Study Start: July 17, 2024
• Primary Completion: October 31, 2025
• Study Completion: October 31, 2025
• Last Updated: January 12, 2026

Record last verified: 2026-01

Data Sharing

• IPD Sharing: Will not share

Locations

US (1)