Implementation of Problem-Solving Treatment in Community Health Centers (PST-Aid)
Type III Hybrid Effectiveness-Implementation Trial of a Clinical Decision Support System for the Implementation of Problem-Solving Treatment in Community Health Centers
2 other identifiers
interventional
410
1 country
1
Brief Summary
Although evidence-based clinical interventions (CI) are a preferred treatment option for patients with depression, CIs are rarely available in community primary care settings. When available, CIs are often delivered with poor fidelity and abandoned by practitioners during the initial months post-training. Identifying effective implementation strategies to support the adoption, reach, and sustained use with fidelity of these CIs could enhance the effectiveness of primary care-based treatment of depression, as primary care is where most treatment for this disorder is delivered. Current models of primacy care practitioner training and supervision follow standard formal didactic procedures that might not be sufficient for successful adoption, high-fidelity delivery, and sustainment of CIs. Automated decision support tools and feedback systems embedded in health informatics technology have been found to be effective in supporting the use of best practices and hence might be useful for the transition from training to sustained CI use. In practice, however, these tools are ignored by practitioners, have mixed success on outcomes, and can hinder clinical care owing to poor design. Problem Solving Treatment Aid (PST-Aid), an educate and reorganize implementation strategy, is a web-based app that promotes practitioner-client collaboration in the use of PST for goal setting and action planning. A pilot randomized trial comparing Problem Solving Treatment (PST) training-as-usual to training plus PST-Aid found PST-Aid was deemed to be appropriate and usable to both practitioner and client users with preliminary support for benefits in depression outcomes.
Trial Health
Trial Health Score
Automated assessment based on enrollment pace, timeline, and geographic reach
participants targeted
Target at P75+ for not_applicable depression
Started Nov 2024
Typical duration for not_applicable depression
1 active site
Health score is calculated from publicly available data and should be used for screening purposes only.
Trial Relationships
Click on a node to explore related trials.
Study Timeline
Key milestones and dates
First Submitted
Initial submission to the registry
July 2, 2024
CompletedFirst Posted
Study publicly available on registry
July 10, 2024
CompletedStudy Start
First participant enrolled
November 6, 2024
CompletedPrimary Completion
Last participant's last visit for primary outcome
March 31, 2028
ExpectedStudy Completion
Last participant's last visit for all outcomes
March 31, 2028
September 15, 2025
September 1, 2025
3.4 years
July 2, 2024
September 8, 2025
Conditions
Outcome Measures
Primary Outcomes (10)
Change in Implementation Strategy Usability Scale (ISUS) score
Usability will be evaluated with clinician report on the 10-item Implementation Strategy Usability Scale (ISUS), which is based closely on the well-validated System Usability Scale. Ratings are on a 1 to 5 scale and yield a total score from 0 to 100. Half the items are reverse scored; higher total scores reflect greater usability. The ISUS has good inter-item consistency (a = .83) and sensitivity. Research has also demonstrated that the original version of the ISUS (the SUS) functions similarly-and yields similar scores-for adults and youth as young as 11 years.
Baseline, 3 months, 6 months
Change in Participant Responsiveness Scale (PRS) score
Clinicians will complete the Participant Responsiveness Scale (PRS), an adapted version of the 12-item Patient Responsiveness Scale tailored to be developmentally appropriate for children aged 8 and above as well as adults. The PRS measures two factors, Participation and Enthusiasm. The original Patient Responsiveness Scale has demonstrated strong reliability (a = .86) and construct validity.
Baseline, 3 months, 6 months
Change in Intervention Appropriateness Measure (IAM) score
Clinicians will complete the Intervention Appropriateness Measure (IAM) is a rigorously developed, pragmatic instrument with strong good internal consistency (a = .87) and test-retest reliability (a = .87).
Baseline, 3 months, 6 months
Adoption over time
Adoption is operationalized as whether or not the clinician completes at least 1 PST session with 3 or more cases at any point during study participation.
Baseline, 7 months post-initial training in the intervention, and end of the individual's study participation period, assessed as the study withdrawal date or 24 months post-training, whichever is first
Reach over time
Reach will be calculated as the percentage of clinicians caseloads of patients with a depressive disorder receiving PST.
Baseline, 7 months post-initial training in the intervention, and end of the individual's study participation period, assessed as the study withdrawal date or 24 months post-training, whichever is first
Change in Patient Health Questionnaire (PHQ-9) score
The Patient Health Questionnaire is one of the most used short depression measures. The PHQ features 9 items on a four-point scale (0=not at all, 1=several days, 2=more than half the days, 3=nearly every day), with cutpoints for 5, 10, 15, and 20 representing mild, moderate, moderately severe, and severe levels of depressive symptoms. Four original validation studies were conducted on nearly 10,000 patients, and there have been multiple meta-analyses. Scores have been found valid, with sensitivity of 88% and specificity of 88% for a cut point of 10 has been found for Major Depressive Disorders.
Baseline, 4 weeks, 9 weeks
Client Satisfaction Questionnaire-16
This measure will ask 3 items from the Client Satisfaction Questionnaire-16: Did treatment meet your needs? Are you satisfied with treatment services? Would you use the same treatment again if needed?
9 weeks
Change in Quality of Life in Neurological Disorders Social Relations scale (Neuro-QOL) score
The Quality of Life in Neurological Disorders Satisfaction with Social Roles scale (Neuro-QOL) is a widely used 8-item measure of functioning in usual social roles, activities, and responsibilities. Factor analyses and Item Response Theory analyses have ensured broad information parameters without differential item functioning by demographics. Scale scores have been validated and normed on thousands of participants in the US general and clinical inpatient and outpatient settings, presenting with a variety of problem areas. Scores provide a T score with a mean of 50 and standard deviation of 10, aligned with a variety of norming samples. An example item stem is: In the past 7 days I am able to do all of my regular family activities. Response options are on a scale of 1 to 5 (1=never, 2-rarely, 3=sometimes, 4=often, 5=always).
Baseline, 4 weeks, 9 weeks
Initial fidelity (PST Fidelity Scale)
Fidelity will be measured using the PST Adherence and Competency Scale (PST Fidelity Scale). The PST Fidelity Scale includes seven items assessing the seven key problem-solving steps rated on a 5 point scale (0=very poor, 5=very good), an average score of 3 or greater indicates a satisfactory performance.Internal consistency is good, with Cronbach alpha ranging from .83 to .89. A Principal Components Analysis found all factors loaded on a common factor accounting for 76.6% of the variance.Interrater reliability has been found to be high (r=.822-.918), with 86% of two-rater comparisons within one point of each other. Initial fidelity will be defined as the hours of training until fidelity-based certification is reached, measured by trainer PST Fidelity Scale ratings of session recordings or mock interviews.
Expert clinicians review audiotapes of therapy sessions or mock interview for each clinician participant over a six-month period of time prior to certification in the intervention
Sustained fidelity
Sustained fidelity will be rated via observer coding of recordings of one randomly selected session (or mock interview) per client using the PST Fidelity Scale (i.e., fidelity tool)
Expert clinicians review audiotapes of therapy sessions or mock interview for each clinician participant over a six-month period of time after initial training
Secondary Outcomes (7)
Framework for Modifications and Adaptations of Evidence-based Interventions
End of the individual's study participation period, assessed as the study withdrawal date or 24 months post-training, whichever is first
Quality of goal setting and action planning over time
Baseline, 4 weeks, 9 weeks
Costs over time
Baseline, 3 months, 6 months, 12 months
Change in PST Task Self Efficacy Scale score
Baseline, 4 weeks, 9 weeks
Change in Behavioral Activation for Depression Scale score
Baseline, 4 weeks, 9 weeks
- +2 more secondary outcomes
Study Arms (2)
Problem Solving Treatment as usual (PST as usual)
ACTIVE COMPARATORParticipants in this arm will receiving training in PST as usual.
Problem Solving Treatment Aid (PST-Aid)
EXPERIMENTALParticipants in this arm will receiving training in PST with PST-Aid.
Interventions
PST is a skills-based intervention that teaches clients a 7-step approach in which they 1) select a specific problem and define it in concrete terms,2) select a goal that is feasible to reach before next session, 3) brainstorm various ways to accomplish the goal, 4) evaluate pros and cons of each solution, including the likelihood they can actually implement it, 5) select the best solution, 6) create a plan to implement the solution, and 7) evaluate the plan afterward to ascertain the effectiveness of the solution. Practitioners teach and illustrate the PST process to clients at each session and encourage clients to implement action plans developed using the PST process. Clients are also encouraged to practice the PST process with additional problems between sessions, in order to gain mastery over the PST skills, enhance behavioral activation and as a result improve their belief in their ability to solve problems on their own (self efficacy).
PST-Aid is an internet-based tool to support the delivery of PST. PST-Aid incorporates decision support for the practitioner as well as client and provides PST treatment support functions (i.e., scaffolding), including patient problem lists and session worksheets. PST-Aid was designed to be used during remote sessions, such that practitioners and clients can interact throughout the session while collaboratively viewing and editing worksheets on their own browsers.This system was developed into a prototype that was piloted and found to be acceptable and with adequate usability.
Eligibility Criteria
You may qualify if:
- Practitioner Participants. (a) are employed by a clinic that is an OCHIN clinical network member;
- Practitioner Participants. (b) hold a master's degree in social work, psychology, counseling, or a related field;
- Practitioner Participants. (c) provide psychotherapeutic care in the OCHIN network;
- Practitioner Participants. (d) have not previously received formal training in PST as defined by University of Washington Advancing Integrated Mental Health Solutions Center (AIMS) criteria;
- Practitioner Participants. (e) are not currently receiving specialized training outside of standard clinic support to implement a depression-specific psychosocial intervention; and
- Practitioner Participants. (f) are English-speaking.
- Client Participants. a) 18+,
- Client Participants. b) English-speaking,
- Client Participants. c) have a diagnosis of unipolar depression per provider report, and
- Client Participants. d) have a PHQ-9 score ≥ 10, which is above the clinical cutoff for depression symptoms.
You may not qualify if:
- Client Participants. (a) history or presence of psychiatric diagnoses other than unipolar, nonpsychotic depression or anxiety disorders,
- Client Participants. (b) active suicidal ideation,
- Client Participants. (c) current alcohol or substance abuse disorders, or
- Client Participants. (d) have dementia
Contact the study team to confirm eligibility.
Sponsors & Collaborators
Study Sites (1)
OCHIN, Inc.
Portland, Oregon, 97228-5426, United States
MeSH Terms
Conditions
Condition Hierarchy (Ancestors)
Study Officials
- PRINCIPAL INVESTIGATOR
Patrick Raue, PhD
University of Washington
Central Study Contacts
Study Design
- Study Type
- interventional
- Phase
- not applicable
- Allocation
- RANDOMIZED
- Masking
- SINGLE
- Who Masked
- OUTCOMES ASSESSOR
- Purpose
- HEALTH SERVICES RESEARCH
- Intervention Model
- PARALLEL
- Sponsor Type
- OTHER
- Responsible Party
- PRINCIPAL INVESTIGATOR
- PI Title
- Professor, Psychiatry and Behavioral Sciences
Study Record Dates
First Submitted
July 2, 2024
First Posted
July 10, 2024
Study Start
November 6, 2024
Primary Completion (Estimated)
March 31, 2028
Study Completion (Estimated)
March 31, 2028
Last Updated
September 15, 2025
Record last verified: 2025-09
Data Sharing
- IPD Sharing
- Will not share