NCT05194228

Brief Summary

Ecological momentary assessment (EMA) is a measurement methodology that utilizes the repeated collection of real-time data on participants' behavior and experience in their natural environment. While EMA allows researchers to gain valuable insights into dynamic behavioral processes, the need for frequent self-report can be burdensome and disruptive to participants. Compliance with EMA protocols is important for accurate, unbiased sampling, yet there is no "gold standard" for EMA study design. In the present study, the investigators aim to use a factorial design to identify the optimal components, or combinations of components, for achieving the highest compliance rates for smartphone-based ecological momentary assessments (EMAs). Participants will be randomized into 1 of 32 conditions in a 2x2x2x2x2 design (i.e., number of questions per EMA survey \[15 vs. 25\] x number of EMAs per day \[2 vs. 4\] x EMA prompting schedule \[random vs. fixed times\]) x payment type \[per EMA vs. based on percentage of EMAs completed\] x order of EMA item question types \[i.e., slider type first 2 weeks vs. Likert-type questions first 2 weeks\]). All participants will complete EMAs for 4 weeks. The effect of each factor on EMA compliance will be examined, as well as the effects of interactions on EMA compliance. The investigators will also examine within and between-subjects factors that influence response rates, and 2) contextual features such as environment and mood that may be associated with better compliance and participant engagement. The results of this study will have broad applications for developing best practices guidelines for future studies utilizing EMA methodologies.

Trial Health

87
On Track

Trial Health Score

Automated assessment based on enrollment pace, timeline, and geographic reach

Enrollment
416

participants targeted

Target at P75+ for not_applicable

Timeline
Completed

Started Nov 2021

Geographic Reach
1 country

1 active site

Status
completed

Health score is calculated from publicly available data and should be used for screening purposes only.

Trial Relationships

Click on a node to explore related trials.

Study Timeline

Key milestones and dates

First Submitted

Initial submission to the registry

November 10, 2021

Completed
20 days until next milestone

Study Start

First participant enrolled

November 30, 2021

Completed
2 months until next milestone

First Posted

Study publicly available on registry

January 18, 2022

Completed
9 months until next milestone

Primary Completion

Last participant's last visit for primary outcome

October 26, 2022

Completed
Same day until next milestone

Study Completion

Last participant's last visit for all outcomes

October 26, 2022

Completed
Last Updated

January 10, 2023

Status Verified

January 1, 2023

Enrollment Period

11 months

First QC Date

November 10, 2021

Last Update Submit

January 9, 2023

Conditions

Ecological Momentary Assessment Best Practices

Keywords

Ecological Momentary AssessmentHealth BehaviorSmartphone Application

Outcome Measures

Primary Outcomes (1)

  • Proportion of assigned daily smartphone surveys that are completed.

    Proportion of daily smartphone surveys completed will vary based upon group assignment.

    through study completion for each participant, 28 days

Secondary Outcomes (1)

  • Number of minutes required to complete the smartphone-based surveys.

    through study completion for each participant, 28 days

Study Arms (32)

Group 1

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 2

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 3

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 4

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 15 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 5

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 6

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 7

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 8

EXPERIMENTAL

$1 Payment per EMA 2 EMAs per day 25 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 9

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 10

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 11

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 12

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 15 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 13

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 14

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 15

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 16

EXPERIMENTAL

$1 Payment per EMA 4 EMAs per day 25 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 17

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 15 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 18

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 15 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 19

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 15 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 20

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 15 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 21

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 25 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 22

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 25 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 23

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 25 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 24

EXPERIMENTAL

Payment by % EMAs 2 EMAs per day 25 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 25

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 15 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 26

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 15 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 27

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 15 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 28

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 15 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 29

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 25 questions per EMA Fixed schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 30

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 25 questions per EMA Fixed schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Group 31

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 25 questions per EMA Random schedule Slider first

Behavioral: Ecologial Momentary Assessment settings

Group 32

EXPERIMENTAL

Payment by % EMAs 4 EMAs per day 25 questions per EMA Random schedule Likert first

Behavioral: Ecologial Momentary Assessment settings

Interventions

Ecologial Momentary Assessment settingsBEHAVIORAL

Various settings for ecological momentary assessments

Group 1Group 10Group 11Group 12Group 13Group 14Group 15Group 16Group 17Group 18Group 19Group 2Group 20Group 21Group 22Group 23Group 24Group 25Group 26Group 27Group 28Group 29Group 3Group 30Group 31Group 32Group 4Group 5Group 6Group 7Group 8Group 9

Eligibility Criteria

Age18 Years - 99 Years
Sexall
Healthy VolunteersYes
Age GroupsAdult (18-64), Older Adult (65+)

You may qualify if:

  • At least 18 years of age
  • Demonstrate \> 6th grade English literacy level
  • Possess an active Android smartphone that is compatible with the Insight (TM) platform with a data plan and an operating system version 6.0 or higher
  • Agree to install the study smartphone application onto their personal phone
  • Agree to complete EMAs prompted by and completed through the study smartphone application

You may not qualify if:

  • Under 18 years of age
  • Demonstrates \< 6th grade English literacy level
  • Does not possess an active Android smartphone that is compatible with the Insight (TM) platform with a data plan and an operating system version 6.0 or higher
  • Does not agree to install the study smartphone application onto their personal phone
  • Does not agree to complete EMAs prompted by and completed through the study smartphone application

Contact the study team to confirm eligibility.

Sponsors & Collaborators

Study Sites (1)

University of Oklahoma Health Sciences Center

Oklahoma City, Oklahoma, 73104, United States

Location

Related Publications (8)

  • Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment (EMA) in behavorial medicine. Annals of Behavioral Medicine, 16(3), 199-202. https://doi.org/10.1093/abm/16.3.199

    BACKGROUND

  • Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. 2008;4:1-32. doi: 10.1146/annurev.clinpsy.3.022806.091415.

    PMID: 18509902BACKGROUND

  • Jones A, Remmerswaal D, Verveer I, Robinson E, Franken IHA, Wen CKF, Field M. Compliance with ecological momentary assessment protocols in substance users: a meta-analysis. Addiction. 2019 Apr;114(4):609-619. doi: 10.1111/add.14503. Epub 2018 Dec 21.

    PMID: 30461120BACKGROUND

  • Rintala A, Wampers M, Myin-Germeys I, Viechtbauer W. Response compliance and predictors thereof in studies using the experience sampling method. Psychol Assess. 2019 Feb;31(2):226-235. doi: 10.1037/pas0000662. Epub 2018 Nov 5.

    PMID: 30394762BACKGROUND

  • Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. Compliance and Retention With the Experience Sampling Method Over the Continuum of Severe Mental Disorders: Meta-Analysis and Recommendations. J Med Internet Res. 2019 Dec 6;21(12):e14475. doi: 10.2196/14475.

    PMID: 31808748BACKGROUND

  • Fletcher DJ, Lewis SM, Matthews JN. Factorial designs for crossover clinical trials. Stat Med. 1990 Oct;9(10):1121-9. doi: 10.1002/sim.4780091002.

    PMID: 2247713BACKGROUND

  • Kezbers KM, Robertson MC, Hebert ET, Montgomery A, Businelle MS. Detecting Deception and Ensuring Data Integrity in a Nationwide mHealth Randomized Controlled Trial: Factorial Design Survey Study. J Med Internet Res. 2025 Jan 28;27:e66384. doi: 10.2196/66384.

    PMID: 39874573DERIVED

  • Businelle MS, Hebert ET, Shi D, Benson L, Kezbers KM, Tonkin S, Piper ME, Qian T. Investigating Best Practices for Ecological Momentary Assessment: Nationwide Factorial Experiment. J Med Internet Res. 2024 Aug 12;26:e50275. doi: 10.2196/50275.

    PMID: 39133915DERIVED

MeSH Terms

Conditions

Health Behavior

Condition Hierarchy (Ancestors)

Behavior

Study Design

Study Type
interventional
Phase
not applicable
Allocation
RANDOMIZED
Masking
NONE
Purpose
OTHER
Intervention Model
FACTORIAL
Model Details: Participants will be randomized into 1 of 32 conditions in a 2x2x2x2x2 design (i.e., number of questions per EMA survey \[15 vs. 25\] x number of EMAs per day \[2 vs. 4\] x EMA prompting schedule \[random vs. fixed times\]) x payment type \[per EMA vs. based on percentage of EMAs completed\] x order of EMA item question types \[i.e., slider type first 2 weeks vs. Likert-type questions first 2 weeks\]).
Sponsor Type
OTHER
Responsible Party
SPONSOR

Study Record Dates

First Submitted

November 10, 2021

First Posted

January 18, 2022

Study Start

November 30, 2021

Primary Completion

October 26, 2022

Study Completion

October 26, 2022

Last Updated

January 10, 2023

Record last verified: 2023-01

Data Sharing

IPD Sharing
Will not share

Locations

US(1)