Factors associated with daily completion rates in a smartphone-based ecological momentary assessment study

Yong Sook Yang, Gi Wook Ryu, Mona Choi

Research output: Contribution to journalArticle

Abstract

Objectives: Ecological momentary assessment (EMA) methods are known to have validity for capturing momentary changes in variables over time. However, data quality relies on the completion rates, which are influenced by both participants’ characteristics and study designs. This study applied an EMA method using a mobile application to assess momentary moods and stress levels in patients with Moyamoya disease to examine variables associated with EMA completion rates. Methods: Adults with Moyamoya disease were recruited from a tertiary hospital in Seoul. Patients with cognitive impairment were excluded. The EMA survey was loaded as a mobile application onto the participants’ personal smartphones. Notifications were sent at semi-random intervals four times a day for seven consecutive days. Daily completion rates were calculated as the percentage of completed responses per day; overall completion rates were calculated as the proportion of completed responses per total of the 28 scheduled measures in the study and assessed through a descriptive analysis, t-test, ANOVA, and regression analysis, with mixed modeling to identify the point at which the daily completion rate significantly decreased. Results: A total of 98 participants responded (mean age, 41.00 ± 10.30 years; 69.4% female; 75.5% married). The overall completion rate was 70.66%, with no gender or age differences found. The daily completion rate decreased significantly after day 5 (p = 0.029). Conclusions: Obtaining a good completion rate is essential for quality data in EMA methods. Strategic approaches to a study design should be established to encourage participants throughout a study to improve completion rates.

Original languageEnglish
Pages (from-to)332-337
Number of pages6
JournalHealthcare Informatics Research
Volume25
Issue number4
DOIs
Publication statusPublished - 2019 Oct

Fingerprint

Smartphones
Mobile Applications
Moyamoya Disease
Analysis of variance (ANOVA)
Regression analysis
Tertiary Care Centers
Analysis of Variance
Regression Analysis
Smartphone
Ecological Momentary Assessment
Data Accuracy

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Cite this

@article{5dc2fa52f5fb40198b72e6b2a3a85d23,
title = "Factors associated with daily completion rates in a smartphone-based ecological momentary assessment study",
abstract = "Objectives: Ecological momentary assessment (EMA) methods are known to have validity for capturing momentary changes in variables over time. However, data quality relies on the completion rates, which are influenced by both participants’ characteristics and study designs. This study applied an EMA method using a mobile application to assess momentary moods and stress levels in patients with Moyamoya disease to examine variables associated with EMA completion rates. Methods: Adults with Moyamoya disease were recruited from a tertiary hospital in Seoul. Patients with cognitive impairment were excluded. The EMA survey was loaded as a mobile application onto the participants’ personal smartphones. Notifications were sent at semi-random intervals four times a day for seven consecutive days. Daily completion rates were calculated as the percentage of completed responses per day; overall completion rates were calculated as the proportion of completed responses per total of the 28 scheduled measures in the study and assessed through a descriptive analysis, t-test, ANOVA, and regression analysis, with mixed modeling to identify the point at which the daily completion rate significantly decreased. Results: A total of 98 participants responded (mean age, 41.00 ± 10.30 years; 69.4{\%} female; 75.5{\%} married). The overall completion rate was 70.66{\%}, with no gender or age differences found. The daily completion rate decreased significantly after day 5 (p = 0.029). Conclusions: Obtaining a good completion rate is essential for quality data in EMA methods. Strategic approaches to a study design should be established to encourage participants throughout a study to improve completion rates.",
author = "Yang, {Yong Sook} and Ryu, {Gi Wook} and Mona Choi",
year = "2019",
month = "10",
doi = "10.4258/hir.2019.25.4.332",
language = "English",
volume = "25",
pages = "332--337",
journal = "Healthcare Informatics Research",
issn = "2093-3681",
publisher = "Korean Society of Medical Informatics",
number = "4",

}

Factors associated with daily completion rates in a smartphone-based ecological momentary assessment study. / Yang, Yong Sook; Ryu, Gi Wook; Choi, Mona.

In: Healthcare Informatics Research, Vol. 25, No. 4, 10.2019, p. 332-337.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Factors associated with daily completion rates in a smartphone-based ecological momentary assessment study

AU - Yang, Yong Sook

AU - Ryu, Gi Wook

AU - Choi, Mona

PY - 2019/10

Y1 - 2019/10

N2 - Objectives: Ecological momentary assessment (EMA) methods are known to have validity for capturing momentary changes in variables over time. However, data quality relies on the completion rates, which are influenced by both participants’ characteristics and study designs. This study applied an EMA method using a mobile application to assess momentary moods and stress levels in patients with Moyamoya disease to examine variables associated with EMA completion rates. Methods: Adults with Moyamoya disease were recruited from a tertiary hospital in Seoul. Patients with cognitive impairment were excluded. The EMA survey was loaded as a mobile application onto the participants’ personal smartphones. Notifications were sent at semi-random intervals four times a day for seven consecutive days. Daily completion rates were calculated as the percentage of completed responses per day; overall completion rates were calculated as the proportion of completed responses per total of the 28 scheduled measures in the study and assessed through a descriptive analysis, t-test, ANOVA, and regression analysis, with mixed modeling to identify the point at which the daily completion rate significantly decreased. Results: A total of 98 participants responded (mean age, 41.00 ± 10.30 years; 69.4% female; 75.5% married). The overall completion rate was 70.66%, with no gender or age differences found. The daily completion rate decreased significantly after day 5 (p = 0.029). Conclusions: Obtaining a good completion rate is essential for quality data in EMA methods. Strategic approaches to a study design should be established to encourage participants throughout a study to improve completion rates.

AB - Objectives: Ecological momentary assessment (EMA) methods are known to have validity for capturing momentary changes in variables over time. However, data quality relies on the completion rates, which are influenced by both participants’ characteristics and study designs. This study applied an EMA method using a mobile application to assess momentary moods and stress levels in patients with Moyamoya disease to examine variables associated with EMA completion rates. Methods: Adults with Moyamoya disease were recruited from a tertiary hospital in Seoul. Patients with cognitive impairment were excluded. The EMA survey was loaded as a mobile application onto the participants’ personal smartphones. Notifications were sent at semi-random intervals four times a day for seven consecutive days. Daily completion rates were calculated as the percentage of completed responses per day; overall completion rates were calculated as the proportion of completed responses per total of the 28 scheduled measures in the study and assessed through a descriptive analysis, t-test, ANOVA, and regression analysis, with mixed modeling to identify the point at which the daily completion rate significantly decreased. Results: A total of 98 participants responded (mean age, 41.00 ± 10.30 years; 69.4% female; 75.5% married). The overall completion rate was 70.66%, with no gender or age differences found. The daily completion rate decreased significantly after day 5 (p = 0.029). Conclusions: Obtaining a good completion rate is essential for quality data in EMA methods. Strategic approaches to a study design should be established to encourage participants throughout a study to improve completion rates.

UR - http://www.scopus.com/inward/record.url?scp=85075242236&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85075242236&partnerID=8YFLogxK

U2 - 10.4258/hir.2019.25.4.332

DO - 10.4258/hir.2019.25.4.332

M3 - Article

AN - SCOPUS:85075242236

VL - 25

SP - 332

EP - 337

JO - Healthcare Informatics Research

JF - Healthcare Informatics Research

SN - 2093-3681

IS - 4

ER -