Abstract
Ecological Momentary Assessment (EMA) methods have emerged as an approach that enhances the ecological validity of data collected for the study of human behavior and experience. In particular, EMA methods are used to capture individuals' experiences (e.g., symptoms, affect, and behaviors) in real-world contexts and in near-real time. However, work investigating participants' experiences in EMA studies and in particular, how these experiences may influence the collected data, is limited. We conducted in-depth focus groups with 32 participants following an EMA study on mental well-being in college students. In doing so, we probed how the elicitation of high-quality, reflective responses is related to the design of EMA interactions. Through our study, we distilled three primary considerations for designing EMA interactions, based on observations of 1) response strategies to repeated questions, 2) the perceived burden of EMA prompts, and 3) challenges to the validity and robustness of EMA data. We present these considerations in the context of two microinteraction-based EMA approaches that we tested: lock-screen EMA and image-based question prompts. We conclude by characterizing design tensions in the presentation and delivery of EMA prompts, and outline directions for future work to address these tensions.
- G. Abowd, Y. Han, P. Abowd, W. Horner, S. Tengler, and J. Chen. 2014. Systems and methods for utilizing micro-interaction events on computing devices to administer questions. Google Patents. https://www.google.com/patents/US20140298260.Google Scholar
- Amelia Aldao and Susan Nolen-Hoeksema. 2012. The influence of context on the implementation of adaptive emotion regulation strategies. Behaviour research and therapy 50, 7 (2012), 493--501. http://www.sciencedirect.com/science/article/pii/S0005796712000733Google Scholar
- Daniel Lee Ashbrook. 2010. Enabling mobile microinteractions. Ph.D. Dissertation. Georgia Institute of Technology. https://smartech.gatech.edu/handle/1853/33986Google Scholar
- Jakob E. Bardram, Mads Frost, KÃąroly SzÃąntÃş, and Gabriela Marcu. 2012. The MONARCA Self-assessment System: A Persuasive Personal Monitoring System for Bipolar Patients. In Proceedings of the 2Nd ACM SIGHIT International Health Informatics Symposium (IHI '12). ACM, New York, NY, USA, 21--30. Google ScholarDigital Library
- Sunny Consolvo, Beverly Harrison, Ian Smith, Mike Y. Chen, Katherine Everitt, Jon Froehlich, and James A. Landay 2007. Conducting in situ evaluations for and with ubiquitous computing technologies. International Journal of Human-Computer Interaction 22, 1--2 (2007), 103--118.Google ScholarCross Ref
- Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (2003), 24--31. http://ieeexplore.ieee.org/abstract/document/1203750/ Google ScholarDigital Library
- Denzil Ferreira, Vassilis Kostakos, and Anind K. Dey. 2015. AWARE: mobile context instrumentation framework. Frontiers in ICT 2 (2015), 6. http://journal.frontiersin.org/article/10.3389/fict.2015.00006/fullGoogle ScholarCross Ref
- Gavan J. Fitzsimons and Vicki G. Morwitz. 1996. The Effect of Measuring Intent on Brand-Level Purchase Behavior. Journal of Consumer Research 23, 1 (June 1996), 1--11.Google ScholarCross Ref
- Jon Froehlich, James Landay, Mike Chen, Sunny Consolvo, Beverly Harrison, and Ian Smith. 2006. An overview of in situ self report and the my experience tool. (2006). http://www.cs.umd.edu/~jonf/publications/Froehlich_AnOverviewOfInSituSelfReportAndTheMyExperienceTool_Unpublished2006.pdfGoogle Scholar
- James J. Gross and Ross A. Thompson. 2007. Emotion regulation: Conceptual foundations. (2007). http://psycnet.apa.org/psycinfo/2007-01392-001Google Scholar
- Gabriella M Harari, Nicholas D Lane, Rui Wang, Benjamin S Crosier, Andrew T Campbell, and Samuel D Gosling. 2016. Using smartphones to collect behavioral data in psychological science: Opportunities, practical considerations, and challenges. Perspectives on Psychological Science 11, 6 (2016), 838--854.Google ScholarCross Ref
- Gillian R. Hayes, Karen G. Cheng, Sen H. Hirano, Karen P. Tang, Marni S. Nagel, and Dianne E. Baker. 2014. Estrellita: A Mobile Capture and Access Tool for the Support of Preterm Infants and Their Caregivers. ACM Trans. Comput.-Hum. Interact. 21, 3 (June 2014), 19:1--19:28. Google ScholarDigital Library
- Todd F Heatherton and Dylan D Wagner. 2011. Cognitive neuroscience of self-regulation failure. Trends in Cognitive Sciences (Jan. 2011).Google Scholar
- Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: differences in the experience sampling method across wearable devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 195--205. http://dl.acm.org/citation.cfm?id=2935340 Google ScholarDigital Library
- John Hicks, Nithya Ramanathan, Donnie Kim, Mohamad Monibi, Joshua Selsky, Mark Hansen, and Deborah Estrin. 2010. AndWellness: an open mobile system for activity and experience sampling. In Wireless Health 2010. ACM, 34--43. http://dl.acm.org/citation.cfm?id=1921087 Google ScholarDigital Library
- Stephen Intille, Caitlin Haynes, Dharam Maniar, Aditya Ponnada, and Justin Manjourides. 2016. μMA: Microinteraction-based Ecological Momentary Assessment (EMA) Using a Smartwatch. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 1124--1128. Google ScholarDigital Library
- Stephen S. Intille, John Rondoni, Charles Kukla, Isabel Ancona, and Ling Bao. 2003. A Context-aware Experience Sampling Tool. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 972--973. Google ScholarDigital Library
- Daniel Kahneman and Alan B. Krueger. 2006. Developments in the measurement of subjective well-being. The journal of economic perspectives 20, 1 (2006), 3--24. http://www.ingentaconnect.com/content/aea/jep/2006/00000020/00000001/art00001Google Scholar
- Kurt Kroenke, Robert L. Spitzer, Janet B. W. Williams, and Bernd LÃűwe. 2009. An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQâĂŞ4. Psychosomatics 50, 6 (Nov. 2009), 613--621.Google Scholar
- Jon A. Krosnick. 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied cognitive psychology 5, 3 (1991), 213--236.Google Scholar
- Jon A. Krosnick and Stanley Presser. 2010. Question and questionnaire design. Handbook of survey research 2, 3 (2010), 263--314. https://books.google.com/books?hl=en8lr=8id=mMPDPXpTP-0C8oi=fnd8pg=PA2638dq=krosnick+and+presser+20108ots=i4YWE0GrGn8sig=_oQIENpfQWHC2wrbjEbdMaB3mnEGoogle Scholar
- Jon A. Krosnick, Stanley Presser, Kaye Husbands Fealing, Steven Ruggles, and David Vannette. 2015. The future of survey research: challenges and opportunities. The National Science Foundation Advisory Committee for the Social, Behavioral and Economic Sciences Subcommittee on Advancing SBE Survey Research. (2015). https://www.nsf.gov/sbe/AC_Materials/The_Future_of_Survey_Research.pdfGoogle Scholar
- Santosh Kumar, Gregory D. Abowd, William T. Abraham, Mustafa alâĂŹAbsi, J. Gayle Beck, Duen Horng Chau, Tyson Condie, David E. Conroy, Emre Ertin, Deborah Estrin, and others. 2015. Center of excellence for mobile sensor data-to-knowledge (MD2K). Journal of the American Medical Informatics Association 22, 6 (2015), 1137--1142. http://jamia.oxfordjournals.org/content/22/6/1137.abstractGoogle ScholarCross Ref
- Nicholas D. Lane, Mu Lin, Mashfiqui Mohammod, Xiaochao Yang, Hong Lu, Giuseppe Cardone, Shahid Ali, Afsaneh Doryab, Ethan Berke, Andrew T. Campbell, and others. 2014. Bewell: Sensing sleep, physical activities and social interactions to promote wellbeing. Mobile Networks and Applications 19, 3 (2014), 345--359. http://link.springer.com/article/10.1007/s11036-013-0484-5 Google ScholarDigital Library
- Nicholas D. Lane, Mashfiqui Mohammod, Mu Lin, Xiaochao Yang, Hong Lu, Shahid Ali, Afsaneh Doryab, Ethan Berke, Tanzeem Choudhury, and Andrew Campbell. 2011. Bewell: A smartphone application to monitor, model and promote wellbeing. In 5th international ICST conference on pervasive computing technologies for healthcare. 23--26. http://www.cs.cornell.edu/~ms2749/pubs/PervasiveHealth_BeWell.pdfGoogle ScholarCross Ref
- Sharan B. Merriam and others. 2002. Introduction to qualitative research. Qualitative research in practice: Examples for discussion and analysis 1 (2002), 1--17. http://stu.westga.edu/~bthibaul/MEDT%208484-%20Baylen/introduction_to_qualitative_research/introduction_to_qualitative_research.pdfGoogle Scholar
- Margaret E. Morris, Qusai Kathawala, Todd K. Leen, Ethan E. Gorenstein, Farzin Guilak, William DeLeeuw, and Michael Labhard. 2010. Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness. Journal of Medical Internet Research 12, 2 (2010), e10.Google ScholarCross Ref
- Vicki G. Morwitz, Eric Johnson, and David Schmittlein. 1993. Does measuring intent change behavior? Journal of consumer research 20, 1 (1993), 46--61. http://jcr.oxfordjournals.org/content/20/1/46.abstractGoogle ScholarCross Ref
- Debbie S. Moskowitz and Simon N. Young. 2006. Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. Journal of psychiatry 8 neuroscience: JPN 31, 1 (2006), 13. http://search.proquest.com/openview/ff77a6319609405a55b7480b2ee9d990/1?pq-origsite=gscholar8cbl=30201Google Scholar
- John P. Pollak, Phil Adams, and Geri Gay. 2011. PAM: a photographic affect meter for frequent, in situ measurement of affect. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 725--734. http://dl.acm.org/citation.cfm?id=1979047 Google ScholarDigital Library
- Aditya Ponnada, Caitlin Haynes, Dharam Maniar, Justin Manjourides, and Stephen Intille. 2017. Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch? Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 92 (Sept. 2017), 16 pages. Google ScholarDigital Library
- Michael D. Robinson and Gerald L. Clore. 2002. Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes. Journal of Personality and Social Psychology 83, 1(2002), 198--215.Google ScholarCross Ref
- Christie Napa Scollon, Chu-Kim Prieto, and Ed Diener. 2009. Experience sampling: promises and pitfalls, strength and weaknesses. In Assessing well-being. Springer, 157--180. http://link.springer.com/chapter/10.1007/978-90-481-2354-4_8Google Scholar
- Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2008. Ecological Momentary Assessment. Annual Review of Clinical Psychology 4, 1 (April 2008), 1--32.Google ScholarCross Ref
- Khai N. Truong, Thariq Shihipar, and Daniel J. Wigdor. 2014. Slide to X: unlocking the potential of smartphone unlocking. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3635--3644. http://dl.acm.org/citation.cfm?id=2557044 Google ScholarDigital Library
- Rajan Vaish, Keith Wyngarden, Jingshu Chen, Brandon Cheung, and Michael S. Bernstein. 2014. Twitch Crowdsourcing: Crowd Contributions in Short Bursts of Time. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3645--3654. Google ScholarDigital Library
- Rajan Vaish, Keith Wyngarden, Jingshu Chen, Brandon Cheung, and Michael S. Bernstein. 2014. Twitch crowdsourcing: crowd contributions in short bursts of time. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3645--3654. http://dl.acm.org/citation.cfm?id=2556996 Google ScholarDigital Library
- Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 3--14. http://dl.acm.org/citation.cfm?id=2632054 Google ScholarDigital Library
- Rui Wang, Gabriella Harari, Peilin Hao, Xia Zhou, and Andrew T. Campbell. 2015. SmartGPA: how smartphones can assess and predict academic performance of college students. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. ACM, 295--306. http://dl.acm.org/citation.cfm?id=2804251 Google ScholarDigital Library
- Ladd Wheeler and Harry T. Reis. 1991. Self-Recording of Everyday Life Events: Origins, Types, and Uses. Journal of Personality 59, 3 (Sept. 1991), 339--354.Google ScholarCross Ref
- Xiaoyi Zhang, Laura R. Pina, and James Fogarty. 2016. Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness. ACM Press, 5658--5664. Google ScholarDigital Library
Index Terms
Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being
Recommendations
Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?
Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden. Microinteraction-EMA(µEMA) may ...
Contextual Analysis to Understand Compliance with Smartphone-based Ecological Momentary Assessment
PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for HealthcareMobile device-based ecological momentary assessment (mobile EMA) is increasingly utilized to capture in situ information about a person's physical and mental health states. Mobile EMA has methodological advantages over traditional survey methods (e.g., ...
DIY Ecological Momentary Assessment
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsEcological Momentary Assessment (EMA) is an increasingly used methodology in HCI which captures an individual’s experiences, typically digitally. The benefits of EMA include: reducing recall bias with ‘in-the-moment’ measurement; improving ecological ...
Comments