skip to main content
research-article

Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being

Authors Info & Claims
Published:26 March 2018Publication History
Skip Abstract Section

Abstract

Ecological Momentary Assessment (EMA) methods have emerged as an approach that enhances the ecological validity of data collected for the study of human behavior and experience. In particular, EMA methods are used to capture individuals' experiences (e.g., symptoms, affect, and behaviors) in real-world contexts and in near-real time. However, work investigating participants' experiences in EMA studies and in particular, how these experiences may influence the collected data, is limited. We conducted in-depth focus groups with 32 participants following an EMA study on mental well-being in college students. In doing so, we probed how the elicitation of high-quality, reflective responses is related to the design of EMA interactions. Through our study, we distilled three primary considerations for designing EMA interactions, based on observations of 1) response strategies to repeated questions, 2) the perceived burden of EMA prompts, and 3) challenges to the validity and robustness of EMA data. We present these considerations in the context of two microinteraction-based EMA approaches that we tested: lock-screen EMA and image-based question prompts. We conclude by characterizing design tensions in the presentation and delivery of EMA prompts, and outline directions for future work to address these tensions.

References

  1. G. Abowd, Y. Han, P. Abowd, W. Horner, S. Tengler, and J. Chen. 2014. Systems and methods for utilizing micro-interaction events on computing devices to administer questions. Google Patents. https://www.google.com/patents/US20140298260.Google ScholarGoogle Scholar
  2. Amelia Aldao and Susan Nolen-Hoeksema. 2012. The influence of context on the implementation of adaptive emotion regulation strategies. Behaviour research and therapy 50, 7 (2012), 493--501. http://www.sciencedirect.com/science/article/pii/S0005796712000733Google ScholarGoogle Scholar
  3. Daniel Lee Ashbrook. 2010. Enabling mobile microinteractions. Ph.D. Dissertation. Georgia Institute of Technology. https://smartech.gatech.edu/handle/1853/33986Google ScholarGoogle Scholar
  4. Jakob E. Bardram, Mads Frost, KÃąroly SzÃąntÃş, and Gabriela Marcu. 2012. The MONARCA Self-assessment System: A Persuasive Personal Monitoring System for Bipolar Patients. In Proceedings of the 2Nd ACM SIGHIT International Health Informatics Symposium (IHI '12). ACM, New York, NY, USA, 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sunny Consolvo, Beverly Harrison, Ian Smith, Mike Y. Chen, Katherine Everitt, Jon Froehlich, and James A. Landay 2007. Conducting in situ evaluations for and with ubiquitous computing technologies. International Journal of Human-Computer Interaction 22, 1--2 (2007), 103--118.Google ScholarGoogle ScholarCross RefCross Ref
  6. Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (2003), 24--31. http://ieeexplore.ieee.org/abstract/document/1203750/ Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Denzil Ferreira, Vassilis Kostakos, and Anind K. Dey. 2015. AWARE: mobile context instrumentation framework. Frontiers in ICT 2 (2015), 6. http://journal.frontiersin.org/article/10.3389/fict.2015.00006/fullGoogle ScholarGoogle ScholarCross RefCross Ref
  8. Gavan J. Fitzsimons and Vicki G. Morwitz. 1996. The Effect of Measuring Intent on Brand-Level Purchase Behavior. Journal of Consumer Research 23, 1 (June 1996), 1--11.Google ScholarGoogle ScholarCross RefCross Ref
  9. Jon Froehlich, James Landay, Mike Chen, Sunny Consolvo, Beverly Harrison, and Ian Smith. 2006. An overview of in situ self report and the my experience tool. (2006). http://www.cs.umd.edu/~jonf/publications/Froehlich_AnOverviewOfInSituSelfReportAndTheMyExperienceTool_Unpublished2006.pdfGoogle ScholarGoogle Scholar
  10. James J. Gross and Ross A. Thompson. 2007. Emotion regulation: Conceptual foundations. (2007). http://psycnet.apa.org/psycinfo/2007-01392-001Google ScholarGoogle Scholar
  11. Gabriella M Harari, Nicholas D Lane, Rui Wang, Benjamin S Crosier, Andrew T Campbell, and Samuel D Gosling. 2016. Using smartphones to collect behavioral data in psychological science: Opportunities, practical considerations, and challenges. Perspectives on Psychological Science 11, 6 (2016), 838--854.Google ScholarGoogle ScholarCross RefCross Ref
  12. Gillian R. Hayes, Karen G. Cheng, Sen H. Hirano, Karen P. Tang, Marni S. Nagel, and Dianne E. Baker. 2014. Estrellita: A Mobile Capture and Access Tool for the Support of Preterm Infants and Their Caregivers. ACM Trans. Comput.-Hum. Interact. 21, 3 (June 2014), 19:1--19:28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Todd F Heatherton and Dylan D Wagner. 2011. Cognitive neuroscience of self-regulation failure. Trends in Cognitive Sciences (Jan. 2011).Google ScholarGoogle Scholar
  14. Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: differences in the experience sampling method across wearable devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 195--205. http://dl.acm.org/citation.cfm?id=2935340 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. John Hicks, Nithya Ramanathan, Donnie Kim, Mohamad Monibi, Joshua Selsky, Mark Hansen, and Deborah Estrin. 2010. AndWellness: an open mobile system for activity and experience sampling. In Wireless Health 2010. ACM, 34--43. http://dl.acm.org/citation.cfm?id=1921087 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Stephen Intille, Caitlin Haynes, Dharam Maniar, Aditya Ponnada, and Justin Manjourides. 2016. μMA: Microinteraction-based Ecological Momentary Assessment (EMA) Using a Smartwatch. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 1124--1128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Stephen S. Intille, John Rondoni, Charles Kukla, Isabel Ancona, and Ling Bao. 2003. A Context-aware Experience Sampling Tool. In CHI '03 Extended Abstracts on Human Factors in Computing Systems (CHI EA '03). ACM, New York, NY, USA, 972--973. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Daniel Kahneman and Alan B. Krueger. 2006. Developments in the measurement of subjective well-being. The journal of economic perspectives 20, 1 (2006), 3--24. http://www.ingentaconnect.com/content/aea/jep/2006/00000020/00000001/art00001Google ScholarGoogle Scholar
  19. Kurt Kroenke, Robert L. Spitzer, Janet B. W. Williams, and Bernd LÃűwe. 2009. An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQâĂŞ4. Psychosomatics 50, 6 (Nov. 2009), 613--621.Google ScholarGoogle Scholar
  20. Jon A. Krosnick. 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied cognitive psychology 5, 3 (1991), 213--236.Google ScholarGoogle Scholar
  21. Jon A. Krosnick and Stanley Presser. 2010. Question and questionnaire design. Handbook of survey research 2, 3 (2010), 263--314. https://books.google.com/books?hl=en8lr=8id=mMPDPXpTP-0C8oi=fnd8pg=PA2638dq=krosnick+and+presser+20108ots=i4YWE0GrGn8sig=_oQIENpfQWHC2wrbjEbdMaB3mnEGoogle ScholarGoogle Scholar
  22. Jon A. Krosnick, Stanley Presser, Kaye Husbands Fealing, Steven Ruggles, and David Vannette. 2015. The future of survey research: challenges and opportunities. The National Science Foundation Advisory Committee for the Social, Behavioral and Economic Sciences Subcommittee on Advancing SBE Survey Research. (2015). https://www.nsf.gov/sbe/AC_Materials/The_Future_of_Survey_Research.pdfGoogle ScholarGoogle Scholar
  23. Santosh Kumar, Gregory D. Abowd, William T. Abraham, Mustafa alâĂŹAbsi, J. Gayle Beck, Duen Horng Chau, Tyson Condie, David E. Conroy, Emre Ertin, Deborah Estrin, and others. 2015. Center of excellence for mobile sensor data-to-knowledge (MD2K). Journal of the American Medical Informatics Association 22, 6 (2015), 1137--1142. http://jamia.oxfordjournals.org/content/22/6/1137.abstractGoogle ScholarGoogle ScholarCross RefCross Ref
  24. Nicholas D. Lane, Mu Lin, Mashfiqui Mohammod, Xiaochao Yang, Hong Lu, Giuseppe Cardone, Shahid Ali, Afsaneh Doryab, Ethan Berke, Andrew T. Campbell, and others. 2014. Bewell: Sensing sleep, physical activities and social interactions to promote wellbeing. Mobile Networks and Applications 19, 3 (2014), 345--359. http://link.springer.com/article/10.1007/s11036-013-0484-5 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Nicholas D. Lane, Mashfiqui Mohammod, Mu Lin, Xiaochao Yang, Hong Lu, Shahid Ali, Afsaneh Doryab, Ethan Berke, Tanzeem Choudhury, and Andrew Campbell. 2011. Bewell: A smartphone application to monitor, model and promote wellbeing. In 5th international ICST conference on pervasive computing technologies for healthcare. 23--26. http://www.cs.cornell.edu/~ms2749/pubs/PervasiveHealth_BeWell.pdfGoogle ScholarGoogle ScholarCross RefCross Ref
  26. Sharan B. Merriam and others. 2002. Introduction to qualitative research. Qualitative research in practice: Examples for discussion and analysis 1 (2002), 1--17. http://stu.westga.edu/~bthibaul/MEDT%208484-%20Baylen/introduction_to_qualitative_research/introduction_to_qualitative_research.pdfGoogle ScholarGoogle Scholar
  27. Margaret E. Morris, Qusai Kathawala, Todd K. Leen, Ethan E. Gorenstein, Farzin Guilak, William DeLeeuw, and Michael Labhard. 2010. Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness. Journal of Medical Internet Research 12, 2 (2010), e10.Google ScholarGoogle ScholarCross RefCross Ref
  28. Vicki G. Morwitz, Eric Johnson, and David Schmittlein. 1993. Does measuring intent change behavior? Journal of consumer research 20, 1 (1993), 46--61. http://jcr.oxfordjournals.org/content/20/1/46.abstractGoogle ScholarGoogle ScholarCross RefCross Ref
  29. Debbie S. Moskowitz and Simon N. Young. 2006. Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. Journal of psychiatry 8 neuroscience: JPN 31, 1 (2006), 13. http://search.proquest.com/openview/ff77a6319609405a55b7480b2ee9d990/1?pq-origsite=gscholar8cbl=30201Google ScholarGoogle Scholar
  30. John P. Pollak, Phil Adams, and Geri Gay. 2011. PAM: a photographic affect meter for frequent, in situ measurement of affect. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 725--734. http://dl.acm.org/citation.cfm?id=1979047 Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Aditya Ponnada, Caitlin Haynes, Dharam Maniar, Justin Manjourides, and Stephen Intille. 2017. Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch? Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 92 (Sept. 2017), 16 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Michael D. Robinson and Gerald L. Clore. 2002. Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes. Journal of Personality and Social Psychology 83, 1(2002), 198--215.Google ScholarGoogle ScholarCross RefCross Ref
  33. Christie Napa Scollon, Chu-Kim Prieto, and Ed Diener. 2009. Experience sampling: promises and pitfalls, strength and weaknesses. In Assessing well-being. Springer, 157--180. http://link.springer.com/chapter/10.1007/978-90-481-2354-4_8Google ScholarGoogle Scholar
  34. Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2008. Ecological Momentary Assessment. Annual Review of Clinical Psychology 4, 1 (April 2008), 1--32.Google ScholarGoogle ScholarCross RefCross Ref
  35. Khai N. Truong, Thariq Shihipar, and Daniel J. Wigdor. 2014. Slide to X: unlocking the potential of smartphone unlocking. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3635--3644. http://dl.acm.org/citation.cfm?id=2557044 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Rajan Vaish, Keith Wyngarden, Jingshu Chen, Brandon Cheung, and Michael S. Bernstein. 2014. Twitch Crowdsourcing: Crowd Contributions in Short Bursts of Time. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3645--3654. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Rajan Vaish, Keith Wyngarden, Jingshu Chen, Brandon Cheung, and Michael S. Bernstein. 2014. Twitch crowdsourcing: crowd contributions in short bursts of time. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3645--3654. http://dl.acm.org/citation.cfm?id=2556996 Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 3--14. http://dl.acm.org/citation.cfm?id=2632054 Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Rui Wang, Gabriella Harari, Peilin Hao, Xia Zhou, and Andrew T. Campbell. 2015. SmartGPA: how smartphones can assess and predict academic performance of college students. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. ACM, 295--306. http://dl.acm.org/citation.cfm?id=2804251 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Ladd Wheeler and Harry T. Reis. 1991. Self-Recording of Everyday Life Events: Origins, Types, and Uses. Journal of Personality 59, 3 (Sept. 1991), 339--354.Google ScholarGoogle ScholarCross RefCross Ref
  41. Xiaoyi Zhang, Laura R. Pina, and James Fogarty. 2016. Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness. ACM Press, 5658--5664. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
        Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 1
        March 2018
        1370 pages
        EISSN:2474-9567
        DOI:10.1145/3200905
        Issue’s Table of Contents

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 26 March 2018
        • Accepted: 1 January 2018
        • Revised: 1 November 2017
        • Received: 1 May 2017
        Published in imwut Volume 2, Issue 1

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader