skip to main content
10.1145/1056808.1056885acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Faces of emotion in human-computer interaction

Published: 02 April 2005 Publication History

Abstract

The study of users' emotional behavior in the Human-Computer Interaction (HCI) field has received increasing attention during the last few years. Our work in this area focuses on the relationship between user emotions and perceived usability problems. Specifically, we propose to observe users' spontaneous facial expressions as a method to identify adverse-event occurrences at the user interface level.This paper reports on the results of an experiment designed to investigate the association between adverse-event occurrences during a word processing task and users' facial expressions monitored using electromyogram (EMG) sensor devices. The results suggest that an increase of task difficulty is related to an increase in specific facial muscle activity, thus creating a baseline for future developments using camera-based monitoring of facial activities.

References

[1]
Brave, S., Nass, C. Emotion in Human-Computer Interaction. In J. Jacko & A. Sears (Eds.), The Human-Computer Interaction Handbook. Hillsdale, NJ: Lawrence Erlbaum Associates, 2003.
[2]
Computer Users Suffer 'PC Rage'. (2002). Retrieved December 13, 2004, from: http://www.mori.com/polls/ 2002/bthomecomputing.shtml
[3]
Ekman P. Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. Psychological Bulletin 115, 2 (1994), 268--287.
[4]
Hazlett, R. Measurement of User Frustration: A Biologic Approach. Ext. Abstracts CHI 2003, ACM Press (2003), 734--735.
[5]
Neven Vision. (n.d.). Retrieved December 13, 2004, from: http://www.nevenvision.com/products/fft-SDK.html
[6]
Picard, R. W., Vyzas, E., Healey, J., Toward Machine Emotional Intelligence: Analysis of Affective Physiological State, IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 10 (2001), 1175--1191.
[7]
Reynolds, C. The Sensing and Measurement of Frustration with Computers. Master's thesis, MIT, 2001.
[8]
Scherer, K. R. What does facial expression express? In K. Strongman (Ed.), International Review of Studies on Emotion. 2 (1992), 139--165.
[9]
van Reekum, C. Levels of Processing in Appraisal: Evidence From Computer Game Generated Emotions. Doctoral dissertation, University of Geneve, 2000.
[10]
Ward R D, Marsden P H, Cahill B and Johnson C. Using skin conductivity to detect emotionally significant events in human-computer interaction. Proc. IHM-HCI 2001.

Cited By

View all
  • (2024)Development of a low-cost, compact, wireless, 16 - channel biopotential data acquisition, signal conditioning and arbitrary waveform stimulatorBiomedical Physics & Engineering Express10.1088/2057-1976/ad17a810:2(025002)Online publication date: 4-Jan-2024
  • (2022)Information Overload!Research Anthology on Managing Crisis and Risk Communications10.4018/978-1-6684-7145-6.ch030(587-612)Online publication date: 1-Jul-2022
  • (2021)Information Overload!Digital Services in Crisis, Disaster, and Emergency Situations10.4018/978-1-7998-6705-0.ch003(50-76)Online publication date: 29-Jan-2021
  • Show More Cited By

Index Terms

  1. Faces of emotion in human-computer interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems
    April 2005
    1358 pages
    ISBN:1595930027
    DOI:10.1145/1056808
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 April 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affective computing
    2. emotion
    3. facial expressions

    Qualifiers

    • Article

    Conference

    CHI05
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 14 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Development of a low-cost, compact, wireless, 16 - channel biopotential data acquisition, signal conditioning and arbitrary waveform stimulatorBiomedical Physics & Engineering Express10.1088/2057-1976/ad17a810:2(025002)Online publication date: 4-Jan-2024
    • (2022)Information Overload!Research Anthology on Managing Crisis and Risk Communications10.4018/978-1-6684-7145-6.ch030(587-612)Online publication date: 1-Jul-2022
    • (2021)Information Overload!Digital Services in Crisis, Disaster, and Emergency Situations10.4018/978-1-7998-6705-0.ch003(50-76)Online publication date: 29-Jan-2021
    • (2021)Complex Website Tasks Increase the Expression Anger Measured with FaceReader OnlineInternational Journal of Human–Computer Interaction10.1080/10447318.2021.1938390(1-7)Online publication date: 11-Jun-2021
    • (2020)Deep convolution network based emotion analysis towards mental health careNeurocomputing10.1016/j.neucom.2020.01.034388:C(212-227)Online publication date: 7-May-2020
    • (2018)What Eye Movements and Facial Expressions Tell Us about User-Friendliness: Testing a Tool for Communicators and JournalistsSocial Media Use in Crisis and Risk Communication10.1108/978-1-78756-269-120181014(205-225)Online publication date: 13-Sep-2018
    • (2017)Portable multipurpose bio-signal acquisition and wireless streaming device for wearables2017 IEEE Sensors Applications Symposium (SAS)10.1109/SAS.2017.7894053(1-6)Online publication date: 13-Mar-2017
    • (2016)IoT-based remote facial expression monitoring system with sEMG signal2016 IEEE Sensors Applications Symposium (SAS)10.1109/SAS.2016.7479847(1-6)Online publication date: Apr-2016
    • (2015)Facial Expression Recognition with sEMG Method2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing10.1109/CIT/IUCC/DASC/PICOM.2015.148(981-988)Online publication date: Oct-2015
    • (2014)Detecting emotional stress during typing task with time pressure2014 Science and Information Conference10.1109/SAI.2014.6918207(329-338)Online publication date: Aug-2014
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media