extended-abstract

Measuring user experience of websites: think aloud protocols and an emotion word prompt list

Authors:

Helen Petrie,

John PreciousAuthors Info & Claims

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Pages 3673 - 3678

https://doi.org/10.1145/1753846.1754037

Published: 10 April 2010 Publication History

Get Access

Abstract

To develop simple yet effective methods for eliciting user experience of websites and other interactive technologies, we explored the use of two techniques: an emotional think aloud protocol and an emotion word prompt list (EWPL). A study of four websites with 16 participants found that a retrospective emotional think aloud protocol produced significantly more emotion words than an equivalent concurrent protocol; plus, with on average 40 emotion words per website, it appears an effective technique for eliciting users emotional reactions to websites. Surprisingly, the use of the EWPL did not produce more emotion words per website, but may still help users overcome their difficulties in expressing emotional reactions to websites when unprompted. Further research will explore the use of these methods with other interactive technologies.

References

[1]

Birns, J.H., Joffre, K.A., Leclerc, J.F. and Paulsen, C.A. (2002). Getting the whole picture: collecting usability data using two methods - concurrent think aloud and retrospective probing. Proceedings of UPA Conference, July 8 - 12, Orlando. Available at: www.usabilityair.org/publications/christinepaulsen/upa_thinkaloud_paper.pdf

Google Scholar

[2]

Dumas, J.S. and Redish, J.C. (1999). A practical guide to usability testing. Exeter, UK: Intellect.

Digital Library

Google Scholar

[3]

Ericsson, A. K. and Simon, H. A. (1993). Protocol Analysis - Rev'd Edition: Verbal Reports as Data. The MIT Press, revised edition.

Google Scholar

[4]

Haak, M., de Jong, M., and Schellens, P. J. (2003). Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behaviour & Information Technology, 22(5):339--351.

Crossref

Google Scholar

[5]

Harrison, C. (2009). Exploring emotional web experience: more than just usability and good design. Phd Thesis, University of York, UK.

Google Scholar

[6]

Hassenzahl, M. (2008). User experience (UX): towards an experiential perspective on product quality. In Proceedings of IHM08 (20th French-speaking Conference on Human-Computer Interaction - Conference Francophone sur l'Interaction Homme-Machine).

Digital Library

Google Scholar

[7]

International Organization for Standardization. (ISO). ISO/DIN CD 9241: Ergonomics of human-system interaction. Part 210: Human-centred design for interactive systems. Geneva, Switzerland: ISO.

Google Scholar

[8]

Petrie, H. and Harrison, C. (2009). Measuring users' emotional reactions to websites. In Proceedings of CHI 2009 (Extended Abstracts), April 4 - 9, 2009, Boston Massachusetts, USA. New York: ACM Press.

Digital Library

Google Scholar

Cited By

View all

Marin-Alvarez ECarcelen-Garcia SGalmes-Cerezo M(2024)A Holistic and Multidimensional Methodology Proposal for a Persona with Total Visual Impairment Archetype on the WebSocieties10.3390/soc1407010214:7(102)Online publication date: 27-Jun-2024
https://doi.org/10.3390/soc14070102
Hertzum M(2024)Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic ReviewACM Transactions on Computer-Human Interaction10.1145/366532731:3(1-29)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665327
Dekkal MProm Tep SArcand MRajaobelina LRicard L(2024)“Ready for Your Insurance Quote?” the Impact of Chatbot Empathy on Emotions and User ExperienceMarketing and Smart Technologies10.1007/978-981-97-1552-7_11(155-171)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-981-97-1552-7_11
Show More Cited By

Index Terms

Measuring user experience of websites: think aloud protocols and an emotion word prompt list
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Measuring users' emotional reactions to websites
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

Initial research to investigate users' emotional reactions to websites is presented. An Emotion Words Priming List (EWPL) was developed for UK English speakers and used to prompt users in an evaluation of 6 websites. Only half the words on the EWPL V1 ...
Emotional user experience

Emotional experience has become an important topic in human-technology interaction research and design. Nevertheless, such research and design often lacks a proper explanatory basis and methodologically robust operationalisation. In this article, a ...
Emotional user experience and feeling of control
AcademicMindTrek '15: Proceedings of the 19th International Academic Mindtrek Conference

Current research on emotional user experience lacks a clear exposition on the relationship between feeling of control and the emotion response. The appraisal theory of emotion posits that perceived control over an event is an important factor in ...

Comments

Information & Contributors

Information

Published In

CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

April 2010

2219 pages

ISBN:9781605589305

DOI:10.1145/1753846

General Chairs:
Elizabeth Mynatt
Georgia Institute of Technology
,
Don Schoner
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

CHI EA '10 Paper Acceptance Rate 350 of 1,346 submissions, 26%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
1,391
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)6

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Marin-Alvarez ECarcelen-Garcia SGalmes-Cerezo M(2024)A Holistic and Multidimensional Methodology Proposal for a Persona with Total Visual Impairment Archetype on the WebSocieties10.3390/soc1407010214:7(102)Online publication date: 27-Jun-2024
https://doi.org/10.3390/soc14070102
Hertzum M(2024)Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic ReviewACM Transactions on Computer-Human Interaction10.1145/366532731:3(1-29)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3665327
Dekkal MProm Tep SArcand MRajaobelina LRicard L(2024)“Ready for Your Insurance Quote?” the Impact of Chatbot Empathy on Emotions and User ExperienceMarketing and Smart Technologies10.1007/978-981-97-1552-7_11(155-171)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-981-97-1552-7_11
Ferraris CDavis TGatzidis CHargood C(2023)Digital Cultural Items in Space: The Impact of Contextual Information on Presenting Digital Cultural ItemsJournal on Computing and Cultural Heritage 10.1145/359472516:4(1-15)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3594725
(2023)ReferencesMeasuring the User Experience10.1016/B978-0-12-818080-8.00022-4(333-344)Online publication date: 2023
https://doi.org/10.1016/B978-0-12-818080-8.00022-4
Mhd Pauzi MWeng KSiran ZKu Saud KAhmad MMahadzir M(2022)Face Shield 3D Printing User Experience Using Think Aloud Method During Pandemic in Malaysia2nd International Conference on Creative Multimedia 2022 (ICCM 2022)10.2991/978-2-494069-57-2_31(294-304)Online publication date: 24-Dec-2022
https://doi.org/10.2991/978-2-494069-57-2_31
Khong CMhd. Pauzi M(2022)3D Scan of Malaysian Culture and Heritage Objects2nd International Conference on Creative Multimedia 2022 (ICCM 2022)10.2991/978-2-494069-57-2_14(115-123)Online publication date: 24-Dec-2022
https://doi.org/10.2991/978-2-494069-57-2_14
Azam WSulaiman SRambli DMean F(2021)Exploring User Preferences on eText Interface Design to Support Reading Among Low Vision Elders2021 International Conference on Computer & Information Sciences (ICCOINS)10.1109/ICCOINS49721.2021.9497191(195-200)Online publication date: 13-Jul-2021
https://doi.org/10.1109/ICCOINS49721.2021.9497191
Allison RHayes CYoung VMcNulty C(2020)Evaluation of an Educational Health Website on Infections and Antibiotics in England: Mixed Methods, User-Centered ApproachJMIR Formative Research10.2196/145044:4(e14504)Online publication date: 6-Apr-2020
https://doi.org/10.2196/14504
Demirkol DSeneler C(2019)Evaluation of Student Information System (SIS) In Terms of User Emotion, Performance and Perceived Usability: A Turkish University Case (An Empirical Study)Procedia Computer Science10.1016/j.procs.2019.09.145158(1033-1051)Online publication date: 2019
https://doi.org/10.1016/j.procs.2019.09.145
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Measuring users' emotional reactions to websites

Emotional user experience

Emotional user experience and feeling of control

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations