skip to main content
10.1145/1753846.1753985acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

Mobile questionnaires for user experience evaluation

Published: 10 April 2010 Publication History

Abstract

As user experience studies move from laboratories to mobile context, we need tools for collecting data in natural settings. Based on the results from a pilot study, we present early guidelines for designing mobile questionnaires to be filled in on handheld, palm-sized mobile devices. We found that special attention needs to be paid to the clarity and simplicity of the structure, layout and questionnaire content, including questions, visual icons, items and scales. In addition to the requirements set by the screen size, also data entry method, interaction style and mobile context related issues need to be taken into account when designing questionnaires for mobile devices.

References

[1]
Bradley, M., and Lang, P.J. Measuring emotion - the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25 (1994), 49--59.
[2]
Hassenzahl, M. The thing and I: Understanding the relationship between users and product. In Funology: From usability to enjoyment, M.A. Blythe, K. Overbeeke, A.F. Monk, P.C. Wright, Eds. Kluwer, The Netherlands (2003), 31--42.
[3]
Hektner, J. M., Schmidt, J.A. and Csikszentmihalyi, M. Experience Sampling Method, Measuring the Quality of Everyday Life. Sage Publications Inc., USA (2007).
[4]
Hornbæk, K. Current practices in measuring usability: Challenges to usability studies and research. Int. J. Hum.-Comput. Stud. 64 (2006), 79--102.
[5]
Isomursu, M., Tähti, M., Väinämö, S. and Kuutti, K. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int. J. Hum.-Comput. Stud. 65 (2007), 404--418.
[6]
Jones, M., Marsden, G., Mohd-Nasir, N., Boone, K. and Buchanan, G. 1999. Improving web interaction in small screen displays. Proc. WWW8 (1999), 51--59.
[7]
Jumisko-Pyykkö, S. and Vainio, T. Framing the Context of Use for Mobile HCI. Int. J. of Mobile-Human-Computer-Interaction (IJMHCI), 2, 1 (2010).
[8]
Meschtscherjakov, A., Weiss, A. and Scherndl, T. Utilizing Emoticons on mobile devices within ESM studies to measure emotions in the field. Proc. MME in conjunction with MobileHCI'09 (2009).
[9]
Mulder, I., ter Hofte, G.H. and Kort, J. SocioXensor: Measuring user behaviour and user eXperience in conteXt with mobile devices. Proc. Measuring Behavior 2005 (2005), 355--358.
[10]
Sauro, J. and Dumas, J.S. Comparison of Three One-Question, Post-Task Usability Questionnaires. Proc. CHI 2009, ACM Press (2009), 1599--1608.
[11]
Väätäjä, H., Koponen, T. and Roto, V. Developing practical tools for user experience evaluation - a case from mobile news journalism. Proc. ECCE 2009, ACM Press (2009), 240--247.
[12]
Zhang, D. and Adipat, B. 2005. Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications. Int. J. Hum-Comput.Stud. 18, 3 (2005), 293--308.

Cited By

View all
  • (2023)The Human-Centredness Metric: Early Assessment of the Quality of Human-Centred Design ActivitiesApplied Sciences10.3390/app13211209013:21(12090)Online publication date: 6-Nov-2023
  • (2019)Capitalizing on new forms of academic library’s intellectual assets: a new library mobile application propositionEducation and Information Technologies10.1007/s10639-019-09944-wOnline publication date: 1-Jul-2019
  • (2019)User Experience Evaluation in eModeration: The Case of Higher Education Institutions in Developing CountriesDigital Transformation for a Sustainable Society in the 21st Century10.1007/978-3-030-29374-1_50(621-633)Online publication date: 14-Aug-2019
  • Show More Cited By
  1. Mobile questionnaires for user experience evaluation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems
    April 2010
    2219 pages
    ISBN:9781605589305
    DOI:10.1145/1753846

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 April 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. evaluation
    2. experience sampling
    3. field study
    4. mobile devices
    5. questionnaires
    6. user experience

    Qualifiers

    • Extended-abstract

    Conference

    CHI '10
    Sponsor:

    Acceptance Rates

    CHI EA '10 Paper Acceptance Rate 350 of 1,346 submissions, 26%;
    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)18
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)The Human-Centredness Metric: Early Assessment of the Quality of Human-Centred Design ActivitiesApplied Sciences10.3390/app13211209013:21(12090)Online publication date: 6-Nov-2023
    • (2019)Capitalizing on new forms of academic library’s intellectual assets: a new library mobile application propositionEducation and Information Technologies10.1007/s10639-019-09944-wOnline publication date: 1-Jul-2019
    • (2019)User Experience Evaluation in eModeration: The Case of Higher Education Institutions in Developing CountriesDigital Transformation for a Sustainable Society in the 21st Century10.1007/978-3-030-29374-1_50(621-633)Online publication date: 14-Aug-2019
    • (2018)User Experience in Mobile Augmented Reality: Emotions, Challenges, Opportunities and Best PracticesComputers10.3390/computers70200337:2(33)Online publication date: 21-May-2018
    • (2018)eModeration: The Validation of a User Experience Evaluation FrameworkInnovative Technologies and Learning10.1007/978-3-319-99737-7_25(241-252)Online publication date: 6-Sep-2018
    • (2017)Electronic Questionnaires Design and ImplementationThe Open Nursing Journal10.2174/187443460171101015711:1(157-202)Online publication date: 31-Oct-2017
    • (2017)Collocated Use of Imaging Systems in Coordinated Surgical PracticeProceedings of the ACM on Human-Computer Interaction10.1145/31347131:CSCW(1-17)Online publication date: 6-Dec-2017
    • (2017)A Nine-Item Questionnaire for Measuring the Social Disfordance of Mediated Social Touch TechnologiesProceedings of the ACM on Human-Computer Interaction10.1145/31347121:CSCW(1-17)Online publication date: 6-Dec-2017
    • (2017)Would You Slack That?Proceedings of the ACM on Human-Computer Interaction10.1145/31347101:CSCW(1-22)Online publication date: 6-Dec-2017
    • (2017)A Sociotechnical Study of a Community-based Rewards ProgramProceedings of the ACM on Human-Computer Interaction10.1145/31346901:CSCW(1-21)Online publication date: 6-Dec-2017
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media