skip to main content
10.1145/1520340.1520619acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

User experience evaluation in the wild

Published: 04 April 2009 Publication History

Abstract

This article details experience feedback resulting from a user experience study in the wild (i.e. in-situ). The system under test was a mobile device for skiers, which aimed at improving their users' experience. The skiers were equipped with a mini-camera, an accelerometer and a geo-localization system. Thanks to a smartphone, they could replay, on trails, theirs best performances (video, maximum speed, ...). The article focuses both on the methodological and the technological issues encountered during these experimentations, and proposes recommendations.

References

[1]
Kjeldskov, J. and Graham, C. A Review of Mobile HCI Research Methods, in Proc. Mobile Human-Computer Interaction -- MobileHCI'2003 (Udine, Italy, 2003), Lecture Notes in Computer Science, Berlin, Springer-Verlag, pp. 317--335.
[2]
Duh, H.B.-L., Tan, G.C.B. and Chen, V.H.-H. Usability evaluation for mobile device: a comparison of laboratory and field tests, in Proc. Proceedings of the 8th conference on human-computer interaction with mobile devices and services (Helsinki, Finland, 2006), ACM Press, pp. 181--186.
[3]
Kaikkonen, A., Kekäläinen, A., Cankar, M., Kallio, T. and Kankainen, A. Usability Testing of Mobile Applications: A Comparison between Laboratory and Field Testing. Journal of Usability Studies. 1, 1 (2005), pp. 4--17.
[4]
Kjeldskov, J., Skov, M., Als, B. and Høegh, R. Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field, in Proc. Mobile Human-Computer Interaction -- MobileHCI'2004 (Glasgow, UK, 13--16 September, 2004), Lecture Notes in Computer Science, Springer-Verlag, 3160, pp. 61--73.
[5]
Jambon, F. User Evaluation of Mobile Devices: In-Situ versus Laboratory Experiments. International Journal of Mobile Computer-Human Interaction. 1, 2 (2009), pp. 56--71. In Press.
[6]
Kellar, M., Reilly, D., Hawkey, K., Rodgers, M., MacKay, B., Dearman, D., Ha, V., MacInnes, W.J., Nunes, M., Parker, K., Whalen, T. and Inkpen, K.M. It's a jungle out there: practical considerations for evaluation in the city, in Proc. CHI'05 extended abstracts on Human factors in computing systems (Portland, OR, USA, 2005), ACM Press, pp. 1533--1536.

Cited By

View all
  • (2024)How Design Researchers Make Sense of Data Visualizations in Data-Driven Design: An Uncertainty-Aware Sensemaking ModelACM Transactions on Computer-Human Interaction10.1145/368526831:6(1-53)Online publication date: 31-Jul-2024
  • (2023)Binary Social Game: A Principle for Enhancing Desired Behaviors through Asynchronous Social InteractionsAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610684(25-29)Online publication date: 8-Oct-2023
  • (2022)From-The-Wild: Towards Co-Designing For and From NatureExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519811(1-7)Online publication date: 27-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems
April 2009
2470 pages
ISBN:9781605582474
DOI:10.1145/1520340
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Check for updates

Author Tags

  1. in-situ evaluation
  2. mobile devices
  3. user experience
  4. user tests

Qualifiers

  • Extended-abstract

Conference

CHI '09
Sponsor:

Acceptance Rates

CHI EA '09 Paper Acceptance Rate 385 of 1,130 submissions, 34%;
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)How Design Researchers Make Sense of Data Visualizations in Data-Driven Design: An Uncertainty-Aware Sensemaking ModelACM Transactions on Computer-Human Interaction10.1145/368526831:6(1-53)Online publication date: 31-Jul-2024
  • (2023)Binary Social Game: A Principle for Enhancing Desired Behaviors through Asynchronous Social InteractionsAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610684(25-29)Online publication date: 8-Oct-2023
  • (2022)From-The-Wild: Towards Co-Designing For and From NatureExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519811(1-7)Online publication date: 27-Apr-2022
  • (2022)Research in the WildundefinedOnline publication date: 8-Mar-2022
  • (2021)Online Hazard Recognition Training: Comparative Case Study of Static Images, Cinemagraphs, and VideosJournal of Construction Engineering and Management10.1061/(ASCE)CO.1943-7862.0002090147:8Online publication date: Aug-2021
  • (2019)Real-Time Aural and Visual Feedback for Improving Violin IntonationFrontiers in Psychology10.3389/fpsyg.2019.0062710Online publication date: 2-Apr-2019
  • (2019)Virtually the Same Experience?Proceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322288(463-473)Online publication date: 18-Jun-2019
  • (2019)Usability Evaluation of Lexicographic e-Services2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA)10.1109/AICCSA47632.2019.9035226(1-7)Online publication date: Nov-2019
  • (2017)Recommendations for the Design of Urban Mobility Applications Based on the Study of the User ExperienceProceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems10.1145/3160504.3160517(1-10)Online publication date: 23-Oct-2017
  • (2016)Rhythmic haptic cueing for gait rehabilitation of neurological conditionsProceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!10.14236/ewic/HCI2016.3(1-8)Online publication date: 11-Jul-2016
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media