skip to main content
10.1145/1868914.1868989acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
short-paper

Seeking a theoretical foundation for design of in sitro usability assessments

Published: 16 October 2010 Publication History

Abstract

Recent studies on usability assessment methodology suggest that features of real-word use settings can be replicated in laboratories in order to combine realism with a high level of control. The field of human-computer interaction, however, lacks theoretical foundation for how to design well scoped and targeted in sitro, or simulation-based usability assessments. In this paper, we draw parallels between usability assessments and training simulations. We argue that the same mechanisms through which training simulations are adjusted to optimize transfer of skills can also be used in usability assessments conducted in sitro to trigger user reflections on specific design aspects.

References

[1]
Kaikkonen, A., Keklinen, A., Cankar, M., Kallio, T. and Kankainen, A. Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1, 1 (2005), 4--16.
[2]
Kjeldskov, J., Skov, M. B., Als, B. S. and Høegh, R. T. Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field. In Proc. Mobile HCI 2004, ACM Press (2004), 61--73.
[3]
Nielsen, C. M., Overgaard, M., Pedersen, M. B., Stage, J. and Stenild, S. It's worth the hassle!: the added value of evaluating the usability of mobile systems in the field. In Proc. NordiCHI 2006, ACM Press (2006), 272--280.
[4]
Kjeldskov, J. and Skov, M. B. Studying Usability In Sitro: Simulating Real World Phenomena in Controlled Environments. International Journal of Human-Computer Interaction, 22, 1 (2007), 7--36.
[5]
Alsos, O. A. and Dahl, Y. Toward a best practice for laboratory-based usability evaluations of mobile ICT for hospitals. In Proc. NordiCHI 2008, ACM Press (2008), 3--12.
[6]
Goodman, J., Brewster, S. and Gray, P. Using Field Experiments to Evaluate Mobile Guides, In Proc. HCI in Mobile Guides, workshop at MobileHCI 2004.
[7]
Gagné, R. M. Simulators. In Training Research and Education, R. Glaser, Editor. Wiley: New York, 1962.
[8]
Svanæs, D. and Seland, G. Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proc. CHI 2004, ACM Press (2004), 479--486.
[9]
Liu, D., Blickensderfer, E. L., Macchiarella, N. D. and Vincenzi, D. A. Transfer of training. In Human Factors in Simulation and Training. CRC Press, 2008.
[10]
ISO 9241--11, Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11: Guidance on Usability. 1998.
[11]
Liu, D., Macchiarella, N. D. and Vincenzi, D. A. Simulation Fidelity. In Human Factors in Simulation and Training. CRC Press, 2008.
[12]
Gross, D. C., Pace, D., Harmoon, S. and Tucker, W. Why fidelity? In Proc. of the Spring 1999 Simulation Interoperability Workshop. 1999.
[13]
Kozlowski, S. W. J. and DeShon, R. P. A psychological fidelity approach to simulation-based training: theory, research and principles. In Scaled Worlds: Development, Validation and Applications, Ashgate Publishing, 2004.
[14]
Maran, N. J. and Glavin, R. J. Low- to high-fidelity simulation -- a continuum of medical education? Medical Education, 37, 1 (2003): 22--28.
[15]
Alessi, S. M., Fidelity in the Design of Instructional Simulations. Journal of Computer-Based Instruction, 15, 2 (1988) 40--47.
[16]
Rehmann, A., Mitman, R. and Reynolds, M. A handbook of flight simulation fidelity requirements for human factors research. Tech. Report No. DOT/FAA/CT-TN95/46. Wright-Patterson AFB, OH: Crew Systems Ergonomics Information Analysis Cente, 1995.
[17]
Dahl, Y. and Svanæs, D. A comparison of location and token-based interaction techniques for point-of-care access to medical information. Personal and Ubiquitous Computing, 12, 6 (2008) 459--478.
[18]
Alsos, O. A. and Svanæs, D. Interaction techniques for using handhelds and PCs together in a clinical setting. In Proc. NordCHI 2006. ACM Press (2006), 125--134.
[19]
Seland, G. System designer assessments of role play as a design method: a qualitative study. In Proc. NordiCHI 2006. ACM Press (2006) 222--231.

Cited By

View all
  • (2014)Was it worth the hassle?Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628398(43-52)Online publication date: 23-Sep-2014

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
October 2010
889 pages
ISBN:9781605589343
DOI:10.1145/1868914
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Reykjavik University
  • University of Iceland

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fidelity
  2. simulation
  3. training simulation
  4. usability assessment
  5. user-centered design

Qualifiers

  • Short-paper

Conference

NordiCHI '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2014)Was it worth the hassle?Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services10.1145/2628363.2628398(43-52)Online publication date: 23-Sep-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media