Article

The challenges of user-centered design and evaluation for infrastructure

Authors:

W. Keith Edwards,

Victoria Bellotti,

Mark W. NewmanAuthors Info & Claims

CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 297 - 304

https://doi.org/10.1145/642611.642664

Published: 05 April 2003 Publication History

Abstract

Infrastructure software comprises code libraries or runtime processes that support the development or operation of application software. A particular infrastructure system may support certain styles of application, and may even determine the features of applications built using it. This poses a challenge: although we have good techniques for designing and evaluating interactive applications, our techniques for designing and evaluating infrastructure intended to support these applications are much less well formed. In this paper, we reflect on case studies of two infrastructure systems for interactive applications. We look at how traditional user-centered techniques, while appropriate for application design and evaluation, fail to properly support infrastructure design and evaluation. We present a set of lessons from our experience, and conclude with suggestions for better user-centered design and evaluation of infrastructure software.

References

[1]

Alexander, C., Ishikawa, S., Silverstein, M., Jacobson, M., Fiksdahl-King, I. and Angel, S. A Pattern Language. Oxford University Press, Oxford, UK, 1977.]]

[2]

Apple Computer, Macintosh: Macintosh Toolbox Essentials, 1993.]]

Digital Library

[3]

Bass, L., John, B.E. and Kates, J. Achieving Usability Through Software Architecture. Carnegie Mellon University. 2001, 2001.]]

[4]

Beck, K. Extreme Programming Explained: Embrace Change. Addison-Wesley, 1999.]]

Digital Library

[5]

Cousins, S.B., Paepcke, A., Winograd, T., Bier, E.A. and Pier, K., The Digital Library Automated Task Environment (DLITE). In Proceedings of ACM International Conference on Digital Libraries, (1997).]]

Digital Library

[6]

Dey, A.K. and Abowd, G., CybreMinder: A Context-Aware System for Supporting Reminders. In Proceedings of Symposium on Handheld and Ubiquitous Computing (HUC), (2000), Springer-Verlag.]]

Digital Library

[7]

Dey, A.K., Futakawa, M., Salber, D. and Abowd, G., The Conference Assistant: Combining Context-Awareness with Wearable Computing. In Proceedings of International Symposium on Wearable Computers (ISWC), (1999).]]

Digital Library

[8]

Dey, A.K., Salber, D. and Abowd, G.D. A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Human Computer Interaction, 16 (2--4). 2001.]]

Digital Library

[9]

Dourish, P., Edwards, W.K., LaMarca, A., Lamping, J., Petersen, K., Salisbury, M., Thornton, J. and Terry, D.B. Extending Document Management Systems with Active Properties. ACM Transactions on Information Systems (TOIS). 2000.]]

Digital Library

[10]

Dourish, P., Lamping, J. and Rodden, T., Building Bridges: Customisation and Mutual Intelligibility in Shared Category Management. In Proceedings of ACM Conference on Supporting Group Work (GROUP), (1999).]]

Digital Library

[11]

Espinoza, F., Persson, P., Sandin, A., Nystrom, H., Cacciatore, E. and Bylund, M., GeoNotes: Social and Navigational Aspects of Location-Based Information Systems. In Proceedings of Ubicomp, (2001), Springer-Verlag.]]

Digital Library

[12]

Fowler, M., http://martinfowler.com/articles/newMethodology.html.]]

[13]

Gamma, E., Helm, R., Johnson, R. and Vlissides, J. Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley, Reading, Massachusetts, 1994.]]

Digital Library

[14]

Hudson, S.E. and Stasko, J.T., Animation Support in a User Interface Toolkit: Flexible, Robust, and Reusable Abstractions. In Proceedings of Symposium on User Interface Software and Technology (UIST), (1993), ACM.]]

Digital Library

[15]

Jacobson, I., Griss, M. and Jonsson, P. Software Reuse: Architecture, Process and Organization for Business Success. ACM Press, New York, NY, 1997.]]

Digital Library

[16]

LaMarca, A., Edwards, W.K., Dourish, P., Lamping, J., Smith, I.E. and Thornton, J.D., Taking the Work out of Workflow: Mechanisms for Document-Centered Collaboration. In Proceedings of European Conference on Computer-Supported Cooperative Work (ECSCW), (Copenhagen, Denmark, 1999).]]

Digital Library

[17]

Nagel, K., Kidd, C., O'Connell, T., Dey, A.K. and Abowd, G.D., The Family Intercom: Developing a Context-Aware Communication System. In Proceedings of Ubicomp, (2001), Springer-Verlag.]]

Digital Library

[18]

Roseman, M. and Greenberg, S., GROUPKIT: A Groupware Toolkit for Building Real-Time Conferencing Applications. In Proceedings of Conference on Computer-Supported Cooperative Work (CSCW), (1992).]]

Digital Library

[19]

Salber, D., Dey, A.K. and Abowd, G.D., The Context Toolkit: Aiding the Development of Context-Enabled Applications. In Proceedings of Conference on Human Factors in Computing Systems (CHI '99), (Pittsburgh, PA USA, 1999), 434--441.]]

Digital Library

Cited By

Sultana SPritha STasnim RDas AAkter RHasan SAlam SKabir MAhmed S(2022)‘ShishuShurokkha’: A Transformative Justice Approach for Combating Child Sexual Abuse in BangladeshProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517543(1-23)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517543
Bernardo FZbyszyński MGrierson MFiebrink R(2020)Designing and Evaluating the Usability of a Machine Learning API for Rapid Prototyping Music TechnologyFrontiers in Artificial Intelligence10.3389/frai.2020.000133Online publication date: 3-Apr-2020
https://doi.org/10.3389/frai.2020.00013
Bernardo FGrierson MFiebrink R(2018)User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning ToolkitJournal of Science and Technology of the Arts10.7559/citarj.v10i2.50910:2(2)Online publication date: 11-Jul-2018
https://doi.org/10.7559/citarj.v10i2.509
Show More Cited By

Index Terms

The challenges of user-centered design and evaluation for infrastructure
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
      2. User centered design
2. Software and its engineering
  1. Software notations and tools
    1. Context specific languages
      1. Domain specific languages
    2. Development frameworks and environments
      1. Integrated and visual development environments
  2. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

User-centered design, activity-centered design, and goal-directed design: a review of three methods for designing web applications
SIGDOC '09: Proceedings of the 27th ACM international conference on Design of communication

When conducting research with users in order to design web applications, the practitioner has a variety of methods from which to choose. This paper examines three such methods'User-Centered Design (UCD), Goal-Directed Design (GDD), and Activity-Centered ...
Optimizing agile user-centred design
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems
The goal of this workshop is to improve future Agile user centred design (UCD) experiences for User Experience (UX) practitioners (such as interaction designers, usability professionals, UI designers, etc.) by investigating best practices for Agile UCD. ...
User Evaluation of Age-Centred Web Design Guidelines
UAHCI '09: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Addressing Diversity. Part I: Held as Part of HCI International 2009

We report an evaluation of a set of age-centred web design guidelines (SilverWeb guidelines) with older web users. We invited 24 older web users and used a cooperative evaluation to validate the guidelines and collect any additional problems. As a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2003

620 pages

ISBN:1581136307

DOI:10.1145/642611

Conference Chairs:
Gilbert Cockton
University of Sunderland, UK
,
Panu Korhonen
Nokia Research Center, Finland

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 April 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

CHI03

Sponsor:

CHI03: Human Factors in Computing Systems

April 5 - 10, 2003

Florida, Ft. Lauderdale, USA

Acceptance Rates

CHI '03 Paper Acceptance Rate 75 of 468 submissions, 16%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
3,776
Total Downloads

Downloads (Last 12 months)135
Downloads (Last 6 weeks)9

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sultana SPritha STasnim RDas AAkter RHasan SAlam SKabir MAhmed S(2022)‘ShishuShurokkha’: A Transformative Justice Approach for Combating Child Sexual Abuse in BangladeshProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517543(1-23)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517543
Bernardo FZbyszyński MGrierson MFiebrink R(2020)Designing and Evaluating the Usability of a Machine Learning API for Rapid Prototyping Music TechnologyFrontiers in Artificial Intelligence10.3389/frai.2020.000133Online publication date: 3-Apr-2020
https://doi.org/10.3389/frai.2020.00013
Bernardo FGrierson MFiebrink R(2018)User-Centred Design Actions for Lightweight Evaluation of an Interactive Machine Learning ToolkitJournal of Science and Technology of the Arts10.7559/citarj.v10i2.50910:2(2)Online publication date: 11-Jul-2018
https://doi.org/10.7559/citarj.v10i2.509
Bellucci AAedo IDíaz P(2017)ECCE Toolkit: Prototyping Sensor-Based InteractionSensors10.3390/s1703043817:3(438)Online publication date: 23-Feb-2017
https://doi.org/10.3390/s17030438
Marquardt NHouben SBeaudouin-Lafon MWilson AMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)HCIToolsProceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/3027063.3027073(624-627)Online publication date: 6-May-2017
https://dl.acm.org/doi/10.1145/3027063.3027073
Boden AAl-Akkad ALiegl MBuscher MStein MRandall DWulf V(2016)Managing Visibility and Validity of Distress Calls with an Ad-Hoc SOS SystemACM Transactions on Computer-Human Interaction10.1145/298738223:6(1-26)Online publication date: 21-Nov-2016
https://dl.acm.org/doi/10.1145/2987382
Gandy MMacIntyre BBenko HDontcheva MWigdor D(2014)Designer's augmented reality toolkit, ten years laterProceedings of the 27th annual ACM symposium on User interface software and technology10.1145/2642918.2647369(627-636)Online publication date: 5-Oct-2014
https://dl.acm.org/doi/10.1145/2642918.2647369
Al-Akkad ARamirez LBoden ARandall DZimmermann AJones MPalanque PSchmidt AGrossman T(2014)Help beaconsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557002(1485-1494)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557002
Wagner ABarbosa JBarbosa D(2014)A model for profile management applied to ubiquitous learning environmentsExpert Systems with Applications: An International Journal10.1016/j.eswa.2013.08.09841:4(2023-2034)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1016/j.eswa.2013.08.098
Houben SNielsen SEsbensen MBardram JKranz MSynnes KBoring SLaerhoven K(2013)NooSphereProceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia10.1145/2541831.2541856(1-10)Online publication date: 2-Dec-2013
https://dl.acm.org/doi/10.1145/2541831.2541856
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten