The challenges of user-centered design and evaluation for infrastructure

ABSTRACT

Infrastructure software comprises code libraries or runtime processes that support the development or operation of application software. A particular infrastructure system may support certain styles of application, and may even determine the features of applications built using it. This poses a challenge: although we have good techniques for designing and evaluating interactive applications, our techniques for designing and evaluating infrastructure intended to support these applications are much less well formed. In this paper, we reflect on case studies of two infrastructure systems for interactive applications. We look at how traditional user-centered techniques, while appropriate for application design and evaluation, fail to properly support infrastructure design and evaluation. We present a set of lessons from our experience, and conclude with suggestions for better user-centered design and evaluation of infrastructure software.

REFERENCES

• 1: Alexander, C., Ishikawa, S., Silverstein, M., Jacobson, M., Fiksdahl-King, I. and Angel, S. A Pattern Language. Oxford University Press, Oxford, UK, 1977.
• 2: CORPORATE Apple Computer Inc., Inside MacIntosh: MacIntosh Toolbox Essentials, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1992
• 3: Bass, L., John, B.E. and Kates, J. Achieving Usability Through Software Architecture. Carnegie Mellon University. 2001, 2001.
• 4: Kent Beck, Extreme programming explained: embrace change, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 5: Steve B. Cousins , Andreas Paepcke , Terry Winograd , Eric A. Bier , Ken Pier, The digital library integrated task environment (DLITE), Proceedings of the second ACM international conference on Digital libraries, p.142-151, July 23-26, 1997, Philadelphia, Pennsylvania, United States [doi>10.1145/263690.263807]
• 6: Anind K. Dey , Gregory D. Abowd, CybreMinder: A Context-Aware System for Supporting Reminders, Proceedings of the 2nd international symposium on Handheld and Ubiquitous Computing, p.172-186, September 25-27, 2000, Bristol, UK
• 7: Anind K. Dey , Daniel Salber , Gregory D. Abowd , Masayasu Futakawa, The Conference Assistant: Combining Context-Awareness with Wearable Computing, Proceedings of the 3rd IEEE International Symposium on Wearable Computers, p.21, October 18-19, 1999
• 8: Dey, A.K., Salber, D. and Abowd, G.D. A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Human Computer Interaction, 16 (2--4). 2001.
• 9: Paul Dourish , W. Keith Edwards , Anthony LaMarca , John Lamping , Karin Petersen , Michael Salisbury , Douglas B. Terry , James Thornton, Extending document management systems with user-specific active properties, ACM Transactions on Information Systems (TOIS), v.18 n.2, p.140-170, April 2000 [doi>10.1145/348751.348758]
• 10: Paul Dourish , John Lamping , Tom Rodden, Building bridges: customisation and mutual intelligibility in shared category management, Proceedings of the international ACM SIGGROUP conference on Supporting group work, p.11-20, November 14-17, 1999, Phoenix, Arizona, United States [doi>10.1145/320297.320299]
• 11: Fredrik Espinoza , Per Persson , Anna Sandin , Hanna Nyström , Elenor Cacciatore , Markus Bylund, GeoNotes: Social and Navigational Aspects of Location-Based Information Systems, Proceedings of the 3rd international conference on Ubiquitous Computing, p.2-17, September 30-October 02, 2001, Atlanta, Georgia, USA
• 12: Fowler, M., http://martinfowler.com/articles/newMethodology.html.
• 13: Erich Gamma , Richard Helm , Ralph Johnson , John Vlissides, Design patterns: elements of reusable object-oriented software, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1995
• 14: Scott E. Hudson , John T. Stasko, Animation support in a user interface toolkit: flexible, robust, and reusable abstractions, Proceedings of the 6th annual ACM symposium on User interface software and technology, p.57-67, December 1993, Atlanta, Georgia, United States [doi>10.1145/168642.168648]
• 15: Ivar Jacobson , Martin Griss , Patrik Jonsson, Software reuse: architecture, process and organization for business success, ACM Press/Addison-Wesley Publishing Co., New York, NY, 1997
• 16: Anthony LaMarca , W. Keith Edwards , Paul Dourish , John Lamping , Ian Smith , Jim Thornton, Taking the work out of workflow: mechanisms for document-centered collaboration, Proceedings of the Sixth European conference on Computer supported cooperative work, p.1-20, August 1999, Copenghagen, Denmark
• 17: Kris Nagel , Cory D. Kidd , Thomas O'Connell , Anind K. Dey , Gregory D. Abowd, The Family Intercom: Developing a Context-Aware Audio Communication System, Proceedings of the 3rd international conference on Ubiquitous Computing, p.176-183, September 30-October 02, 2001, Atlanta, Georgia, USA
• 18: Mark Roseman , Saul Greenberg, GROUPKIT: a groupware toolkit for building real-time conferencing applications, Proceedings of the 1992 ACM conference on Computer-supported cooperative work, p.43-50, November 01-04, 1992, Toronto, Ontario, Canada [doi>10.1145/143457.143460]
• 19: Daniel Salber , Anind K. Dey , Gregory D. Abowd, The context toolkit: aiding the development of context-enabled applications, Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, p.434-441, May 15-20, 1999, Pittsburgh, Pennsylvania, United States [doi>10.1145/302979.303126]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Evaluation/methodology

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
            Subjects: Domain-specific architectures
        D.2.13 Reusable Software
            Subjects: Domain engineering
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

  H. Information Systems
  H.1 MODELS AND PRINCIPLES
      H.1.2 User/Machine Systems
          Subjects: Human factors
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Evaluation/methodology
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Prototyping; User-centered design

General Terms:
Design, Human Factors