research-article

ToolClips: an investigation of contextual video assistance for functionality understanding

Authors:

George FitzmauriceAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1515 - 1524

https://doi.org/10.1145/1753326.1753552

Published: 10 April 2010 Publication History

Abstract

We investigate the use of on-line contextual video assistance to improve the learnability of software functionality. After discussing motivations and design goals for such forms of assistance, we present our new technique, ToolClips. ToolClips augment traditional tooltips to provide users with quick and contextual access to both textual and video assistance. In an initial study we found that users successfully integrated ToolClip usage into the flow of their primary tasks to overcome learnability difficulties. In a second study, we found that with ToolClips, users successfully completed 7 times as many unfamiliar tasks, in comparison to using a commercial professionally developed on-line help system. Users also retained the information obtained from ToolClips, performing tasks significantly faster one week later.

Supplementary Material

JPG File (p1515.jpg)

Download
21.00 KB

MOV File (p1515.mov)

Download
27.66 MB

References

[1]

Ames, A.L. (2001). Just what they need, just when they need it: an introduction to embedded assistance. ACM SIGDOC. 111--115.

Digital Library

[2]

Anderson, J.R., Boyle, C.F., Farrell, R. and Reisner, B.J. (1984). Cognitive principles in the design of computer tutors. Cognitive Science Society. 2--9.

[3]

Baecker, R. (2002). Showing instead of telling. ACM SIGDOC. 10--16.

Digital Library

[4]

Baecker, R., Small, I. and Mander, R. (1991). Bringing icons to life. ACM CHI. 1--6.

Digital Library

[5]

Buxton, W., Billinghurst, M., Guiard, Y., Sellen, A. and Zhai, S. (2009). Human Input to Computer Systems: Theories, Techniques and Technology -- A Work in Progress. www.billbuxton.com/inputManuscript.html

[6]

Carroll, J.M. (1990). The Nurnberg Funnel. MIT Press.

[7]

Carroll, J.M. and Rosson, M.B. (1987). Paradox of the active user. Interfacing thought: cognitive aspects of human-computer interaction. MIT Press. 80--111.

Digital Library

[8]

Dix, A., Finlay, J.E., Abowd, G.D. and Beale, R., Human Conputer Interaction: Prentice-Hall, Inc.

Digital Library

[9]

Dutke, S. and Reimer, T. (2000). Evaluation of two types of online help information for application software: Operative and function-oriented help. Journal of Computer-Assisted Learning. 16:307--315.

[10]

Ehret, B.D. (2002). Learning where to look: location learning in graphical user interfaces. CHI. 211--218.

Digital Library

[11]

Farkas, D.K. (1993). The role of balloon help. Journal of Computer Documentation. 17(2):3--19.

Digital Library

[12]

Goodall, S.D. (1992). Online help: a part of documentation. Systems Documentation. 169--174.

Digital Library

[13]

Grabler, F., Agrawala, M., Li, W., Dontcheva, M. and Igarashi, T. (2009). Generating photo manipulation tutorials by demonstration. ACM SIGGRAPH. 66.

Digital Library

[14]

Grossman, T., Fitzmaurice, G. and Attar, R. (2009). A Survey of Software Learnability: Metrics, Methodologies and Guidelines. ACM CHI. 649--658.

Digital Library

[15]

Harrison, S.M. (1995). A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface. ACM CHI. 82--89.

Digital Library

[16]

Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research. Int. J. of Human--Computer Studies. 64(2):79--102.

Digital Library

[17]

Huang, J. and Twidale, M. B. (2007). Graphstract: minimal graphical help for computers. UIST. 203--212.

Digital Library

[18]

Jackson, S. (2001). Editing computer hardware procedures for multimedia presentation. ACM SIGDOC. 68--72.

Digital Library

[19]

Kelleher, C. and Pausch, R. (2005). Stencils-based tutorials: design and evaluation. ACM CHI. 541--550.

Digital Library

[20]

Knabe, K. (1995). Apple guide: a case study in user-aided design of online help. ACM CHI. 286--287.

Digital Library

[21]

Lazar, J., Jones, A. and Shneiderman, B. (2006). Workplace user frustration with computers: An exploratory investigation of the causes and severity. Behaviour and Information Technology. 25(3):239--251.

[22]

Liu, T.-Y., Huang, Y.-C. and Chen, W.-C. (2001). A novel algorithm for real-time full screen capture system. Multimedia Signal Processing. 395--400.

[23]

Mack, R.L., Lewis, C.H. and Carroll, J.M. (1983). Learning to use word processors: problems and prospects. ACM Trans. on Inf. Systems. 1(3):254--271.

Digital Library

[24]

Nielsen, J. (1994). Usability Engineering. Morgan Kaufmann.

Digital Library

[25]

Palmiter, S. and Elkerton, J. (1991). An evaluation of animated demonstrations of learning computer-based tasks. ACM CHI. 257--263.

Digital Library

[26]

Palmiter, S. and Elkerton, J. (1993). Animated demonstrations for learning procedural computer-based tasks. Human.-Computer Interaction. 8(3):193--216.

Digital Library

[27]

Palmiter, S., Elkerton, J. and Baggett, P. (1991). Animated demonstrations vs. written instructions for learning procedural tasks: a preliminary investigation. Int. J. of Man-Machine Studies. 34(5):687--701.

Digital Library

[28]

Plaisant, C. and Shneiderman, B. (2005). Show Me! Guidelines for Producing Recorded Demonstrations. Visual Languages and Human-Centric Comp. 171--178.

Digital Library

[29]

Rettig, M. (1991). Nobody reads documentation. Communications of the ACM. 34(7):19--24.

Digital Library

[30]

Sellen, A. and Nicol, A. (1995). Building user-centered on-line help. Human-computer interaction: toward the year 2000. Morgan Kaufmann Publishers. 718--723.

Digital Library

[31]

Shneiderman, B. (1983). Direct Manipulation: A Step Beyond Programming Languages. Computer. 16(8):57--69.

Digital Library

[32]

Shneiderman, B. (1997). Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Inc.

Digital Library

[33]

Spannagel, C., Girwidz, R., Lothe, H, Zendler, A. and Schroeder, U. (2008). Animated demonstrations and training wheels interfaces in a complex learning environment. Interacting with Computers. 20(1):97--111.

Digital Library

[34]

Sukaviriya, P. (1988). Dynamic construction of animated help from application context. ACM UIST. 190--202.

Digital Library

[35]

Sukaviriya, P., Isaacs, E. and Bharat, K. (1992). Multimedia help: a prototype and an experiment. ACM CHI. 433--434.

Digital Library

[36]

Terry, M. and Mynatt, E.D. (2002). Side views: persistent, on-demand previews for open-ended tasks. ACM UIST. 71--80.

Digital Library

[37]

Tuck, R. and Olsen, D.R. (1990). Help by guided tasks: utilizing UIMS knowledge. ACM CHI. 71--78.

Digital Library

[38]

Zeleznik, R.C., Bragdon, A., Liu, C.-C. and Forsberg, A. (2008). Lineogrammer: creating diagrams by drawing. ACM UIST. 161--170.

Digital Library

Cited By

Mao JLyu BLin KPan X(2025)Applying Prototype Theory to Assess Generational Divide in Usability of Icons Depicting Product AppearanceInternational Journal of Human–Computer Interaction10.1080/10447318.2025.2470281(1-24)Online publication date: 3-Mar-2025
https://doi.org/10.1080/10447318.2025.2470281
Khurana AChilana PKostakos VKay JHoang T(2024)Understanding Novice Users' Mental Models of Gesture Discoverability and Designing Effective OnboardingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678370(290-295)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678370
Artizzu VLuyten KRuiz GSpano L(2024)ViRgilites: Multilevel Feedforward for Multimodal Interaction in VRProceedings of the ACM on Human-Computer Interaction10.1145/36586458:EICS(1-24)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3658645
Show More Cited By

Index Terms

ToolClips: an investigation of contextual video assistance for functionality understanding
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Augmenting icons for deaf computer users
CHI EA '04: CHI '04 Extended Abstracts on Human Factors in Computing Systems

Tooltips (TTs) can be used to make icons more understandable to users. However, text-based tooltips will not assist users with print disabilities. Four types of TTs to assist deaf and hearing impaired users were implemented: Sign Language, Picture (an ...
Post-transitioning user performance on cross-device menu interfaces
Highlights
- First study to investigate user performance with multiple menu interfaces across devices with focusing on performance after transitioning from one device to ...
Abstract
Multi-device user-interaction behavior creates a need to design cross-device menus that support users to re-locate menu items efficiently and effectively after the transition from one device to another. We conducted two laboratory ...
Lessons learned from SUIT, the simple user interface toolkit
Special issue on user interface software and technology

In recent years, the computer science community has realized the advantages of GUIs (Graphical User Interfaces). Because high-quality GUIs are difficult to build, support tools such as UIMSs, UI Toolkits, and Interface Builders have been developed. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

107
Total Citations
View Citations
1,457
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)6

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mao JLyu BLin KPan X(2025)Applying Prototype Theory to Assess Generational Divide in Usability of Icons Depicting Product AppearanceInternational Journal of Human–Computer Interaction10.1080/10447318.2025.2470281(1-24)Online publication date: 3-Mar-2025
https://doi.org/10.1080/10447318.2025.2470281
Khurana AChilana PKostakos VKay JHoang T(2024)Understanding Novice Users' Mental Models of Gesture Discoverability and Designing Effective OnboardingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678370(290-295)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678370
Artizzu VLuyten KRuiz GSpano L(2024)ViRgilites: Multilevel Feedforward for Multimodal Interaction in VRProceedings of the ACM on Human-Computer Interaction10.1145/36586458:EICS(1-24)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3658645
Emerson AEndow STorres C(2024)Anther: Cross-Pollinating Communities of Practice via Video TutorialsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660727(1991-2005)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660727
Khurana ASubramonyam HChilana P(2024)Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-SeekingProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645200(288-303)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645200
Khurana AGlueck MChilana P(2024)Do I Just Tap My Headset?Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314517:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631451
Tanprasert TDai JMcGrenere J(2024)HelpCall: Designing Informal Technology Assistance for Older Adults via VideoconferencingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642938(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642938
Li CZhang ZSaugstad MSafranchik EKulkarni CHuang XPatel SIyer VAlthoff TFroehlich J(2024)LabelAId: Just-in-time AI Interventions for Improving Human Labeling Quality and Domain Knowledge in Crowdsourcing SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642089(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642089
Rezaie MTory MCarpendale S(2024)Struggles and Strategies in Understanding Information VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.338856030:6(3035-3048)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3388560
Beaudouin-Lafon ME JXia H(2023)Color Field: Developing Professional Vision by Visualizing the Effects of Color FiltersProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606828(1-16)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606828
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten