Article

An evaluation of using programming by demonstration and guided walkthrough techniques for authoring and utilizing documentation

Authors:

Madhu Prabaker,

Lawrence Bergman,

Vittorio CastelliAuthors Info & Claims

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 241 - 250

https://doi.org/10.1145/1124772.1124809

Published: 22 April 2006 Publication History

Abstract

Much existing documentation is informal and serves to communicate "how-to" knowledge among restricted working groups. Using current practices, such documentation is both difficult to maintain and difficult to use properly.In this paper, we propose a documentation system, called DocWizards, that uses programming by demonstration to support low-cost authoring and guided walkthrough techniques to improve document usability.We report a comparative study between the use of DocWizards and traditional techniques for authoring and following documentation. The study participants showed significant gains in efficiency and reduction in error rates when using DocWizards. In addition, they expressed a clear preference for using the DocWizards tool, both for authoring and for following documentation.

References

[1]

Apple Guide. http://developer.apple.com/documentation/index.html

[2]

Bergman, L.D., Castelli, V., Lau, T.A., and Oblinger, D. DocWizards: a system for authoring follow-me documentation wizards. Proc. UIST, ACM Press (2005), 191--200.

Digital Library

[3]

Camtasia website: http://www.techsmith.com/products/studio/default.asp.

[4]

Carroll, J.M., and Kay, D.S. Prompting, feedback and error correction in the design of the scenario machine. Int. J. of Man-Machine Studies, 28 (1998) 11--27.

Digital Library

[5]

Cypher, A., ed. Watch what I do: programming by demonstration. The MIT Press, Cambridge, MA, 1993.

Digital Library

[6]

Designing Coachmarks. http://www.developer.apple.com/techpubs/mac/AppleGuide/AppleGuide-24.html

[7]

Eclipse IDE® website: http://www.eclipse.org.

[8]

Forward, A. and Lethbridge, T.C. The relevance of software documentation, tools, and technology: a survey. Proc. DocEng 2002, McLean (2002), 26--33.

Digital Library

[9]

Goodall, S. Online help in the real world. Proc. SIGDOC 1991, ACM Press (1991) 1--44.

Digital Library

[10]

Heuristic Evaluation: How-to: http://www.useit.com/papers/heuristic/heuristic_evaluation.html

[11]

Jackson, K., Krajcik, J. and Soloway, E. The design of guided learner-adaptable scaffolding in interactive learning environments. Proc. CHI 1998, ACM Press (1998), 187--194.

Digital Library

[12]

Kelleher, C. and Pausch, R. Stencils-based tutorials: design and evaluation. Proc. CHI 2005, ACM Press (2005), 541--550.

Digital Library

[13]

Knabe, K. Apple guide: a case study in user-aided design of online help. Proc. CHI 1995, ACM Press (1995), 286--287.

Digital Library

[14]

Lau, T.A., Bergman, L.D., Castelli, V., and Oblinger, D. Sheepdog: learning procedures for technical support. Proc. IUI 2004, ACM Press (2004), 109--116.

Digital Library

[15]

Lau, T.A., Wolfman, S., Domingos, P. and Weld, D.S. Learning repetitive text-editing procedures with SMARTedit, in Lieberman, ed. Your wish is my command: giving users the power to instruct their software, Morgan Kaufmann, 2001.

Digital Library

[16]

Lieberman, H., ed. Your wish is my command: programming by example, Morgan Kauffman, 2001.

[17]

McDaniel, R.G. and Myers, B.A. Building applications using only demonstration. Proc. IUI 1998, ACM Press (1998), 109--116.

Digital Library

[18]

Microsoft® Word: http://office.microsoft.com.

[19]

Oblinger, D., Castelli, V., and Bergman, L.D. Augmentation-based learning, combining observations and user edits for programming-by-demonstration. Proc. IUI 2006, ACM Press (2006), to appear.

Digital Library

[20]

Quintana, C., et al. Symphony: a case study in extending learner-centered design through process space analysis. Proc of CHI 1999, ACM Press (1999), 473--480.

Digital Library

[21]

RWD Technologies®: http://www.rwd.org.

[22]

Siegel S. and Castellan, N.J. Jr. Nonparametric statistics for the behavioral sciences, 2nd Edition, McGraw-Hill, New York, 1998.

[23]

Wallace, R., et al. ARTEMIS: learner-centered design of an information seeking environment for K-12 education. Proc CHI 1998, ACM Press (1998), 195--202.

Digital Library

Cited By

Hsu W(2015)Creating Open Source Lecture MaterialsSTEM Education10.4018/978-1-4666-7363-2.ch004(68-94)Online publication date: 2015
https://doi.org/10.4018/978-1-4666-7363-2.ch004
Hsu W(2015)Creating Open Source Lecture MaterialsOpen Source Technology10.4018/978-1-4666-7230-7.ch020(336-363)Online publication date: 2015
https://doi.org/10.4018/978-1-4666-7230-7.ch020
Hynes NBegole BKim JInkpen KWoo W(2015)Realism in Interactive TutorsProceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2702613.2726963(115-120)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702613.2726963
Show More Cited By

Index Terms

An evaluation of using programming by demonstration and guided walkthrough techniques for authoring and utilizing documentation
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Efficient authoring of software documentation using RaPiD7
ICSE '03: Proceedings of the 25th International Conference on Software Engineering

This paper presents a method, developed in Nokia, for efficient document authoring in software development projects. The method is called RaPiD7 (Rapid Production of Documentation, 7 steps). The method improves traditional approach for document ...
Documentation threads - presentation of fragmented documentation

In this paper, we introduce a means for presenting fragmented documentation through a concept called documentation threads. A documentation thread presents a number of documentation fragments specified by the programmer and can guide a documentation ...
Using offline documentation online

Current interactive programs usually provide some form of online documentation in addition to the traditional hard-copy user's manual. To save the expense of writing two documents covering the same material, it is not uncommon to find offline manuals ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2006

1353 pages

ISBN:1595933727

DOI:10.1145/1124772

Editors:
Rebecca Grinter
Georgia Institute of Technology, USA
,
Thomas Rodden
University of Nottingham, UK
,
Paul Aoki
Intel, USA
,
Ed Cutrell
Microsoft, USA
,
Robin Jeffries
Google, USA
,
Gary Olson
University of Michigan, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI06

Sponsor:

CHI06: CHI 2006 Conference on Human Factors in Computing Systems

April 22 - 27, 2006

Québec, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
913
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hsu W(2015)Creating Open Source Lecture MaterialsSTEM Education10.4018/978-1-4666-7363-2.ch004(68-94)Online publication date: 2015
https://doi.org/10.4018/978-1-4666-7363-2.ch004
Hsu W(2015)Creating Open Source Lecture MaterialsOpen Source Technology10.4018/978-1-4666-7230-7.ch020(336-363)Online publication date: 2015
https://doi.org/10.4018/978-1-4666-7230-7.ch020
Hynes NBegole BKim JInkpen KWoo W(2015)Realism in Interactive TutorsProceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2702613.2726963(115-120)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702613.2726963
Shah MShah AAhmed ARehman A(2013)User support approche for “Global Users Support Standardization and Establishment Organization (GUSSEO)”Eighth International Conference on Digital Information Management (ICDIM 2013)10.1109/ICDIM.2013.6693965(175-181)Online publication date: Sep-2013
https://doi.org/10.1109/ICDIM.2013.6693965
Qattous HGray PWelland RSucci GMorisio MNagappan N(2010)An empirical study of specification by example in a software engineering toolProceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/1852786.1852808(1-10)Online publication date: 16-Sep-2010
https://dl.acm.org/doi/10.1145/1852786.1852808
Lau TDrews CNichols J(2009)Interpreting written how-to instructionsProceedings of the 21st International Joint Conference on Artificial Intelligence10.5555/1661445.1661675(1433-1438)Online publication date: 11-Jul-2009
https://dl.acm.org/doi/10.5555/1661445.1661675
Yeh TChang TMiller RWilson AGuimbretière F(2009)SikuliProceedings of the 22nd annual ACM symposium on User interface software and technology10.1145/1622176.1622213(183-192)Online publication date: 4-Oct-2009
https://dl.acm.org/doi/10.1145/1622176.1622213
Wiedenbeck SSun XChintakovid T(2007)Antecedents to End Users' Success in Learning to Program in an Introductory Programming CourseProceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing10.1109/VLHCC.2007.9(69-72)Online publication date: 23-Sep-2007
https://dl.acm.org/doi/10.1109/VLHCC.2007.9
Gweon GBergman LCastelli VBellamy R(2007)Evaluating an Automated Tool to Assist Evolutionary Document GenerationProceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing10.1109/VLHCC.2007.20(243-248)Online publication date: 23-Sep-2007
https://dl.acm.org/doi/10.1109/VLHCC.2007.20
Castelli VOblinger DBergman L(2007)Augmentation-Based Learning combining observations and user edits for Programming-by-DemonstrationKnowledge-Based Systems10.1016/j.knosys.2007.04.00720:6(575-591)Online publication date: 1-Aug-2007
https://dl.acm.org/doi/10.1016/j.knosys.2007.04.007
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten