Extending direct manipulation in a text editor

ABSTRACT

This paper describes the implementation of a prototype text editor that incorporates conversation-like features through the direct-manipulation modality. In this way, traditional direct-manipulation interaction techniques such as direct reference via pointing can be extended to include techniques more commonly associated with human conversation, such as negotiation of reference. The paper illustrates the use of the prototype with an extended example, and discusses research issues raised by the implementation.

REFERENCES

• 1: Michel Beaudouin-Lafon, Instrumental interaction: an interaction model for designing post-WIMP user interfaces, Proceedings of the SIGCHI conference on Human factors in computing systems, p.446-453, April 01-06, 2000, The Hague, The Netherlands [doi>10.1145/332040.332473]
• 2: Clark and Marshall, 1981} Herbert Clark and Catherine Marshall. Definite reference and mutual knowledge. In A K. Joshi, B. L. Webber, I. A. Sag (Eds.), Elements of discourse understanding, pages 10--63. Cambridge University Press New York, 1981.
• 3: Clark, H., and Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition. 22, 1--39.
• 4: Allen Cypher, EAGER: programming repetitive tasks by example, Proceedings of the SIGCHI conference on Human factors in computing systems: Reaching through technology, p.33-39, April 27-May 02, 1991, New Orleans, Louisiana, United States [doi>10.1145/108844.108850]
• 5: Lynn Lambert , Sandra Carberry, Modeling negotiation subdialogues, Proceedings of the 30th annual meeting on Association for Computational Linguistics, p.193-200, June 28-July 02, 1992, Newark, Delaware [doi>10.3115/981967.981992]
• 6: Robert C. Miller , Brad A. Myers, Interactive Simultaneous Editing of Multiple Text Regions, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.161-174, June 25-30, 2001
• 7: Novick, D., (2001). "Conversational" Dialogues in Direct-Manipulation Interfaces, Proceedings of the 2nd IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Seattle, WA, August 5, 2001.
• 8: {Novick and Perez-Quiñones, 1998}. David Novick and Perez-Quiñones. Cooperating with computers: Abstracting from action to situated acts, Proceedings of the Ninth European Conference on Cognitive Ergonomics (ECCE-9), pages 49--54. Limerick, IR, August, 1998. European Association for Cognitive Ergonomics.
• 9: Gordon W. Paynter, Generalizing Programming by Demonstration, Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI '96), p.344, November 24-27, 1996
• 10: Schober, M. F., and Clark, H. H. (1989). Understanding by addressees and overhearers. Cognitive Psychology, 21, 211--232.
• 11: Shneiderman, B. (1983). Direct manipulation: A step beyond programming languages. IEEE Computer, 16(8):57--69, 1983.
• 12: {Suchman, 1987} Lucy Suchman. Plans and situated actions. Cambridge University Press, Cambridge, 1987.
• 13: Suhm. B. Empirical evaluation of interactive multimodal error correction, IEEE Workshop on Automatic Speech Recognition and Understanding, , Santa Barbara (CA), 1997, 583--590

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation)

General Terms:
Documentation, Human Factors

Keywords:
direct manipulation