skip to main content
10.1145/1166253.1166304acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
Article

CueTIP: a mixed-initiative interface for correcting handwriting errors

Published: 15 October 2006 Publication History

Abstract

With advances in pen-based computing devices, handwriting has become an increasingly popular input modality. Researchers have put considerable effort into building intelligent recognition systems that can translate handwriting to text with increasing accuracy. However, handwritten input is inherently ambiguous, and these systems will always make errors. Unfortunately, work on error recovery mechanisms has mainly focused on interface innovations that allow users to manually transform the erroneous recognition result into the intended one. In our work, we propose a mixed-initiative approach to error correction. We describe CueTIP, a novel correction interface that takes advantage of the recognizer to continually evolve its results using the additional information from user corrections. This significantly reduces the number of actions required to reach the intended result. We present a user study showing that CueTIP is more efficient and better preferred for correcting handwriting recognition errors. Grounded in the discussion of CueTIP, we also present design principles that may be applied to mixed-initiative correction interfaces in other domains.

Supplementary Material

JPG File (1166304.jpg)
index.html (index.html)
Slides from the presentation
ZIP File (p323-slides.zip)
Supplemental material for CueTIP: a mixed-initiative interface for correcting handwriting errors
Audio only (1166304.mp3)
Video (1166304.mp4)

References

[1]
Goldberg, D., & Goodisman, A. (1991). Stylus User Interfaces for Manipulating Text. Proceedings of Fourth Annual ACM Symposium on User Interface Software and Technology, 127--135.
[2]
Halverson, C., Horn, D., Karat, C., Karat, J. (1999). The Beauty of Errors: Patterns of Error Correction in Desktop Speech Systems. Proceedings of Interact 1999, 133--140.
[3]
Horvitz, E. (1999). Principles of Mixed-Initiative User Interfaces. Proceedings of CHI 1999 Conference on Human Factors in Computing Systems, 159--166.
[4]
Huerst, W., Yang, J., & Waibel, A. (1998). Interactive Error Repair for an Online Handwriting Interface. Proceedings of CHI 1998 Conference on Human Factors in Computing Systems, 353--354.
[5]
Jelinek, F (1997). Statistical Methods for Speech Recognition. The MIT Press.
[6]
Kristjansson, T., Culotta, A., Viola, P., & McCallum, A. (2004). Interactive Information Extraction with Constrained Conditional Random Fields. Proceedings of the 19th AAAI International Conference on Artificial Intelligence, 412--418.
[7]
Mankoff, J., Hudson, S. E., Abowd, G. D. (2000). Interaction Techniques for Ambiguity Resolution in Recognition-based Interfaces. Proceedings of Thirteenth Annual ACM Symposium on User Interface Software and Technology, 11--20.
[8]
Microsoft Tablet Input Panel. Retrieved 1 April 2006: www.microsoft.com/windowsxp/using/tabletpc/pen/correcttext.mspx.
[9]
Oviatt, S. L. (2000). Taming Recognition Errors with a Multimodal Interface. Communications of the ACM, 43(9), 45--51.
[10]
Oviatt, S. L., & R. VanGent (1996). Error Resolution During Multimodal Human-Computer Interaction. Proceedings of the 1996 International Conference on Spoken Language Processing, 1, 204--207.
[11]
Plamondon, R., & Srihari, S. (2000). On-line and Off-line Handwriting Recognition: A Comprehensive Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1), 63--84.
[12]
Schomaker, L. R. B. (1994). User-interface Aspects in Recognizing Connected-Cursive Handwriting. Proceedings of the IEE Colloquium on Handwriting and Pen-based Input, 1994/065, 8/1-8/3.
[13]
Smithies, S., Novins, K., & Arvo, J. (1999). A Handwriting-Based Equation Editor. Proceedings of Graphics Interface, 84--91.
[14]
Tappert, C. C., Suen, C. Y., & Wakahara, T. (1990). The State of the Art in On-Line Handwriting Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(8), 787--808.

Cited By

View all
  • (2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
  • (2021)Designing Deep Reinforcement Learning for Human Parameter ExplorationACM Transactions on Computer-Human Interaction10.1145/341447228:1(1-35)Online publication date: 20-Jan-2021
  • (2019)Interactive Repair of Tables Extracted from PDF Documents on Mobile DevicesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300523(1-13)Online publication date: 2-May-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology
October 2006
354 pages
ISBN:1595933131
DOI:10.1145/1166253
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. constraints
  2. correction interface
  3. handwriting recognition
  4. mixed initiative
  5. user study

Qualifiers

  • Article

Conference

UIST06

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25
The 38th Annual ACM Symposium on User Interface Software and Technology
September 28 - October 1, 2025
Busan , Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 09 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
  • (2021)Designing Deep Reinforcement Learning for Human Parameter ExplorationACM Transactions on Computer-Human Interaction10.1145/341447228:1(1-35)Online publication date: 20-Jan-2021
  • (2019)Interactive Repair of Tables Extracted from PDF Documents on Mobile DevicesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300523(1-13)Online publication date: 2-May-2019
  • (2018)A Review of User Interface Design for Interactive Machine LearningACM Transactions on Interactive Intelligent Systems10.1145/31855178:2(1-37)Online publication date: 13-Jun-2018
  • (2018)CommunityDiffACM Transactions on Knowledge Discovery from Data10.1145/304700912:1(1-34)Online publication date: 10-Jan-2018
  • (2016)In-Place-InkProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992184(67-76)Online publication date: 6-Nov-2016
  • (2016)My Text in Your HandwritingACM Transactions on Graphics10.1145/288609935:3(1-18)Online publication date: 18-May-2016
  • (2015)DataToneProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807478(489-500)Online publication date: 5-Nov-2015
  • (2014)User adaptation to a faulty unistroke-based text entry technique by switching to an alternative gesture setProceedings of Graphics Interface 201410.5555/2619648.2619679(183-192)Online publication date: 7-May-2014
  • (2014)CiteSightProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609585(807-816)Online publication date: 3-Jul-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media