skip to main content
10.1145/1124772.1124843acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

A new error metric for text entry method evaluation

Published: 22 April 2006 Publication History

Abstract

On devices such as mobile phones, text is often entered using keypads and predictive text entry techniques. Current metrics used for measuring text entry error rates have limitations in terms of the types of errors they account for, and cannot easily distinguish between different types of errors. This research proposes a new text entry error metric that addresses some of the outstanding issues that exist with current metrics. Specifically, the metric accounts in detail for the way the user handles corrections during text entry, moving beyond current keystroke level error measurement. The feasibility and usefulness of this new metric is shown through the analysis of an experiment that tests an alphabetically constrained keypad design that includes upper and lower case letters, numbers, and punctuation marks.

References

[1]
Gong, J., and Tarasewich, P. Alphabetically constrained keypad designs for text entry on mobile devices, In Proc. of CHI 2005, (2005), 211--220.
[2]
Isokoski, P. Performance of menu-augmented soft keyboards, In Proc. of CHI 2004, (2004), 423--430.
[3]
MacKenzie, I. S., and Soukoreff, R. W. Phrase sets for evaluating text entry techniques, In Ext. Abstracts of CHI 2003, (2003), 754--755.
[4]
MacKenzie, I. S., and Soukoreff, R. W. Input-based language modeling in the design of high performance input systems, In Proc. of Graphics Interface 2003, (2003), 89--96.
[5]
Soukoreff, R.W., and MacKenzie, I.S., Metrics for text entry research: An evaluation of MSD and KSPC, and a new unified error metric, In Proc. of CHI 2003, (2003), 113--120.
[6]
Soukoreff, R.W, and MacKenzie, I.S., Recent developments in text-entry error rate measurement, In Ext. Abstracts of CHI 2004, (2004), 1425--1428.
[7]
Wobbrock, J.O. and Myers, B.A., Analyzing the input stream for character-level errors in unconstrained text entry evaluations, working paper, (2005). Available at: www.cs.cmu.edu/~jrock/pubs/texteval.pdf.
[8]
Zhai, S., Hunter, M., and Smith, B.A. Performance Optimization of Virtual Keyboards, Human Computer Interaction 17(2, 3), (2002), 229--270.

Cited By

View all
  • (2019)Beyond the Input StreamProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347922(831-842)Online publication date: 17-Oct-2019
  • (2012)Cost of error correction quantification with Bengali text transcription2012 4th International Conference on Intelligent Human Computer Interaction (IHCI)10.1109/IHCI.2012.6481828(1-6)Online publication date: Dec-2012
  • (2008)Design and evaluation of korean text entry methods for mobile phonesCHI '08 Extended Abstracts on Human Factors in Computing Systems10.1145/1358628.1358773(2853-2858)Online publication date: 5-Apr-2008
  • Show More Cited By

Index Terms

  1. A new error metric for text entry method evaluation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    April 2006
    1353 pages
    ISBN:1595933727
    DOI:10.1145/1124772
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 April 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. error metrics
    2. mobile device user interface design
    3. novice learning and usability
    4. predictive keypad text entry

    Qualifiers

    • Article

    Conference

    CHI06
    Sponsor:
    CHI06: CHI 2006 Conference on Human Factors in Computing Systems
    April 22 - 27, 2006
    Québec, Montréal, Canada

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)12
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 30 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)Beyond the Input StreamProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347922(831-842)Online publication date: 17-Oct-2019
    • (2012)Cost of error correction quantification with Bengali text transcription2012 4th International Conference on Intelligent Human Computer Interaction (IHCI)10.1109/IHCI.2012.6481828(1-6)Online publication date: Dec-2012
    • (2008)Design and evaluation of korean text entry methods for mobile phonesCHI '08 Extended Abstracts on Human Factors in Computing Systems10.1145/1358628.1358773(2853-2858)Online publication date: 5-Apr-2008
    • (2007)Text Entry SystemsundefinedOnline publication date: 12-Mar-2007

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media