skip to main content
10.1145/1647314.1647358acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
technical-note

A multimodal predictive-interactive application for computer assisted transcription and translation

Published: 02 November 2009 Publication History

Abstract

Traditionally, Natural Language Processing (NLP) technologies have mainly focused on full automation. However, full automation often proves unnatural in many applications, where technology is expected to assist rather than replace the human agents.
In consequence, Multimodal Interactive (MI) technologies have emerged. On the one hand, the user interactively co-operates with the system to improve system accuracy. On the other hand, multimodality improves system ergonomics.
In this paper, we present an application that implements such MI technologies. First, we have designed an Application Programming Interface (API), featuring a client-server framework, to deal with most common NLP MI tasks. Second, we have developed a generic client application. The resulting client-server architecture has been successfully tested with two di erent NLP problems: transcription of text images and translation of texts.

References

[1]
A. Lagarda, L. Rodríguez, E. Cubel, E. Vidal, and F. Casacuberta. Transtype 2. un sistema de ayuda a la traducción. In Proceeding of the SEPLN: XIX Congreso de la Sociedad Española para el Procesamiento del Lenguaje, pages 345--346, Septiembre 2003.
[2]
D. Ortiz-Martınez, I. Garcıa-Varea, and F. Casacuberta. Thot: a toolkit to train phrase-based statistical translation models. In Tenth Machine Translation Summit. AAMT, Phuket, Thailand, September 2005.
[3]
V. Romero, L. A. Levia, A. H. Toselli, and E. Vidal. Interactive multimodal transcription of text image using a web-based demo system. In Procedings of the International Conference on Intelligent User Interfaces, pages 477--478. Sanibel Island, Florida, February 2009.
[4]
A. H. Toselli, V. Romero, and E. Vidal. Computer assisted transcription of text images and multimodal interaction. In Proceedings of the 5th Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms, volume 5237 of LNCS, pages 296--308. Utrecht, The Netherlands, September 2008.

Cited By

View all
  • (2010)Interactive predictive parsing using a web-based architectureProceedings of the NAACL HLT 2010 Demonstration Session10.5555/1855450.1855460(37-40)Online publication date: 2-Jun-2010
  • (2010)IPP-AnnProceedings of the 2010 Workshops on Database and Expert Systems Applications10.1109/DEXA.2010.84(255-259)Online publication date: 30-Aug-2010
  • (2010)CAT-API Framework PrototypesProceedings of the 2010 Workshops on Database and Expert Systems Applications10.1109/DEXA.2010.81(264-265)Online publication date: 30-Aug-2010

Index Terms

  1. A multimodal predictive-interactive application for computer assisted transcription and translation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces
    November 2009
    374 pages
    ISBN:9781605587721
    DOI:10.1145/1647314

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 November 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. handwritten recognition
    2. interactive framework
    3. machine translation
    4. multimodality

    Qualifiers

    • Technical-note

    Conference

    ICMI-MLMI '09
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2010)Interactive predictive parsing using a web-based architectureProceedings of the NAACL HLT 2010 Demonstration Session10.5555/1855450.1855460(37-40)Online publication date: 2-Jun-2010
    • (2010)IPP-AnnProceedings of the 2010 Workshops on Database and Expert Systems Applications10.1109/DEXA.2010.84(255-259)Online publication date: 30-Aug-2010
    • (2010)CAT-API Framework PrototypesProceedings of the 2010 Workshops on Database and Expert Systems Applications10.1109/DEXA.2010.81(264-265)Online publication date: 30-Aug-2010

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media