skip to main content
10.1145/2522848.2531754acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
demonstration

Demonstration of sketch-thru-plan: a multimodal interface for command and control

Published:09 December 2013Publication History

ABSTRACT

This paper demonstrates a multimodal system called Sketch-Thru-Plan (STP) that enables users to speak and draw doctrinal language and symbols in order to create courses of action. We argue that STP can meet many of the challenges inherent in building user interfaces for operations planning and command-and-control. The system is being transitioned to military organizations for use in planning courses of action.

References

  1. R.A. Bolt. "Voice and Gesture at the Graphics Interface." ACM Comp. Graphics, 14(3), 1980, pp. 262--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. A. Cheyer, and L. Julia, Multimodal maps: An agent-based approach, International Conf. on Cooperative Multimodal Communication, Springer, 1995, pp. 24--26.Google ScholarGoogle Scholar
  3. P.R. Cohen, M. Johnston, D. McGee, S. Oviatt, J. Pittman, I. Smith, L. Chen, J. Clow. QuickSet: Multimodal interaction for distributed applications Proc. of the 5th ACM Int'l Conf. on Multimedia, 31--40. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Johnston, P. R Cohen, D. McGee, S. L. Oviatt, J. A Pittman, I. Smith, Unification-based multimodal integration. Proc.of the Eighth Conference of the Assoc. for Computational Linguistics, 1997, 281--288. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. D. B. Moran, A. J. Cheyer, L. E. Julia, D. L. Martin, S. Park, Multimodal user interfaces in the Open Agent Architecture, Proc. of the 2nd Int'l Conference on Intelligent User Intefaces, ACM Press, 1997, pp. 61--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. L. Oviatt , Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12 (1), 1997, pp. 93--129. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Oviatt, S. L., and Cohen, P. R. Perceptual user interfaces: multimodal interfaces that process what comes naturally, CACM 43 (3), 45--53, 2000 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. R. Sharma, M. Yeasin, N. Krahnstoever, I. Rauschert, G. Cai, I. Brewer, A. M. MacEachren, K. Sengupta. Speech--Gesture Driven Multimodal Interfaces for Crisis Management., Proc. IEEE, 91(9), 2003, 1327--1354.Google ScholarGoogle ScholarCross RefCross Ref
  9. M.W., Salisbury, J.H. Hendrickson, T.L Lammers, C. Fu, S.A. Talk and Draw: Bundling speech and graphics, Moody, IEEE Computer, 23(8), August, 1990, pp. 59--65 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Demonstration of sketch-thru-plan: a multimodal interface for command and control

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction
              December 2013
              630 pages
              ISBN:9781450321297
              DOI:10.1145/2522848

              Copyright © 2013 Owner/Author

              Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 9 December 2013

              Check for updates

              Qualifiers

              • demonstration

              Acceptance Rates

              ICMI '13 Paper Acceptance Rate49of133submissions,37%Overall Acceptance Rate453of1,080submissions,42%

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader