A reference model for multimodal input interpretation

ABSTRACT

This paper proposes a reference model for multimodal input interpretation to understand multimodal input in multimodal interactive systems. The paper gives details of the functionality of each of the layers within the model and suggests its validity through development of multiple multimodal systems with same architecture.

REFERENCES

• 1: Philip R. Cohen , Michael Johnston , David McGee , Sharon Oviatt , Jay Pittman , Ira Smith , Liang Chen , Josh Clow, QuickSet: multimodal interaction for distributed applications, Proceedings of the fifth ACM international conference on Multimedia, p.31-40, November 09-13, 1997, Seattle, Washington, United States [doi>10.1145/266180.266328]
• 2: Vo, M.T., and Waibel, A., "Modeling and Interpreting Multimodal Inputs: A Semantic Integration Approach", Carnegie Mellon University Technical Report CMU-CS-97-192, 1997
• 3: M. Bordegoni , G. Faconti , S. Feiner , M. T. Maybury , T. Rist , S. Ruggieri , P. Trahanias , M. Wilson, A standard reference model for intelligent multimedia presentation systems, Computer Standards & Interfaces, v.18 n.6-7, p.477-496, Dec. 1997 [doi>10.1016/S0920-5489(97)00013-5 ]
• 4: Bob Carpenter, The logic of typed feature structures, Cambridge University Press, New York, NY, 1992

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

Keywords:
multimodality, reference model