skip to main content
10.1145/1529282.1529306acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

Developing and evaluating web multimodal interfaces - a case study with usability principles

Published: 08 March 2009 Publication History

Abstract

In this paper we describe an approach to facilitate the design of Web multimodal interfaces aiming at improving the user experience and the user interface usability using speech recognition together with the usual graphical user interfaces. We present a proposal for usability evaluation based on the heuristic evaluation, which considers the multimodal principles identified during a case study. As a result of using the proposed approach in the case study and from literature review, we report our considerations for the design, development and improvement of the Web multimodal interfaces.

References

[1]
Baranauskas, M. C. C.; Rocha, H. V. Design and Evaluation of Human-Computer Interfaces, ed. Campinas: Emopi Publisher, 2003. v. 1. 244 p.
[2]
Cohen, M. H.; Giaugola, J. P.; Balogh, J. Voice user interface design. Addison-Wesley, Boston, January 2004
[3]
Flippo, F.; Krebs, A.; Marsic, I. A framework for rapid development of multimodal interfaces, Proc. of the 5th intl conf. on Multimodal interfaces, November 03, Vancouver, Canada
[4]
Klemmer, S. R.; Sinha, A. K.; Chen, J.; Landay, J. A. "SUEDE: A Wizard of Oz Prototyping Tool for Speech User Interfaces." in CHI Letters, The 13th Annual ACM Symposium on User Interface Software and Technology: UIST 2000. 2(2): p. 1--10.
[5]
Limbourg, Q.; Vanderdonckt, J.; Michotte, B.; Bouillon, L.; Lopez, V. USIXML: a Language Supporting Multi-Path Development of User Interfaces. In Proc. of 9th IFIP Working Conf. on Engineering for HCI jointly with 11th Int. Workshop on Design and Specification of Interactive Systems EHCI-DSVIS'2004 (Hamburg, July04). Kluwer Academic Press, Dordrecht, 2004.
[6]
Nichols, J.; Myers, B.; Harris, T.; Rosenfeld, R.; Shriver, S.; Hughes, J. Requirements for automatically generating multimodal interfaces for complex appliances. In ICMI '02: Proc. of the 4th IEEE Intl Conf. on Multimodal Interfaces, page 377, Washington, DC, USA, 2002. IEEE Computer Society.
[7]
Nielsen, Jacob. How to Conduct a Heuristic Evaluation. http://www.useit.com/papers/heuristic/heuristic_evaluation.html.
[8]
Oviatt, S. L. Taming recognition errors with a multimodal architecture. Communications of the ACM, 43 (9), 45--51. New York: ACM Press 2000.
[9]
Oviatt, S. Multimodal Interfaces. In: J. Jacko and A. Sears (eds) The HCI Mahwah, NJ: Lawrence Erlbaum and Associates, 2002.
[10]
Paiva, D. M. B.; Freire, A. P.; Fortes, R. P. M. Design Rationale in Academic Software Development: Requirements for a Representation Model. In: 18th Intl. Conf. on Software Engineering and Knowledge Engineering -- San Francisco, 2006, p. 469--472.
[11]
Paternò. F.; Giammarino, F. Multimodal interaction: Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices. Proc. of the Working conference on Advanced visual interfaces AVI'06.
[12]
Puerta, A.; Eisenstein, J. XIML: A Common Representation for Interaction Data, Proc. ACM IUI'01, pp. 214--215.
[13]
Raman, T. V. Design principles for multimodal interaction. In MMI Workshop, Computer Human Interfaces (CHI-03), p. 5--10, Fort Lauderdale, USA.
[14]
Reeves, L. M. Guidelines for multimodal user interface design. Communications of the ACM, 47(1): 57--69.
[15]
Stanciulescu A.; Limbourg Q.; Vanderdonckt J.; Michotte B.; Montero F.; A Transformational Approach for Multimodal Web User Interfaces based on USIXML. Proc. of the 7th intl conf on Multimodal interfaces ICMI 2005, p. 259--266, ACM Press.
[16]
Stanciulescu, A., Vanderdonckt, J., Design Options for Multimodal Web Applications, Proc. of 6th Int. Conf. on Computer-Aided Design of User Interfaces CADUT06 (Bucharest, June06), Chapter 4, Springer-Verlag, Berlin, 2006, pp. 41--56.
[17]
Talarico Neto, A; Fortes, R. P. M. Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces. In: SIGDOC, 2008, Lisbon. Proc. of the 26th ACM Intl Conference on Design of Communication, 2008. p. 277--278.

Cited By

View all
  • (2022)Defining Recommendations to Guide User Interface Design: Multimethod ApproachJMIR Human Factors10.2196/378949:3(e37894)Online publication date: 30-Sep-2022
  • (2010)Verbal control of mathematical tools for simulation and virtual environmentsProceedings of the 2010 Summer Computer Simulation Conference10.5555/1999416.1999430(124-132)Online publication date: 11-Jul-2010
  • (2010)Improving multimodal interaction design with the MMWA authoring environmentProceedings of the 28th ACM International Conference on Design of Communication10.1145/1878450.1878476(151-158)Online publication date: 27-Sep-2010
  • Show More Cited By

Index Terms

  1. Developing and evaluating web multimodal interfaces - a case study with usability principles

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SAC '09: Proceedings of the 2009 ACM symposium on Applied Computing
    March 2009
    2347 pages
    ISBN:9781605581668
    DOI:10.1145/1529282
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 08 March 2009

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. evaluation of multimodal interfaces
    2. multimodal user interfaces
    3. voice user interfaces
    4. web

    Qualifiers

    • Research-article

    Conference

    SAC09
    Sponsor:
    SAC09: The 2009 ACM Symposium on Applied Computing
    March 8, 2009 - March 12, 2008
    Hawaii, Honolulu

    Acceptance Rates

    Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

    Upcoming Conference

    SAC '25
    The 40th ACM/SIGAPP Symposium on Applied Computing
    March 31 - April 4, 2025
    Catania , Italy

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Defining Recommendations to Guide User Interface Design: Multimethod ApproachJMIR Human Factors10.2196/378949:3(e37894)Online publication date: 30-Sep-2022
    • (2010)Verbal control of mathematical tools for simulation and virtual environmentsProceedings of the 2010 Summer Computer Simulation Conference10.5555/1999416.1999430(124-132)Online publication date: 11-Jul-2010
    • (2010)Improving multimodal interaction design with the MMWA authoring environmentProceedings of the 28th ACM International Conference on Design of Communication10.1145/1878450.1878476(151-158)Online publication date: 27-Sep-2010
    • (2009)Using automatic techniques to evaluate usability of web multimodal interfaces designProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858487(1-8)Online publication date: 5-Oct-2009
    • (2009)Design of communication in multimodal web interfacesProceedings of the 27th ACM international conference on Design of communication10.1145/1621995.1622011(81-88)Online publication date: 5-Oct-2009

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media