skip to main content
10.1145/1456536.1456597acmconferencesArticle/Chapter ViewAbstractPublication PagesdocConference Proceedingsconference-collections
poster

Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces

Published: 22 September 2008 Publication History

Abstract

This poster describes a novel approach that is intended to combine graphical user interfaces (GUI) and voice interaction in the Web throughout the design and the development of intuitive and user-friendly multimodal interfaces. We are considering the user interface design modeling aspects, principles and guidelines that are being used to design voice and GUI. Our goal is to get an organized process to the design of multimodal interfaces that will let the designers to evaluate the interfaces with real users, find out usability issues and report the rationale to correct those issues. Moreover it will capture and store the acquired knowledge gathered during the multimodal interfaces design by using the design rationale (DR) and design patterns techniques.

References

[1]
Borchers, J. 2001. A Pattern Approach to Interaction Design. John Wiley & Sons Ltd., 2001.
[2]
Bouillon L., Vanderdonckt J., Chieu Chow K., Flexible Reengineering of Web Sites, in proceedings of the international conference on Intelligent User Interfaces, (IUI'04), January 13--16, Madeira (Portugal), ACM Press, New York, USA, 2004, pp 132--139
[3]
Oviatt, S. Multimodal Interfaces. In: J. Jacko and A. Sears. 2002. The Human-Computer Interaction Handbook. Mahwah, NJ: Lawrence Erlbaum and Associates, 2002.
[4]
Paiva, D. M. B.; Freire, A. P.; Fortes, R. P. M. 2006. Design rationale in Academic Software Development: Requirements for a Representation Model. In: Eighteenth International Conference on Software Engineering and Knowledge Engineering 2006, San Francisco, 2006, p. 469--472.
[5]
Paternò. F.; Giammarino. 2006. Authoring interfaces with combined use of graphics and voice for both stationary and mobile devices. Proceedings of the working conference on Advanced visual interfaces AVI 2006.
[6]
Raman, T. V. 2003. Design Principles for Multimodal Interaction, MMI Workshop, CHI 2003, Fort Lauderdale, Florida, USA.
[7]
Reeves, L. M. Guidelines for multimodal user interface design. Communications of the ACM, Vol. 47, pp. 57--69, January 2004.
[8]
Stanciulescu A.; Limbourg Q.; Vanderdonckt J. 2005. A Transformational Approach for Multimodal Web User Interfaces based on USIXML. Proceedings of the 7th International Conference on Multimodal Interfaces, pages 259--266, ACM
[9]
Wright, D. R. 2007. The decision pattern: capturing and communicating design intent. In Proceedings of the 25th Annual ACM international Conference on Design of Communication. SIGDOC '07. ACM, New York, NY, 69--74.

Cited By

View all
  • (2020)Can Computer-Generated Speech Have an Age?Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3383082(1-7)Online publication date: 25-Apr-2020
  • (2018)Investigating the usability and user experiences of voice user interfaceProceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct10.1145/3236112.3236130(127-131)Online publication date: 3-Sep-2018
  • (2009)Using automatic techniques to evaluate usability of web multimodal interfaces designProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858487(1-8)Online publication date: 5-Oct-2009
  • Show More Cited By

Index Terms

  1. Multimodal interfaces design issues: the fusion of well-designed voice and graphical user interfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communication
    September 2008
    303 pages
    ISBN:9781605580838
    DOI:10.1145/1456536
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 September 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. design patterns
    2. multimodal web interfaces
    3. voice user interfaces

    Qualifiers

    • Poster

    Conference

    SIGDOC '08
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 355 of 582 submissions, 61%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)Can Computer-Generated Speech Have an Age?Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3383082(1-7)Online publication date: 25-Apr-2020
    • (2018)Investigating the usability and user experiences of voice user interfaceProceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct10.1145/3236112.3236130(127-131)Online publication date: 3-Sep-2018
    • (2009)Using automatic techniques to evaluate usability of web multimodal interfaces designProceedings of the XV Brazilian Symposium on Multimedia and the Web10.1145/1858477.1858487(1-8)Online publication date: 5-Oct-2009
    • (2009)Design of communication in multimodal web interfacesProceedings of the 27th ACM international conference on Design of communication10.1145/1621995.1622011(81-88)Online publication date: 5-Oct-2009
    • (2009)Developing and evaluating web multimodal interfaces - a case study with usability principlesProceedings of the 2009 ACM symposium on Applied Computing10.1145/1529282.1529306(116-120)Online publication date: 8-Mar-2009

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media