skip to main content
10.1145/1148550.1148558acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihmConference Proceedingsconference-collections
Article

WWHT: un modèle conceptuel pour la présentation multimodale d'information

Published: 27 September 2005 Publication History

Abstract

Multimodal presentation of information aims at using several modalities of communication to produce relevant outputs to the user. This presentation involves different concepts regarding to information, interaction components (modes, modalities, media) and interaction context. An incremental process is required to create an adapted presentation. This paper presents a conceptual model for the multimodal presentation of information called WWHT and based on four concepts: What, Which, How, Then. These concepts describe the life cycle of a multimodal presentation from its birth to its disappearance including its evolutions. The application of the model is introduced through the outputs specification of a mobile phone application.

References

[1]
1. André, E. The generation of multimedia presentations. R. Dale, H. Moisl and H. Somers (eds.). In Techniques and Applications for the Processing of Language as Text, 2000, pp. 305-327.
[2]
2. André, E. Natural Language in Multimedia/Multimodal Systems. Mitkov, R. (ed.). Handbook of Natural Language Processing, 2003, pp. 650-669, Oxford University Press.
[3]
3. A Metamodel for the Runtime Architecture of an Interactive System. SIGCHI Bulletin, The UIMS Tool Developers Workshop, Vol. 24, 1992, pp. 32-37.
[4]
4. Arens, Y, Hovy, E. H. The Design of a Model-Based Multimedia Interaction Manager. AI Review, Vol. 9, No. 3, 1995.
[5]
5. Bellik, Y., Interfaces Multimodales : Concepts, Modèles et Architectures, Thèse de Doctorat, Université Paris XI (Orsay), 1995.
[6]
6. Bernsen, N.O. A Reference Model for Output Information in Intelligent Multimedia Presentation Systems. In Proceedings of the ECAI'96,1996.
[7]
7. Bordegoni, M., Faconti, G., Maybury, M.T., Rist, T., Ruggieri, S., Trahanias, P. and Wilson, M. A Standard Reference Model for Intelligent Multimedia Presentation Systems. Computer Standards & Interfaces, Vol. 18, No. 6-7:, 1997, pp. 477-496.
[8]
8. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L., Vanderdonckt, J. A unifying reference framework for multi-target user interfaces. Journal of Interacting With Computer, Elsevier Science B.V, Vol. 15, No. 3, 2003, pp. 289-308.
[9]
9. Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J., and Young, R.M. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: the CARE Properties. In Proceedings of INTERACT'95, Lillehammer, Norway, 1995.
[10]
10. Dey, A. K., Salber, D. and Abowd, G.D. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Moran, T.P. and Dourish, P. (eds.). Context-Aware computing: a special triple issue of Human-Computer Interaction, 2002.
[11]
11. Karagiannidis, C., Koumpis, A., and Stephanidis, C. Deciding 'What', 'When', 'Why', and 'How' to adapt in intelligent multimedia presentation systems. In Proceedings of ECAI workshop on Towards a standard reference model for intelligent multimedia presentation systems, 1996.
[12]
12. Lejeune, F. Analyse sémantico-cognitive d'énoncés en Langue des Signes Française pour une génération automatique de séquences gestuelles. Thèse de Doctorat, Université Paris XI (Orsay), 2004.
[13]
13. Lemlouma, T., Layaïda, N. Context-Aware Adaptation for Mobile Devices. Mobile Data Management, Berkeley, California, USA, 2004.
[14]
14. Rousseau, C., Bellik, Y., Vernier, F. and Bazalgette, D. Architecture framework for output multimodal systems design. In Proceedings of OZCHI'04, Australia, Wollongong, 2004.
[15]
15. Rousseau, C., Bellik, Y., Gruaz, R., Etienne, F. et Vernier, F. Fourniture F12.3 : Manuel Utilisateur de MOSTe. PEA INTUITION - PHASE 2, Réf.: CDS/ET/TT/04-158 I.R.01, 2004.
[16]
16. Satyanarayanan, M. Pervasive Computing: Vision and Challenges. IEEE Personal Communications, Vol. 8, No. 4, 2001, pp. 10-17.
[17]
17. Thevenin, D., Adaptation en Interaction Homme-Machine : le cas de la Plasticité. Thèse de Doctorat, Université Joseph Fourier, Grenoble I, 2001.

Cited By

View all
  • (2019)The AM4I Architecture and Framework for Multimodal Interaction and Its Application to Smart EnvironmentsSensors10.3390/s1911258719:11(2587)Online publication date: 6-Jun-2019
  • (2017)Fusion and fission engine for an assistant robot using an ontology knowledge baseJournal of Ambient Intelligence and Smart Environments10.3233/AIS-1704589:6(757-781)Online publication date: 1-Jan-2017
  • (2016)Technology-Based Innovations to Foster Personalized Healthy Lifestyles and Well-Being: A Targeted ReviewJournal of Medical Internet Research10.2196/jmir.486318:6(e128)Online publication date: 24-Jun-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
IHM '05: Proceedings of the 17th Conference on l'Interaction Homme-Machine
September 2005
350 pages
ISBN:1595931929
DOI:10.1145/1148550
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. human-computer interaction
  2. interaction context
  3. multimodal presentation
  4. output multimodality

Qualifiers

  • Article

Acceptance Rates

Overall Acceptance Rate 103 of 199 submissions, 52%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2019)The AM4I Architecture and Framework for Multimodal Interaction and Its Application to Smart EnvironmentsSensors10.3390/s1911258719:11(2587)Online publication date: 6-Jun-2019
  • (2017)Fusion and fission engine for an assistant robot using an ontology knowledge baseJournal of Ambient Intelligence and Smart Environments10.3233/AIS-1704589:6(757-781)Online publication date: 1-Jan-2017
  • (2016)Technology-Based Innovations to Foster Personalized Healthy Lifestyles and Well-Being: A Targeted ReviewJournal of Medical Internet Research10.2196/jmir.486318:6(e128)Online publication date: 24-Jun-2016
  • (2016)Fission Engine for an Ambient Assistance Robot Based on the Ontology ConceptProcedia Computer Science10.1016/j.procs.2016.04.20983(457-464)Online publication date: 2016
  • (2015)Building an Adaptive Multimodal Framework for Resource Constrained SystemsA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-6708-2_9(173-191)Online publication date: 2015
  • (2014)Improving Interaction with TV-Based Applications through Adaptive Multimodal FissionEmerging Research and Trends in Interactivity and the Human-Computer Interface10.4018/978-1-4666-4623-0.ch003(54-73)Online publication date: 2014
  • (2014)Multimodal Fusion and Fission within W3C Standards for Nonverbal Communication with Blind PersonsComputers Helping People with Special Needs10.1007/978-3-319-08596-8_33(209-213)Online publication date: 2014
  • (2013)Compilation of ReferencesEmerging Research and Trends in Interactivity and the Human-Computer Interface10.4018/978-1-4666-4623-0.chcrf(0-0)Online publication date: 31-Oct-2013
  • (2011)Adapting multimodal fission to user's abilitiesProceedings of the 6th international conference on Universal access in human-computer interaction: design for all and eInclusion - Volume Part I10.5555/2022591.2022632(347-356)Online publication date: 9-Jul-2011
  • (2011)La télévision et le téléphone portable en SuisseCommunication10.4000/communication.2396Online publication date: 4-Oct-2011
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media