Article

Observation and capture of multimodal interaction in mobile situations

Authors:

Moustapha Zouinar,

Marc Relieu,

Pascal Salembier,

Guillaume CalvetAuthors Info & Claims

UbiMob '04: Proceedings of the 1st French-speaking conference on Mobility and ubiquity computing

Pages 5 - 8

https://doi.org/10.1145/1050873.1050876

Published: 01 June 2004 Publication History

Get Access

Abstract

This paper describes a method and a data collection infrastructure for capturing data about the use of a mobile multimodal system in the field, under realistic conditions. The infrastructure includes instrumentation worn by the user to capture his perspective while moving, a means of capturing a wider view of the context and a multimodal data logger.

References

[1]

Beck, E., Christiansen, M., Kjeldskov J., Kolbe, N. & Stage, J. Experimental Evaluation of Techniques for Usability Testing of Mobile Systems in a Laboratory Setting. In Proceedings of OzCHI 2003, Brisbane, Australia, 2003

Google Scholar

[2]

Health, C. & Button, G. (eds) Special Issue on Workplace Studies. British Journal of Sociology, Vol. 53, No. 2, 2002.

Google Scholar

[3]

Jameson, A. Usability Issues and Methods for Mobile Multimodal Systems, in Proceedings of the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments Kloster Irsee, Germany, June, 2002.

Google Scholar

[4]

Kerguelen, A. Quels outils concevoir pour aider au relevé d'observation sur le terrain ? XXXIIIème Congrès de la SELF, "Temps et Travail", Paris, 1998.

Google Scholar

[5]

Lahlou, S. Observing cognitive work in offices. In N. Streitz, J. Siegel, V. Hartkopf & S. Kosomi (eds). Cooperative Buildings, Integrating Information, Organizations, and Architecture. Lecture Notes in Computer Science, 1670, Heidelberg: Springer, 1999.

Digital Library

Google Scholar

[6]

Lyons, K. & Starner, T. Mobile capture for wearable computer usability testing. In Proceedings of the Fifth International Symposium on Wearable Computers, Los Alamitos, CA: IEEE Computer, 2001.

Digital Library

Google Scholar

[7]

Mark, G., Christensen, U., Shafae, M. A Methodology Using a Microcamera for Studying Mobile IT Usage and Person Mobility Paper presented at the Workshop on Mobile Communication, 2001.

Google Scholar

[8]

Merlin, B. Plateforme générique d'observation des interactions. Rapport technique IRIT-Diamant, 2004.

Google Scholar

[9]

Oviatt, S. Multimodal. System processing in mobile environments. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, ACM Press. 2000.

Digital Library

Google Scholar

[10]

Pirhonen, A., Brewster, S. & Holguin, C. Gestural and audio metaphors as a means of control for mobile devices. In proceedings of CHI 2002, 291--29

Digital Library

Google Scholar

[11]

Relieu, M. The “ glasscam ” as an observational tool for studying screen-based mobile phone uses and management of parallel activities. International Conference on Conversation Analysis (ICCA-02) Copenhagen, 17-21 May, 2002.

Google Scholar

[12]

Seagull, F. J. & Xiao, Y. Using eye-tracking video data to augment knowledge elicitation in cognitive task analysis. In Proceedings of the Human factors and Ergonomics Society 45th Annual Meeting, October 8-12, Minneapolis, Minnesota, USA, 2001

Crossref

Google Scholar

[13]

Vom Lehn, D., Heath, C. & Hindmarsh, J. La déécouverte interactive des objects de musée. Alliage: culture, science, technique, 2003, pp 165--178.

Google Scholar

Cited By

View all

Licoppe CFigeac J(2017)Gaze Patterns and the Temporal Organization of Multiple Activities in Mobile Smartphone UsesHuman–Computer Interaction10.1080/07370024.2017.132600833:5-6(311-334)Online publication date: 31-Jul-2017
https://doi.org/10.1080/07370024.2017.1326008
Figeac JChaulet J(2016)Le design de l’hyperconnectivité relationnelleThe design of social hyper-connectivity : Video-ethnography of the uses of Mobile Social Network SitesRevue française des sciences de l’information et de la communication10.4000/rfsic.1955Online publication date: 1-Jan-2016
https://doi.org/10.4000/rfsic.1955
Licoppe CFigeac J(2014)L’organisation temporelle des engagements visuels dans des situations de multi-activité équipée en milieu urbainActivites10.4000/activites.40511:1Online publication date: 2014
https://doi.org/10.4000/activites.405
Show More Cited By

Index Terms

Observation and capture of multimodal interaction in mobile situations
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Multimodal interaction systems: information and time features

Multimodal interaction systems combine visual information (involving images, text, sketches and so on) with voice, gestures and other modalities to provide flexible and powerful dialogue approaches, enabling users to choose one or more of the multiple ...
From vocal to multimodal dialogue management
ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Multimodal, speech-enabled systems pose different research problems when compared to unimodal, voice-only dialogue systems. One of the important issues is the question of how a multimodal interface should look like in order to make the multimodal ...
Multimodal multiparty social interaction with the furhat head
ICMI '12: Proceedings of the 14th ACM international conference on Multimodal interaction

We will show in this demonstrator an advanced multimodal and multiparty spoken conversational system using Furhat, a robot head based on projected facial animation. Furhat is a human-like interface that utilizes facial animation for physical robot heads ...

Comments

Information & Contributors

Information

Published In

UbiMob '04: Proceedings of the 1st French-speaking conference on Mobility and ubiquity computing

June 2004

226 pages

ISBN:1581139152

DOI:10.1145/1050873

Conference Chairs:
Anne-Marie Dery-Pinna
I3S, Université Nice Sophia Antipolis
,
Alain Giboin
INRIA, Sophia-Antipolis

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
371
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Licoppe CFigeac J(2017)Gaze Patterns and the Temporal Organization of Multiple Activities in Mobile Smartphone UsesHuman–Computer Interaction10.1080/07370024.2017.132600833:5-6(311-334)Online publication date: 31-Jul-2017
https://doi.org/10.1080/07370024.2017.1326008
Figeac JChaulet J(2016)Le design de l’hyperconnectivité relationnelleThe design of social hyper-connectivity : Video-ethnography of the uses of Mobile Social Network SitesRevue française des sciences de l’information et de la communication10.4000/rfsic.1955Online publication date: 1-Jan-2016
https://doi.org/10.4000/rfsic.1955
Licoppe CFigeac J(2014)L’organisation temporelle des engagements visuels dans des situations de multi-activité équipée en milieu urbainActivites10.4000/activites.40511:1Online publication date: 2014
https://doi.org/10.4000/activites.405
Mercer KMay AMitchel V(2014)Designing for videoPersonal and Ubiquitous Computing10.1007/s00779-013-0702-y18:3(723-735)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1007/s00779-013-0702-y
Calvet GSalembier PKahn JZouinar M(2005)Etude empirique de l'interaction multimodale en mobilitéProceedings of the 17th Conference on l'Interaction Homme-Machine10.1145/1148550.1148597(283-286)Online publication date: 27-Sep-2005
https://dl.acm.org/doi/10.1145/1148550.1148597

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Multimodal interaction systems: information and time features

From vocal to multimodal dialogue management

Multimodal multiparty social interaction with the furhat head

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations