ABSTRACT
Most work in the space of multimodal and gestural interaction has focused on single user productivity tasks. The design of multimodal, freehand gestural interaction for multiuser lean-back scenarios is a relatively nascent area that has come into focus because of the availability of commodity depth cameras. In this paper, we describe our approach to designing multimodal gestural interaction for multiuser photo browsing in the living room, typically a shared experience with friends and family. We believe that our learnings from this process will add value to the efforts of other researchers and designers interested in this design space.
Supplemental Material
- Dey, P., Madhvanath, S., Ranjan, A. and Das, S. 2011. An Exploration of Gesture-Speech Multimodal Patterns for Touch Interfaces. 3rd International Conference on Human Computer Interaction, April 7 - 10 2011, Bangalore, India. Google ScholarDigital Library
- Dey, P., Selvaraj, M. and Lee, B. 2011. Robust User Context Analysis for Multimodal Interfaces. ICMI 2011: 13th International Conference on Multimodal Interaction, November 14-18, 2011, Alicante, Spain. Google ScholarDigital Library
- Perron, L. 2007. What gestures to perform a collaborative storytelling? In ICVS'07: Proc. 4th Intl. Conf. on virtual storytelling: Using virtual reality technologies for storytelling (2007). Google ScholarDigital Library
- Suryanarayan, P., Subramanian, A. and Mandalapu, D. 2010. 'Dynamic Hand Pose Recognition Using Depth Data'. 20th International Conference on Pattern Recognition (ICPR), Istanbul, Turkey, August 23-26, 2010 Google ScholarDigital Library
- http://www.hpl.hp.com/india/research/MMI.html.Google Scholar
Index Terms
- Designing multiuser multimodal gestural interactions for the living room
Recommendations
Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied InteractionMore and more objects of our everyday environment are becoming smart and connected, offering us new interaction possibilities. Tangible interaction and gestural interaction are promising communication means with these objects in this post-WIMP ...
A Touchless Gestural System for Extended Information Access Within a Campus
SIGUCCS '17: Proceedings of the 2017 ACM SIGUCCS Annual ConferenceIn the last two decades, we have witnessed a growing spread of touchless interfaces, facilitated by higher performances of computational systems, as well as the increased availability of cheaper sensors and devices. Putting the focus on gestural input, ...
Eliciting tangible and gestural user interactions with and on a cooking pan
MuC '20: Proceedings of Mensch und Computer 2020Embedding computational capabilities in everyday objects enables novel interaction concepts that are seamlessly integrated in users' everyday tasks. We conducted an elicitation study to investigate how subjects use a pan to control functions related to ...
Comments