research-article

Natural exploration of multimedia contents

Authors:

Alessandro Soro,

Gavino PaddeuAuthors Info & Claims

MoMM '09: Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia

Pages 382 - 385

https://doi.org/10.1145/1821748.1821821

Published: 14 December 2009 Publication History

Abstract

In this paper we present a research experience of tangible exploration of multimedia contents: the troll, as we dubbed it, consists in the coupling of a paper brochure and a LCD display. Browsing the brochure the user can access multimedia contents that are displayed on the screen; the animations and movies are related to each specific page of the brochure, that in turn reports a description of our projects. We show the rationale behind the exploitation of TUIs in the specific design space of the demo corner of our research lab, discuss the implementation and evaluation with users of a working prototype, and suggest a broader viewpoint in the context of natural interaction as well as further work.

References

[1]

Back, M., Cohen, J., Gold, R., Harrison, S., and Minneman, S. 2001. Listen reader: an electronically augmented paper-based book. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, United States). CHI '01. ACM, New York, NY, 23--29.

Digital Library

[2]

Dourish, P. Where the action is - The foundations of Embodied Interaction. The MIT Press, Cambridge, MA. 2004.

[3]

Fitzmaurice, G. W., Ishii, H., and Buxton, W. A. 1995. Bricks: laying the foundations for graspable user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, United States, May 07--11, 1995). I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. Conference on Human Factors in Computing Systems. ACM Press/Addison-Wesley Publishing Co., New York, NY, 442--449.

Digital Library

[4]

Grasset, R., Duenser, A., Seichter, H., and Billinghurst, M. 2007. The mixed reality book: a new multimedia reading experience. In CHI '07 Extended Abstracts on Human Factors in Computing Systems (San Jose, CA, USA, April 28 - May 03, 2007). CHI '07. ACM, New York, NY, 1953--1958. DOI= http://doi.acm.org/10.1145/1240866.1240931

Digital Library

[5]

Ishii, I. and Ullmer, B. Tangible bits: towards seamless interfaces between people, bits and atoms. Proceedings of the SIGCHI conference on Human factors in computing systems table of contents. Atlanta, Georgia, United States. Pages: 234--241. 1997

Digital Library

[6]

Kaltenbrunner, M. and Bencina, R. 2007. reacTIVision: a computer-vision framework for table-based tangible interaction. In Proceedings of the 1st international Conference on Tangible and Embedded interaction (Baton Rouge, Louisiana, February 15--17, 2007). TEI '07. ACM, New York, NY, 69--74. DOI= http://doi.acm.org/10.1145/1226969.1226983

Digital Library

[7]

Karam, M. and schraefel, m. c. A Taxonomy of Gestures in Human Computer Interactions Technical Report ECSTR-IAM05-009, Electronics and Computer Science, University of Southampton. 2005.

[8]

Kendon, A. Current Issues in the Study of Gestures. in The Biological Foundations of Gestures: Motor and Semiotic Aspects (J. L. Nesopulous, P. Peron, and A. R. Lecours, eds.) pp. 23--47, Lawrence Erlbaum Assoc. 1986.

[9]

Kendon, A. An Agenda for Gesture Studies. The Semiotic Review of Books. 1996.

[10]

Kirsh, D. and Maglio, P. On Distinguishing Epistemic from Pragmatic Action. Cognitive Science 18, 513--549 (1994)

[11]

Klemmer, S. R., Graham, J., Wolff, G. J., and Landay, J. A. 2003. Books with voices: paper transcripts as a physical interface to oral histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA, April 05--10, 2003). CHI '03. ACM, New York, NY, 89--96. DOI= http://doi.acm.org/10.1145/642611.642628

Digital Library

[12]

Mazalek, A., Davenport, G., and Ishii, H. 2002. Tangible viewpoints: a physical approach to multimedia stories. In Proceedings of the Tenth ACM international Conference on Multimedia (Juan-les-Pins, France, December 01--06, 2002). MULTIMEDIA '02. ACM, New York, NY, 153--160. DOI= http://doi.acm.org/10.1145/641007.641037

Digital Library

[13]

McNeill, D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press, Chicago. 1992.

[14]

Pavlovic, V. I., Sharma, R., and Huang, T. S. 1997. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7 (Jul. 1997), 677--695. DOI= http://dx.doi.org/10.1109/34.598226.

Digital Library

[15]

Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X., Kirbas, C., McCullough, K. E., and Ansari, R. 2002. Multimodal human discourse: gesture and speech. ACM Trans. Comput.-Hum. Interact. 9, 3 (Sep. 2002), 171--193. DOI= http://doi.acm.org/10.1145/568513.568514

Digital Library

[16]

Weiser, M. The computer for the 21st century. Scientific American, 1991.

[17]

Wellner, P. The DigitalDesk Calculator: Tangible Manipulation on a Desk top Display. In Proc. of the ACM Symposium on User Interface Software and Technology (UIST) 1991.

Digital Library

[18]

Wexelblat, A. 1998. Research Challenges in Gesture: Open Issues and Unsolved Problems. In Proceedings of the international Gesture Workshop on Gesture and Sign Language in Human-Computer interaction (September 17--19, 1997). I. Wachsmuth and M. Fröhlich, Eds. Lecture Notes In Computer Science, vol. 1371. Springer-Verlag, London, 1--11.

Digital Library

[19]

Wu, Y. and Huang, T. S. Vision-Based Gesture Recognition: A Review. In Gesture-Based Communication in Human-Computer Interaction Proc. of the International Gesture Workshop, GW'99 Gif-sur-Yvette, France, March 17--19, 1999.

Digital Library

Cited By

Tsong CSamsudin ZWan Yahaya W(2017)Framing Foundational Taxonomy of Multimedia Tangibility in Education Setting for Children2017 2nd International Conference on Multimedia and Image Processing (ICMIP)10.1109/ICMIP.2017.21(309-314)Online publication date: Mar-2017
https://doi.org/10.1109/ICMIP.2017.21
Tsong CSamsudin ZJaafar Wan Yahaya WChong T(2013)Making digital objects tangible: A case study for tangibility in preschoolers' multimedia learning2013 IEEE Symposium on Computers & Informatics (ISCI)10.1109/ISCI.2013.6612407(22-227)Online publication date: Apr-2013
https://doi.org/10.1109/ISCI.2013.6612407
Uras SArdu DPaddeu GDeriu MSteinbauer MPardede ETaniar D(2012)Do not judge an interactive book by its coverProceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia10.1145/2428955.2428966(17-20)Online publication date: 3-Dec-2012
https://dl.acm.org/doi/10.1145/2428955.2428966

Index Terms

Natural exploration of multimedia contents
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Natural exploration of 3D models
CHItaly '11: Proceedings of the 9th ACM SIGCHI Italian Chapter International Conference on Computer-Human Interaction: Facing Complexity

We report on two interactive systems for natural exploration of 3d models. Manipulation and navigation of 3d virtual objects can be a difficult task for a novel user, specially with a common 2D display. With traditional input devices such as 3d mice, ...
Pop through mouse button interactions
UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology

We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users ...
Interacting with large displays from a distance with vision-tracked multi-finger gestural input
UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology

We explore the idea of using vision-based hand tracking over a constrained tabletop surface area to perform multi-finger and whole-hand gestural interactions with large displays from a distance. We develop bimanual techniques to support a variety of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MoMM '09: Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia

December 2009

663 pages

ISBN:9781605586595

DOI:10.1145/1821748

General Chair:
Gabriele Kotsis
Johannes Kepler University Linz, Austria
,
Program Chairs:
David Taniar
Monash University, Australia
,
Eric Pardede
La Trobe University, Australia

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Johannes Kepler University

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MoMM '09

Sponsor:

MoMM '09: 7th International Conference on Mobile Computing and Multimedia

December 14 - 16, 2009

Kuala Lumpur, Malaysia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
97
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tsong CSamsudin ZWan Yahaya W(2017)Framing Foundational Taxonomy of Multimedia Tangibility in Education Setting for Children2017 2nd International Conference on Multimedia and Image Processing (ICMIP)10.1109/ICMIP.2017.21(309-314)Online publication date: Mar-2017
https://doi.org/10.1109/ICMIP.2017.21
Tsong CSamsudin ZJaafar Wan Yahaya WChong T(2013)Making digital objects tangible: A case study for tangibility in preschoolers' multimedia learning2013 IEEE Symposium on Computers & Informatics (ISCI)10.1109/ISCI.2013.6612407(22-227)Online publication date: Apr-2013
https://doi.org/10.1109/ISCI.2013.6612407
Uras SArdu DPaddeu GDeriu MSteinbauer MPardede ETaniar D(2012)Do not judge an interactive book by its coverProceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia10.1145/2428955.2428966(17-20)Online publication date: 3-Dec-2012
https://dl.acm.org/doi/10.1145/2428955.2428966

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten