research-article

RVDT: a design space for multiple input devices, multipleviews and multiple display surfaces combination

Authors:

Christian Jacquemin,

Frédéric VernierAuthors Info & Claims

ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

Pages 269 - 276

https://doi.org/10.1145/1647314.1647372

Published: 02 November 2009 Publication History

Abstract

We study interaction combination performed using a tabletop device, a mouse, and/or a six Degrees Of Freedom(DOF) input device in a systemcombining a 2Dflat (map-kind) view presented horizontally and a 3D perspective vertical view of the same virtual environment. The design of such a 2D/3D interface relies on the RVDT model and its design space that allow easy high-level combined interactions to achieve spatial tasks. RVDT integrates the relations between physical and numerical DOFs and applies to any graphical user interface in which multiple views, multiple display surfaces and multiple input devices are combined. The user study shows that experimented users prefer table-top/6DOF input device interaction combination with a maximal number of elementary tasks performed with both devices.

References

[1]

R. Ajaj, L. Savioja, and C. Jacquemin. Software platform for real-time room acoustic visualization. In Proceedings of the 2008 ACM symposium on Virtual reality software and technology, pages 247---248, Bordeaux, France, 2008. ACM.

Digital Library

[2]

D. Aliakseyeu, S. Subramanian, J. Martens, and M. Rauterberg. Interaction techniques for navigation through and manipulation of 2D and 3D data. In Proceedings of the workshop on Virtual environments 2002, pages 179--188, Barcelona, Spain, 2002. Eurographics Association.

Digital Library

[3]

E. André,W. Finkler,W. Graf, T. Rist, A. Shauder, and W.Walhstein. Wip: the automatic synthesis of multimodal presentations. In Intelligent multimedia interfaces, pages 75--93, Menlo Park, CA, USA, 1993. American Association for Artificial Intelligence.

Digital Library

[4]

G. Bailly, L. Nigay, and D. Auber. NAVRNA: visualization -- exploration -- editing of RNA. In Proceedings of the working conference on Advanced visual interfaces, pages 504--507, Venezia, Italy, 2006. ACM.

Digital Library

[5]

M. Q.W. Baldonado, A. Woodruff, and A. Kuchinsky. Guidelines for using multiple views in information visualization. In Proceedings of the working conference on Advanced visual interfaces, pages 110--119, Palermo, Italy, 2000. ACM.

Digital Library

[6]

R. Ballagas, M. Ringel, M. Stone, and J. Borchers. iStuff: a physical user interface toolkit for ubiquitous computing environments. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 537--544, Ft. Lauderdale, Florida, USA, 2003. ACM.

Digital Library

[7]

J. Bouchet and L. Nigay. ICARE: a component-based approach for the design and development of multimodal interfaces. In CHI '04 extended abstracts on Human factors in computing systems, pages 1325--1328, Vienna, Austria, 2004. ACM.

Digital Library

[8]

D. A. Bowman, E. Kruijff, J. J. LaViola, and I. Poupyrev. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., 2004.

Digital Library

[9]

J. Coutaz, L. Nigay, D. Salber, A. Blandford, J. May, and R. M. Young. Four easy pieces for assessing the usability of multimodal interaction: the CARE properties. In Proceedings of INTERACT 95, pages 115--120, 1995.

[10]

P. Dragicevic and J. Fekete. The input configurator toolkit: towards high input adaptability in interactive applications. In Proceedings of the working conference on Advanced visual interfaces, pages 244--247, Gallipoli, Italy, 2004. ACM.

Digital Library

[11]

S. K. Feiner and K. R. McKeown. Automating the generation of coordinated multimedia explanations. In Readings in intelligent user interfaces, pages 89--98, San Francisco, CA, USA, 1998. Morgan Kaufmann Publishers Inc.

Digital Library

[12]

M. Fjeld, K. Lauche, S. Dierssen,M. Bichsel, and M. Rauterberg. BUILD-IT: a brick-based integral solution supporting multidisciplinary design tasks. In Proceedings of the IFIP Working Group 13.2 Conference on Designing Effective and Usable Multimedia Systems, pages 122--133. Kluwer, B.V., 1998.

Digital Library

[13]

F. Flippo, A. Krebs, and I. Marsic. A framework for rapid development of multimodal interfaces. In Proceedings of the 5th international conference on Multimodal interfaces ICMI '03, pages 109--116, New York, NY, USA, 2003. ACM.

Digital Library

[14]

C. Forlines, A. Esenther, C. Shen, D.Wigdor, and K. Ryall. Multi-user, multi-display interaction with a single-user, single-display geospatial application. In Proceedings of the 19th annual ACM symposium on User interface software and technology, pages 273--276, Montreux, Switzerland, 2006. ACM.

Digital Library

[15]

N. Kobayashi, E. Tokunaga, H. Kimura, Y. Hirakawa, M. Ayabe, and T. Nakajima. An input widget framework for multi-modal and multi-device environments. In Third IEEEWorkshop on Software Technologies for Future Embedded and Ubiquitous Systems SEUS 2005., pages 63--70, 2005.

Digital Library

[16]

R. Kuchar, T. Schairer, and W. Straßer. Photorealistic Real-Time visualization of cultural heritage: A case study of friedrichsburg castle in germany. In EG Cultural Heritage Papers, pages 9--16, 2007.

[17]

J. Martin. TYCOON: theoretical framework and software tools for multimodal interfaces. In Intelligence and Multimodality in Multimedia Interfaces. AAAI Press, 1998.

[18]

J. Roberts. On encouraging multiple views for visualization. In Proceedings of IEEE Conference on Information Visualization, pages 8--14, 1998.

Digital Library

[19]

Rousseau, Bellik, and Vernier. Multimodal output specification / simulation platform. In Proceedings of the 7th international conference on Multimodal interfaces ICMI '05, pages 84--91, New York, NY, USA, 2005. ACM.

Digital Library

[20]

C. Shen, K. Ryall, C. Forlines, A. Esenther, F. D. Vernier, K. Everitt, M.Wu, D.Wigdor,M. R. Morris, M. Hancock, and E. Tse. Informing the design of Direct-Touch tabletops. IEEE Comput. Graph. Appl., 26(5):36--46, 2006.

Digital Library

[21]

D. Teil and T. Bellik. Multimodal interaction interface using voice and gesture. In D. G. B. M. M. Taylor, F. Neel, editor, The Structure of Multimodal Dialog II, pages 349--366. John Benjamins Publishing Company, 2000.

[22]

D.Wigdor, C. Shen, C. Forlines, and R. Balakrishnan. Effects of display position and control space orientation on user preference and performance. In Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 309--318, Montréal, Québec, Canada, 2006. ACM.

Digital Library

[23]

D.Wigdor, C. Shen, C. Forlines, and R. Balakrishnan. Table-centric interactive spaces for real-time collaboration. In Proceedings of the working conference on Advanced visual interfaces, pages 103--107, Venezia, Italy, 2006. ACM.

Digital Library

[24]

S. Zhai. User performance in relation to 3D input device design. SIGGRAPH Comput. Graph., 32(4):50--54, 1998.

Digital Library

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Korzetz MKühn RKegel KGeorgi LSchumann FSchlegel T(2019)MilkyWay: A Toolbox for Prototyping Collaborative Mobile-Based Interaction TechniquesUniversal Access in Human-Computer Interaction. Multimodality and Assistive Environments10.1007/978-3-030-23563-5_38(477-490)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1007/978-3-030-23563-5_38
Dang CAndré EPaternò FSantoro CZiegler J(2014)A framework for the development of multi-display environment applications supporting interactive real-time portalsProceedings of the 2014 ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2607023.2607038(45-54)Online publication date: 17-Jun-2014
https://dl.acm.org/doi/10.1145/2607023.2607038

Index Terms

RVDT: a design space for multiple input devices, multipleviews and multiple display surfaces combination
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Tangible views for information visualization
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

In information visualization, interaction is commonly carried out by using traditional input devices, and visual feedback is usually given on desktop displays. By contrast, recent advances in interactive surface technology suggest combining interaction ...
Use your head: tangible windows for 3D information spaces in a tabletop environment
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

Tangible Windows are a novel concept for interacting with virtual 3D information spaces in a workbench-like multi-display environment. They allow for performing common 3D interaction tasks in a more accessible manner by combining principles of tangible ...
Touchers and mousers: commonalities and differences in co-located collaboration with multiple input devices
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present new findings on commonalities and differences between touch and mouse input for co-located interaction between teams of two people who know each other. Twenty-two participants were instructed to work as co-located pairs on three sets of two ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces

November 2009

374 pages

ISBN:9781605587721

DOI:10.1145/1647314

General Chairs:
James L. Crowley
INRIA Grenoble Rhône-Alpes Research Centre, France
,
Yuri Ivanov
MERL, USA
,
Christopher Wren
Google, USA
,
Program Chairs:
Daniel Gatica-Perez
Idiap Research Institute, Switzerland
,
Michael Johnston
AT&T Research, USA
,
Rainer Stiefelhagen
University of Karlsruhe, Germany

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI-MLMI '09

Sponsor:

SIGCHI

ICMI-MLMI '09: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 2 - 4, 2009

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Korzetz MKühn RKegel KGeorgi LSchumann FSchlegel T(2019)MilkyWay: A Toolbox for Prototyping Collaborative Mobile-Based Interaction TechniquesUniversal Access in Human-Computer Interaction. Multimodality and Assistive Environments10.1007/978-3-030-23563-5_38(477-490)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1007/978-3-030-23563-5_38
Dang CAndré EPaternò FSantoro CZiegler J(2014)A framework for the development of multi-display environment applications supporting interactive real-time portalsProceedings of the 2014 ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2607023.2607038(45-54)Online publication date: 17-Jun-2014
https://dl.acm.org/doi/10.1145/2607023.2607038

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten