skip to main content
10.1145/1842993.1843019acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaviConference Proceedingsconference-collections
research-article

Lift-and-drop: crossing boundaries in a multi-display environment by Airlift

Published: 26 May 2010 Publication History

Abstract

Many of the interactive environments surrounding us today consist of multiple mobile and/or stationary visual displays. However, interaction with such multi-display environments is still dominated by the personal computer paradigm - one user interacts with one single display at a time.
In this paper first we present a new video-based input device called Airlift, which captures hands and fingertips independent from any display and therefore allows for consistent interaction across display boundaries. Second, we propose a system architecture for interaction spanning multiple displays. Third, we start to explore this new design space by proposing and evaluating a new interaction technique Lift-and-Drop for copying data from one display to another.
According to the results of our study for the task considered the new technique is superior to other techniques based on traditional direct input devices which are limited to the surface of single displays like pen or touch.

References

[1]
Digital vision touch technology - white paper, 2003. http://smarttech.com/DViT/, last access: December 16 2009.
[2]
Homepage apple, 2009. http://www.apple.com, last access: December 16 2009.
[3]
Homepage microsoft surface, 2009. http://www.microsoft.com/surface/, last access: December 16 2009.
[4]
Oblong g-speak., 2010. http://www.oblong.com, last access: April 2 2010.
[5]
A. Agarwal, S. Izadi, M. Chandraker, and A. Blake. High precision multi-touch sensing on surfaces using overhead cameras. In Tabletop, pages 197--200, 2007.
[6]
T. Bader, R. Räpple, and J. Beyerer. Fast invariant contour-based classification of hand symbols for hci. In CAIP 2009, volume 5702 of LNCS, pages 689--696. Springer, 2009.
[7]
P. Dietz and D. Leigh. Diamondtouch: a multi-user touch technology. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 219--226, New York, NY, USA, 2001. ACM.
[8]
J. Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118, New York, NY, USA, 2005. ACM.
[9]
S. G. Hart and L. E. Stavenland. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock and N. Meshkati, editors, Human Mental Workload, chapter 7, pages 139--183. Elsevier, 1988.
[10]
M. Hascoët. Throwing models for large displays. HCI 2003, Designing for Society, 2:77--108, 2003.
[11]
B. Johanson, A. Fox, and T. Winograd. The interactive workspaces project: Experiences with ubiquitous computing rooms. IEEE pervasive computing, 1(2):67--74, April-June 2002.
[12]
J. Letessier and F. Bérard. Visual tracking of bare fingers for interactive surfaces. In UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technology, pages 119--122, New York, NY, USA, 2004. ACM.
[13]
S. Malik and J. Laszlo. Visual touchpad: a two-handed gestural input device. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 289--296, New York, NY, USA, 2004. ACM.
[14]
P. Mistry, P. Maes, and L. Chang. Wuw - wear ur world: a wearable gestural interface. In CHI '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 4111--4116, New York, NY, USA, 2009. ACM.
[15]
M. A. Nacenta, D. Aliakseyeu, S. Subramanian, and C. Gutwin. A comparison of techniques for multi-display reaching. In CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 371--380, New York, NY, USA, 2005. ACM Press.
[16]
J. Rekimoto. Pick-and-drop: A direct manipulation technique for multiple computer environments. 1997.
[17]
J. Rekimoto. Smartskin: an infrastructure for freehand manipulation on interactive surfaces. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 113--120, New York, NY, USA, 2002. ACM.
[18]
A. D. Wilson. Touchlight: an imaging touch screen and display for gesture-based interaction. In ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces, pages 69--76, New York, NY, USA, 2004. ACM.
[19]
A. D. Wilson. Playanywhere: a compact interactive tabletop projection-vision system. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 83--92, New York, NY, USA, 2005. ACM.

Cited By

View all
  • (2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
  • (2020)Exploring the Design Space of Badge Based InputProceedings of the ACM on Human-Computer Interaction10.1145/34273134:ISS(1-20)Online publication date: 4-Nov-2020
  • (2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
  • Show More Cited By

Index Terms

  1. Lift-and-drop: crossing boundaries in a multi-display environment by Airlift

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces
    May 2010
    427 pages
    ISBN:9781450300766
    DOI:10.1145/1842993
    • Editor:
    • Giuseppe Santucci
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • Consulta Umbria SRL

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 May 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. gesture-based interaction
    2. multi-display multi-user environments

    Qualifiers

    • Research-article

    Conference

    AVI '10
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 128 of 490 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)20
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
    • (2020)Exploring the Design Space of Badge Based InputProceedings of the ACM on Human-Computer Interaction10.1145/34273134:ISS(1-20)Online publication date: 4-Nov-2020
    • (2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
    • (2017)Towards end-user development of distributed user interfacesUniversal Access in the Information Society10.1007/s10209-017-0601-518:4(785-799)Online publication date: 7-Dec-2017
    • (2016)Assessment of UAV operator workload in a reconfigurable multi-touch ground control station environmentJournal of Unmanned Vehicle Systems10.1139/juvs-2015-00394:3(203-216)Online publication date: Sep-2016
    • (2016)Supporting Patient Healing through ICUsmartCARE: Technologies that Enable Family Collaboration, Presence, and Information Flow2016 IEEE International Conference on Healthcare Informatics (ICHI)10.1109/ICHI.2016.42(297-300)Online publication date: Oct-2016
    • (2016)Towards User-Defined Cross-Device InteractionICWE 2016 International Workshops on Current Trends in Web Engineering - Volume 988110.1007/978-3-319-46963-8_17(179-187)Online publication date: 6-Jun-2016
    • (2012)The design and architecture of reticularspacesProceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems10.1145/2305484.2305529(269-274)Online publication date: 25-Jun-2012
    • (2012)ReticularSpacesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2208689(2845-2854)Online publication date: 5-May-2012
    • (2012)Culturally based designProceedings of the ACM 2012 conference on Computer Supported Cooperative Work10.1145/2145204.2145284(509-518)Online publication date: 11-Feb-2012
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media