research-article

Spatially aware handhelds for high-precision tangible interaction with large displays

Authors:

Steven FeinerAuthors Info & Claims

TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

Pages 181 - 188

https://doi.org/10.1145/1517664.1517705

Published: 16 February 2009 Publication History

Abstract

While touch-screen displays are becoming increasingly popular, many factors affect user experience and performance. Surface quality, parallax, input resolution, and robustness, for instance, can vary with sensing technology, hardware configurations, and environmental conditions.

We have developed a framework for exploring how we could overcome some of these dependencies, by leveraging the higher visual and input resolution of small, coarsely tracked mobile devices for direct, precise, and rapid interaction on large digital displays.

The results from a formal user study show no significant differences in performance when comparing four techniques we developed for a tracked mobile device, where two existing touch-screen techniques served as baselines. The mobile techniques, however, had more consistent performance and smaller variations among participants, and an overall higher user preference in our setup. Our results show the potential of spatially aware handhelds as an interesting complement or substitute for direct touch-interaction on large displays.

References

[1]

Albinsson, P-A. and Zhai, S. High precision touch screen interaction. Proc. CHI '03 (2003), 105--112.

Digital Library

[2]

Ballagas, R., Borchers, J., Rohs, M., and Sheridan, J. G. The smart phone: A ubiquitous input device. Pervasive Computing, IEEE, vol. 5, no. 1 (2006). 70--77.

Digital Library

[3]

Baudisch, P., Good, N., Bellotti, V., and Schraedley, P. 2002. Keeping things in context: A comparative evaluation of focus plus context screens, overviews, and zooming. Proc. CHI '02 (2002), 259--266.

Digital Library

[4]

Benko, H., Wilson, A., and Baudisch, P. Precise selection techniques for multi-touch screens. Proc. CHI '06 (2006), 1263--1272.

Digital Library

[5]

Benko, H., Ishak, E. W., and Feiner, S. 2004. Collaborative mixed reality visualization of an archaeological excavation. Proc. ISMAR '04 (2004), 132--140.

Digital Library

[6]

Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. Commun. ACM 36, 7 (Jul. 1993), 39--49.

Digital Library

[7]

Hardy, R. and Rukzio, E. Touch & interact: Touch-based interaction of mobile phones with displays. Proc. MobileHCI '08 (2008), 245--254.

Digital Library

[8]

Hart, S. G., and Staveland, L. E. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload (1988), 239--250.

[9]

Henrysson, A. and Ollila, M. UMAR: Ubiquitous mobile augmented reality. Proc. MUM '04 (2004), 41--45.

Digital Library

[10]

Hodges, S., Izadi, S., Butler, A., Rrustemi, A., and Buxton, B. Thin-Sight: Versatile multi-touch sensing for thin form-factor displays. Proc UIST '07 (2007), 259--268.

Digital Library

[11]

Lewis, J. R. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact., 7(1). (1995), 57--78.

Digital Library

[12]

MacKenzie, I. S. and Oniszczak, A. A comparison of three selection techniques for touchpads. Proc. CHI '98 (1998), 336--343.

Digital Library

[13]

Moscovich, T. and Hughes, J. F. Navigating documents with the virtual scroll ring. Proc. UIST '04 (2004), 57--60.

Digital Library

[14]

Olwal, A., Feiner S., and Heyman, S. Rubbing and tapping for precise and rapid selection on touch-screen displays. Proc. CHI '08 (2008), 295--304.

Digital Library

[15]

Olwal, A. LightSense: Enabling spatially aware handheld interaction devices. Proc. ISMAR '06 (2006). 119--122.

Digital Library

[16]

Reilly, D., Rodgers, M., Argue, R., Nunes, M., and Inkpen, K. Marked-up maps: Combining paper maps and electronic information resources. Personal Ubiquitous Comput. 10, 4 (2006), 215--226.

Digital Library

[17]

Rekimoto, J. A multiple device approach for supporting whiteboard-based interactions. Proc. CHI '98 (1998), 344--351.

Digital Library

[18]

Rekimoto, J. and Nagao, K. The world through the computer: Computer augmented interaction with real world environments. Proc. UIST '95 (1995), 29--36.

Digital Library

[19]

Rohs, M., Schöning, J., Krüger, A., and Hecht, B. Towards real-time markerless tracking of magic lenses on paper maps. Adjunct Proc. Pervasive '07 (2007), 69--72.

[20]

Rukzio, E., Broll, G., Leichtenstern, K., and Schmidt, A. Mobile interaction with the real world: An evaluation and comparison of physical mobile interaction techniques. Proc. AmI-07 (2007), 1--18.

Digital Library

[21]

Smith, G. and schraefel, mc. The radial scroll tool: Scrolling support for stylus- or touch-based document navigation. Proc. UIST '04 (2004), 53--56.

Digital Library

[22]

Wagner, D., Reitmayr, G., Mulloni, A., Drummond, T., and Schmalstieg, D. Pose tracking from natural features on mobile phones. Proc. ISMAR '08 (2008), 125--134.

Digital Library

[23]

Wagner, D. and Schmalstieg, D. First steps towards handheld augmented reality. Proc. ISWC '03 (2003), 127--135.

Digital Library

[24]

Wilson, A. D. and Sarin, R. BlueTable: Connecting wireless mobile devices on interactive surfaces using vision-based handshaking. Proc. GI 2007 (2007), 119--125.

Digital Library

[25]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. Proc. UIST'07 (2007), 159--168.

Digital Library

[26]

Yee, K. Peephole displays: Pen interaction on spatially aware hand-held computers. Proc. CHI '03 (2003), 1--8.

Digital Library

Cited By

Nasirinejad MReilly D(2024)mF+CInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103170182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103170
Chen LZhang SLiu C(2022)Research on the Multi-Screen Connection Interaction Method Based on Regular Octagon K-Value Template MatchingSymmetry10.3390/sym1408152814:8(1528)Online publication date: 26-Jul-2022
https://doi.org/10.3390/sym14081528
Yi HHan SPark MLee W(2022)SurfaceLens: near-surface spatial interaction with science museum exhibitsDigital Creativity10.1080/14626268.2022.203920833:1(18-34)Online publication date: 4-Mar-2022
https://doi.org/10.1080/14626268.2022.2039208
Show More Cited By

Recommendations

Improving drag-and-drop on wall-size displays
GI '05: Proceedings of Graphics Interface 2005

On wall-size displays with pen or touch input, users can have difficulties reaching display contents located too high, too low, or too far away. Drag-and-drop interactions can be further complicated by bezels separating individual display units. ...
Exploring Expressive NFC-Based Mobile Phone Interaction with Large Dynamic Displays
NFC '09: Proceedings of the 2009 First International Workshop on Near Field Communication

Inherent obstacles in current mobile applications are the limited input and output capabilities of mobile phones. In many ways, e.g. in terms of display capabilities and processing power, today’s mobile phones are quite versatile and provide opportunity ...
Development strategies for tangible interaction on horizontal surfaces
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Tangible interactions on horizontal surfaces are increasingly relevant for collaborative applications, embodied interaction, musical performance, and interaction with 3D information. This unique studio opportunity introduces approaches to developing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

February 2009

407 pages

ISBN:9781605584935

DOI:10.1145/1517664

Conference Chairs:
Nicolas Villar
Microsoft Research Cambridge, UK
,
Shahram Izadi
Microsoft Research Cambridge, UK
,
Program Chairs:
Mike Fraser
University of Bristol, UK
,
Steve Benford
University of Nottingham, UK

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Microsoft Research (USA)
Microsoft Research Cambridge (UK)
Nokia (Finland)
Microsoft Hardware (USA)

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 February 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI09

Sponsor:

TEI09: 3rd International Conference on Tangible and Embedded Interaction

February 16 - 18, 2009

Cambridge, United Kingdom

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
789
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nasirinejad MReilly D(2024)mF+CInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103170182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103170
Chen LZhang SLiu C(2022)Research on the Multi-Screen Connection Interaction Method Based on Regular Octagon K-Value Template MatchingSymmetry10.3390/sym1408152814:8(1528)Online publication date: 26-Jul-2022
https://doi.org/10.3390/sym14081528
Yi HHan SPark MLee W(2022)SurfaceLens: near-surface spatial interaction with science museum exhibitsDigital Creativity10.1080/14626268.2022.203920833:1(18-34)Online publication date: 4-Mar-2022
https://doi.org/10.1080/14626268.2022.2039208
Huang ZLi YKong J(2022)Investigating the multimedia pointing techniques in the tabletop-centric cross-device interactionMultimedia Tools and Applications10.1007/s11042-022-12975-082:7(10077-10098)Online publication date: 21-Apr-2022
https://doi.org/10.1007/s11042-022-12975-0
Büschel WMitschick AMeyer TDachselt R(2019)Investigating Smartphone-based Pan and Zoom in 3D Data Spaces in Augmented RealityProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340113(1-13)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340113
Besançon LSereno MYu LAmmi MIsenberg T(2019)Hybrid Touch/Tangible Spatial 3D Data SelectionComputer Graphics Forum10.1111/cgf.1371038:3(553-567)Online publication date: 10-Jul-2019
https://doi.org/10.1111/cgf.13710
Niebling FKozlíková BSchreck TWischgoll T(2017)Spatial interaction for the post-processing of 3D CFD datasetsProceedings of the Eurographics/IEEE VGTC Conference on Visualization: Short Papers10.2312/eurovisshort.20171136(73-77)Online publication date: 12-Jun-2017
https://dl.acm.org/doi/10.2312/eurovisshort.20171136
Besancon LIssartel PAmmi MIsenberg T(2017)Hybrid Tactile/Tangible Interaction for 3D Data ExplorationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.259921723:1(881-890)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2599217
Badam SAmini FElmqvist NIrani P(2016)Supporting visual exploration for multiple users in large display environments2016 IEEE Conference on Visual Analytics Science and Technology (VAST)10.1109/VAST.2016.7883506(1-10)Online publication date: Oct-2016
https://doi.org/10.1109/VAST.2016.7883506
López DOehlberg LDoger CIsenberg T(2016)Towards An Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data ExplorationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.244023322:5(1616-1629)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1109/TVCG.2015.2440233
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten