skip to main content
10.1145/1088463.1088518acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
Article

Virtual tangible widgets: seamless universal interaction with personal sensing devices

Published: 04 October 2005 Publication History

Abstract

Using a single personal device as an universal controller for diverse services is a promising approach to solving the problem of too many controllers in ubiquitous multimodal environments. However, the current approaches to universal controllers cannot provide intuitive control because they are restricted to traditional mobile user interfaces such as small keys or small touch panels. We propose Vidgets, which is short for virtual tangible widgets}, as an approach to selecting and controlling ubiquitous services with virtually implemented tangible user interfaces based on a single sensing personal device equipped with a digital camera and several physical sensors. We classify the use of the universal controller into the three stages: (a) searching for a service, (b) grasping the service and (c) using the service. User studies with our prototype implementation indicate that the smooth transition and integration of the three stages improve the overall interaction with our universal controller.

References

[1]
R. Ballagas, M. Rohs, J. G. Sheridan, and J. Borchers. Sweep and point & shoot: Phonecam-based interactions for large public displays. In CHI '05: Extended abstracts of the 2005 conference on Human factors and computing systems, Portland, Oregon, USA, Apr. 2005. ACM Press.
[2]
J. F. Bartlett. Rock 'n' Scroll Is Here to Stay. IEEE Computer Graphics and Applications, 20(3):40--45, 2000.
[3]
S. Greenberg and C. Fitchett. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 209--218. ACM Press, 2001.
[4]
E. Guttman. Autoconfiguration for IP Networking: Enabling Local Communication. IEEE Internet Computing, pages 81--86, June 2001.
[5]
T. R. Hansen, E. Eriksson, and A. Lykke-Olesen. Mixed interaction space - designing for camera based interaction with mobile devices. In CHI '05: Extended abstracts of the 2005 conference on Human factors and computing systems, Portland, Oregon, USA, Apr. 2005. ACM Press.
[6]
B. L. Harrison, K. P. Fishkin, A. Gujar, C. Mochon, and R. Want. Squeeze me, hold me, tilt me! an exploration of manipulative user interfaces. In CHI '98: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 17--24. ACM Press, 1998.
[7]
K. Hinckley, J. S. Pierce, M. Sinclair, and E. Horvitz. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User Interface Software and Technology, pages 91--100. ACM Press, 2000.
[8]
H. Ishii and B. Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In CHI '97: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 234--241. ACM Press, 1997.
[9]
H. Kato. ARToolkit. http://www.hitl.washington.edu/artoolkit/.
[10]
N. Kohtake, T. Iwamoto, G. Suzuki, S. Aoki, D. Maruyama, T. Kouda, K. Takashio, and H. Tokuda. u-Photo: A Snapshot-based Interaction Technique for Ubiquitous Embedded Information. In Proceedings of the PERVASIVE 2004 (VideoPaper), April 2004.
[11]
J. Nichols, B. A. Myers, M. Higgins, J. Hughes, T. K. Harris, R. Rosenfeld, and M. Pignol. Generating remote control interfaces for complex appliances. In Proceedings of the 15th annual ACM symposium on User interface software and technology, pages 161--170. ACM Press, 2002.
[12]
D. A. Norman. The Invisible Computer: Why Good Products Can Fail, the Personal Computer Is So Complex, and Information Appliances Are the Solution. The MIT Press, September 1998.
[13]
S. Ponnekanti, B. Lee, A. Fox, P. Hanrahan, and T. Winograd. ICrafter: A Service Framework for Ubiquitous Computing Environments. In Proceedings of the 3rd international conference on Ubiquitous Computing, pages 56--75. ACM Press, September 2001.
[14]
J. Rekimoto. Tilting operations for small screen interfaces. In Proceedings of the 9th annual ACM symposium on User interface software and technology, pages 167--168. ACM Press, 1996.
[15]
J. Rekimoto and Y. Ayatsuka. Cybercode: designing augmented reality environments with visual tags. In DARE'00: Proceedings of DARE 2000 on Designing augmented reality environments, pages 1--10. ACM Press, 2000.
[16]
M. Ringwald. Spontaneous interaction with everyday devices using a pda. Workshop on Supporting Spontaneous Interaction in Ubiquitous Computing Settings at Ubicomp 2002, 2002.
[17]
M. Rohs and P. Zweifel. A conceptual framework for camera phone-based interaction techniques. In Pervasive Computing: Third International Conference, PERVASIVE 2005, number 3468 in Lecture Notes in Computer Science (LNCS), Munich, Germany, 2005. Springer-Verlag.
[18]
I. Siio, T. Masui, and K. Fukuchi. Real-world interaction using the fieldmouse. In UIST '99: Proceedings of the 12th annual ACM symposium on User interface software and technology, pages 113--119. ACM Press, 1999.
[19]
D. Wagner, T. Pintaric, F. Ledermann, and D. Schmalstieg. Towards massively multi-user augmented reality on handheld devices. In Pervasive Computing: Third International Conference, PERVASIVE 2005, Lecture Notes in Computer Science (LNCS). Springer-Verlag, 2005.
[20]
Web3D Consortium. Vrml97 functional specification and vrml97 external authoring interface (eai) international standard. http://www.web3d.org/x3d/specifications/vrml/.
[21]
M. Weiser. The Computer for the 21st Century. Scientific American, 265(3):94--104, September 1991.
[22]
ZeroC. ICE: Internet Communications Engine. http://www.zeroc.com/.

Cited By

View all
  • (2023)Modeling a Digitally Enhanced Real World Inspired by Agential Realism—Exploring Opportunities and ChallengesSmart Cities10.3390/smartcities60100166:1(319-338)Online publication date: 13-Jan-2023
  • (2014)User interfaces for smart things -- A generative approach with semantic interaction descriptionsACM Transactions on Computer-Human Interaction10.1145/258467021:2(1-25)Online publication date: 1-Feb-2014
  • (2009)Bimanual tangible interaction with mobile phonesProceedings of the 3rd International Conference on Tangible and Embedded Interaction10.1145/1517664.1517697(131-136)Online publication date: 16-Feb-2009
  • Show More Cited By

Index Terms

  1. Virtual tangible widgets: seamless universal interaction with personal sensing devices

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICMI '05: Proceedings of the 7th international conference on Multimodal interfaces
      October 2005
      344 pages
      ISBN:1595930280
      DOI:10.1145/1088463
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 October 2005

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. handheld augmented reality
      2. interaction techniques
      3. personal mobile devices
      4. ubiquitous computing
      5. universal controllers
      6. virtual tangible user interface

      Qualifiers

      • Article

      Conference

      ICMI05
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 453 of 1,080 submissions, 42%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)5
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 07 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)Modeling a Digitally Enhanced Real World Inspired by Agential Realism—Exploring Opportunities and ChallengesSmart Cities10.3390/smartcities60100166:1(319-338)Online publication date: 13-Jan-2023
      • (2014)User interfaces for smart things -- A generative approach with semantic interaction descriptionsACM Transactions on Computer-Human Interaction10.1145/258467021:2(1-25)Online publication date: 1-Feb-2014
      • (2009)Bimanual tangible interaction with mobile phonesProceedings of the 3rd International Conference on Tangible and Embedded Interaction10.1145/1517664.1517697(131-136)Online publication date: 16-Feb-2009
      • (2008)Reflecting human behavior to motivate desirable lifestyleProceedings of the 7th ACM conference on Designing interactive systems10.1145/1394445.1394489(405-414)Online publication date: 25-Feb-2008
      • (2008)Controlling data flows between appliances using a camera phoneProceedings of the 2nd international conference on Tangible and embedded interaction10.1145/1347390.1347407(71-74)Online publication date: 18-Feb-2008
      • (2007)Personal companionProceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction10.5555/1763296.1763415(1052-1061)Online publication date: 22-Jul-2007
      • (2007)System support for mobile augmented reality servicesProceedings of the 2007 ACM symposium on Applied computing10.1145/1244002.1244346(1616-1623)Online publication date: 11-Mar-2007
      • (2007)Personal Companion: Personalized User Interface for U-Service Discovery, Selection and InteractionUniversal Access in Human-Computer Interaction. Ambient Interaction10.1007/978-3-540-73281-5_115(1052-1061)Online publication date: 2007
      • (2006)CookieFlavorsCHI '06 Extended Abstracts on Human Factors in Computing Systems10.1145/1125451.1125637(965-970)Online publication date: 21-Apr-2006
      • (2006)Building Mobile Augmented Reality Services in Pervasive Computing EnvironmentsProceedings of the 2006 ACS/IEEE International Conference on Pervasive Services10.1109/PERSER.2006.1652243(285-288)Online publication date: 26-Jun-2006
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media