skip to main content
10.1145/1186655.1186659acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
Article

Mobile visual interaction: enhancing local communication and collaboration with visual interactions

Published: 04 December 2006 Publication History

Abstract

User interaction with applications and data is traditionally based on Menu driven, mouse or pen based user interfaces. As increasing number of mobile devices are equipped with cameras, mobile devices can be a key tool for local and remote visual interaction and communications. In this paper we discuss our Mobile Visual Interaction system that enables pointing with mobile camera devices on larger displays, and key findings in using mobile cameras for human computer interaction. The mobile pointing software can identify and interpret camera-detectable data elements inserted on data surfaces such as computer displays or projected screens. The user can interact with this system by pointing the mobile camera device to the surface and performing gestures. In this article we share the key challenges and key results found during developing the system.

References

[1]
Ballagas, R., Rohs, M., Sheridan, J., and Borchers, J. 2005. Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays. In CHI 2005 extended abstracts on Human factors in computing systems. ACM, 1200--1203.
[2]
Chande, S. 2006. mForms: An Application Framework for Mobilizing Business Applications, January 2006, COMSWARE 2006, New Delhi
[3]
Gandalf Computer Vision Library URL: http://gandalf-library.sourceforge.net/
[4]
Jeon, S., Hwang, J., Kim, G., and Billinghurst, M. 2006. Interaction Techniques in Large Display Environments using Hand-held Devices. In Proceedings of VRST 2006, November 2006, Limassol, Cyprus. In print. URL: http://www.hitlabnz.org/route.php?r=pubs-list
[5]
Klemmer, S. R., Newman, M. W., Farrell, R., Bilezikjian, M., and Landay, J. A. 2001: The Designers' Outpost: A Tangible Interface for Collaborative Web Site Design, In Proceedings of UIST 2001, ACM Press, New York, 1--10.
[6]
Lee, B. and Klemmer, S. R., 2005. Notebooks that Share and Walls that Remember: Electronic Capture of Design Education Artifacts. In Conference Supplement to UIST 2005. URL: http://hci.stanford.edu/research/ideas/
[7]
Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. In International Journal of Computer Vision, 60, 2 (2004), 91--110.
[8]
Madhavapeddy, A., Scott, D., Sharp, R. and Upton, E., 2004. Using Camera-Phones to Enhance Human-Computer Interaction. In The adjunct proceedings of the Sixth International Conference on Ubiquitous Computing. URL: http://anil.recoil.org/papers/2004-ubicomp-camera.pdf
[9]
Miyaoku, K., Higashino, S., and Tonomura, Y. 2004. C-blink: A hue-difference-based light signal marker for large screen interaction via any mobile terminal. In Proceedings of UIST 2004. ACM, 147--156.
[10]
Mynatt, E. D., Igarashi, T., Edwards, W. K., and LaMarca, A. 1999. Flatland: new dimensions in office whiteboards. In Proceedings of SIGCHI 1999, ACM Press, New York, 346--353.
[11]
Rekimoto, J. 1997. Pick-and-Drop: A direct manipulation technique for multiple computer environments. In Proceedings of UIST'97, 31--39.
[12]
SmartTech's SmartBoard touch-screen. URL: http://www.smarttech.com/smartboard/ {15-Sep-2006}

Cited By

View all
  • (2015)Reading between linesProceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/2750858.2805824(157-168)Online publication date: 7-Sep-2015
  • (2013)LightSyncProceedings of the 19th annual international conference on Mobile computing & networking10.1145/2500423.2500437(15-26)Online publication date: 30-Sep-2013
  • (2010)Interactive display of image details using a camera-coupled mobile projector2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops10.1109/CVPRW.2010.5543466(9-16)Online publication date: Jun-2010
  • Show More Cited By

Index Terms

  1. Mobile visual interaction: enhancing local communication and collaboration with visual interactions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MUM '06: Proceedings of the 5th international conference on Mobile and ubiquitous multimedia
    December 2006
    78 pages
    ISBN:1595936076
    DOI:10.1145/1186655
    • General Chair:
    • Vidya Setlur
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • MediaX-Stanford University
    • Nokia
    • Ricoh

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 December 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. imaging
    2. large displays
    3. mobile camera
    4. user interfaces
    5. visual interaction

    Qualifiers

    • Article

    Conference

    MUM06
    Sponsor:
    MUM06: Mobile Ubiquitous Multimedia Conferene 2006
    December 4 - 6, 2006
    California, Stanford, USA

    Acceptance Rates

    Overall Acceptance Rate 190 of 465 submissions, 41%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2015)Reading between linesProceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/2750858.2805824(157-168)Online publication date: 7-Sep-2015
    • (2013)LightSyncProceedings of the 19th annual international conference on Mobile computing & networking10.1145/2500423.2500437(15-26)Online publication date: 30-Sep-2013
    • (2010)Interactive display of image details using a camera-coupled mobile projector2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops10.1109/CVPRW.2010.5543466(9-16)Online publication date: Jun-2010
    • (2008)A camera-based mobile data channelProceedings of the 16th ACM international conference on Multimedia10.1145/1459359.1459408(359-368)Online publication date: 26-Oct-2008
    • (2007)Unsynchronized 4D BarcodesAdvances in Visual Computing10.1007/978-3-540-76858-6_36(363-374)Online publication date: 2007

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media