skip to main content
10.1145/1851600.1851626acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

Towards using embedded magnetic field sensor for around mobile device 3D interaction

Published: 07 September 2010 Publication History

Abstract

We present a new technique based on using embedded compass (magnetic) sensor for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical boundary. Our proposed method is based on using compass (magnetic field) sensor integrated in new mobile devices (e.g. iPhone 3GS, G1/2 Android). In this method, a properly shaped permanent magnet (e.g. a rod, pen or a ring) is used for interaction. The user makes coarse gestures in 3D space around the device using the magnet. Movement of the magnet affects magnetic field sensed by the compass sensor integrated in the device. The temporal pattern of the gesture is then used as a basis for sending different interaction commands to the mobile device. The proposed method does not impose changes in hardware and physical specifications of the mobile device, and unlike optical methods is not limited by occlusion problems. Therefore, it allows for efficient use of 3D space around device, including back of device. Zooming, turning pages, accepting/rejecting calls, clicking items, controlling a music player, and mobile game interaction are some example use cases. Initial evaluation of our algorithm using a prototype application developed for iPhone shows convincing gesture classification results.

References

[1]
Starner, T. and Auxier, J. and Ashbrook, D. and Gandy, M, The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring, International Symposium on Wearable Computing, 2000, pp. 87--94.
[2]
Kratz, S., Rohs, M. HoverFlow: expanding the design space of around-device interaction. In Proc. of the 11th International Conference on Human Interaction with Mobile Devices and Services, Sep. 2009, Bonn, Germany.
[3]
Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. In Proc. of UIST '00. ACM, pp. 91--100.
[4]
Butler, A., Izadi, S., and Hodges, S. 2008. SideSight: Multi-"touch" interaction around small devices. In Proc. of UIST'08. ACM, 201--204.
[5]
Howard, B. and Howard, M.G.: Ubiquitous Computing Enabled by Optical Reflectance Controller. Whitepaper. Lightglove, Inc., http://lightglove.com/WhitePaper.htm. (Visited on 25.06.2009).
[6]
Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. In Proc. of CHI '09.
[7]
Metzger, C., Anderson, M., and Starner, T. 2004. FreeDigiter: A Contact-Free Device for Gesture Control. In Proc. of the Eighth international Symposium on Wearable Computers. ISWC. IEEE Computer Society, 18--21.
[8]
Theremin, L.S. The Design of a Musical Instrument Based on Cathode Relays. Reprinted in Leonardo Music J., No. 6, 1996, 49--50.
[9]
Smith, J., White, T., Dodge, C., Paradiso, J., Gershenfeld, N., and Allport, D. 1998. Electric Field Sensing For Graphical Interfaces. IEEE Comput. Graph. Appl. 18, 3 (May. 1998), 54--60.
[10]
Minsky M L and Papert S A 1969 Perceptrons (Cambridge, MA: MIT Press).
[11]
Sheldon B. Akers. Binary Decision Diagrams, IEEE Transactions on Computers, C-27(6), pp. 509--516, June 1978.

Cited By

View all
  • (2022)TrackballWatchProceedings of the ACM on Human-Computer Interaction10.1145/35467346:MHCI(1-14)Online publication date: 20-Sep-2022
  • (2021)GestuRING: A Web-based Tool for Designing Gesture Input with Rings, Ring-Like, and Ring-Ready DevicesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474780(710-723)Online publication date: 10-Oct-2021
  • (2021)POV Display and Interaction Methods extending SmartphoneProceedings of the Augmented Humans International Conference 202110.1145/3458709.3458992(183-191)Online publication date: 22-Feb-2021
  • Show More Cited By

Index Terms

  1. Towards using embedded magnetic field sensor for around mobile device 3D interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
    September 2010
    552 pages
    ISBN:9781605588353
    DOI:10.1145/1851600
    • General Chairs:
    • Marco de Sá,
    • Luís Carriço,
    • Program Chair:
    • Nuno Correia
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 September 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. around device 3D interaction
    2. embedded compass (magnetic) sensor
    3. mobile devices
    4. movement-based gestures
    5. properly shaped magnet

    Qualifiers

    • Research-article

    Conference

    MobileHCI '10

    Acceptance Rates

    MobileHCI '10 Paper Acceptance Rate 46 of 225 submissions, 20%;
    Overall Acceptance Rate 202 of 906 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)25
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)TrackballWatchProceedings of the ACM on Human-Computer Interaction10.1145/35467346:MHCI(1-14)Online publication date: 20-Sep-2022
    • (2021)GestuRING: A Web-based Tool for Designing Gesture Input with Rings, Ring-Like, and Ring-Ready DevicesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474780(710-723)Online publication date: 10-Oct-2021
    • (2021)POV Display and Interaction Methods extending SmartphoneProceedings of the Augmented Humans International Conference 202110.1145/3458709.3458992(183-191)Online publication date: 22-Feb-2021
    • (2021)AR-enhanced Widgets for Smartphone-centric InteractionProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472019(1-12)Online publication date: 27-Sep-2021
    • (2020)waveSenseProceedings of the Augmented Humans International Conference10.1145/3384657.3384790(1-7)Online publication date: 16-Mar-2020
    • (2020)WiSignACM Transactions on Intelligent Systems and Technology10.1145/337755311:3(1-24)Online publication date: 23-Apr-2020
    • (2020)Watch my Painting: The Back of the Hand as a Drawing Space for SmartwatchesExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3383040(1-10)Online publication date: 25-Apr-2020
    • (2020)MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in MagnetometerProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376234(1-13)Online publication date: 21-Apr-2020
    • (2019)Tangible Around-Device Interaction Using Rotatory Gestures with a Magnetic RingProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340137(1-8)Online publication date: 1-Oct-2019
    • (2019)MagnetipsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300638(1-12)Online publication date: 2-May-2019
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media