SenseBelt: A Belt-Worn Sensor to Support Cross-Device Interaction

ABSTRACT

Mobile interaction is shifting from a single device to simultaneous interaction with ensembles of devices such as phones, tablets, or watches. Spatially-aware cross-device interaction between mobile devices typically requires a fixed tracking infrastructure, which limits mobility. In this paper, we present SenseBelt -- a sensing belt that enhances existing mobile interactions and enables low-cost, ad hoc sensing of cross-device gestures and interactions. SenseBelt enables proxemic interactions between people and their personal devices. SenseBelt also supports cross-device interaction between personal devices and stationary devices, such as public displays. We discuss the design and implementation of SenseBelt together with possible applications. With an initial evaluation, we provide insights into the benefits and drawbacks of a belt-worn mediating sensor to support cross-device interactions.

References

1. Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10), 121--130. https://doi.org/10.1145/1936652.1936676
2. Xiang 'Anthony' Chen, Tovi Grossman, Daniel J. Wigdor, and George Fitzmaurice. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. 159--168. https://doi.org/10.1145/2556288.2556955
3. David Dearman and Jeffery S. Pierce. 2008. It's on My Other Computer!: Computing with Multiple Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 767--776. https://doi.org/10.1145/1357054.1357177
4. David Dobbelstein, Philipp Hock, and Enrico Rukzio. 2015. Belt: An Unobtrusive Touch Input Device for Head-worn Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2135--2138. https://doi.org/10.1145/2702123.2702450
5. Hans Gellersen, Carl Fischer, Dominique Guinard, Roswitha Gostner, Gerd Kortuem, Christian Kray, Enrico Rukzio, and Sara Streng. 2009. Supporting Device Discovery and Spontaneous Interaction with Spatial References. Personal Ubiquitous Comput. 13, 4: 255--264. https://doi.org/10.1007/s00779-008-0206--3
6. Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14), 523--532. https://doi.org/10.1145/2598510.2598541
7. Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1: 42--50. https://doi.org/10.1145/1897239.1897250
8. Anisse Gross. 2014. What's the Problem with Google Glass? The New Yorker. Retrieved January 6, 2017 from http://www.newyorker.com/business/currency/wh ats-the-problem-with-google-glass
9. Edward T. Hall. 1966. The Hidden Dimension.
10. Jason Hong. 2013. Considering Privacy Issues in the Context of Google Glass. Commun. ACM 56, 11: 10--11. https://doi.org/10.1145/2524713.2524717
11. Steven Houben, Jo Vermeulen, Clemens Klokmose, Nicolai Marquardt, Johannes Schöning, and Harald Reiterer. 2015. Cross-Surface: Workshop on Interacting with Multi-Device Ecologies in the Wild. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15), 485--489. https://doi.org/10.1145/2817721.2835067
12. William Huang, Ye-Sheng Kuo, Pat Pannuto, and Prabal Dutta. 2014. Opo: A Wearable Sensor for Capturing High-fidelity Face-to-face Interactions. In Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems (SenSys '14), 61--75. https://doi.org/10.1145/2668332.2668338
13. Haojian Jin, Christian Holz, and Kasper Hornbaek. 2015. Tracko: Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15), 147--156. https://doi.org/10.1145/2807442.2807475
14. Brad Johanson, Armando Fox, and Terry Winograd. 2002. The Interactive Workspaces project: experiences with ubiquitous computing rooms. IEEE Pervasive Computing 1, 2: 67--74. https://doi.org/10.1109/MPRV.2002.1012339
15. Tero Jokela, Jarno Ojala, and Thomas Olsson. 2015. A Diary Study on Combining Multiple Information Devices in Everyday Activities and Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), 3903--3912. https://doi.org/10.1145/2702123.2702211
16. Konstantin Klamka and Raimund Dachselt. 2015. Elasticcon: Elastic Controllers for Casual Interaction. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15), 410-- 419. https://doi.org/10.1145/2785830.2785849
17. David Ledo, Saul Greenberg, Nicolai Marquardt, and Sebastian Boring. 2015. Proxemic-Aware Controls: Designing Remote Controls for Ubiquitous Computing Ecologies. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15), 187--198. http://dx.doi.org/10.1145/2785830.2785871
18. Andrés Lucero, Matt Jones, Tero Jokela, and Simon Robinson. 2013. Mobile Collocated Interactions: Taking an Offline Break Together. interactions 20, 2: 26--32. https://doi.org/10.1145/2427076.2427083
19. Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual Engagement: Facilitating Information Exchange Between Digital Devices as a Function of Proximity. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12), 31--40. https://doi.org/10.1145/2396636.2396642
20. Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device Interaction via Micromobility and F-formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12), 13--22. https://doi.org/10.1145/2380116.2380121
21. Rene Mayrhofer and Hans Gellersen. 2009. Shake Well Before Use: Intuitive and Secure Pairing of Mobile Devices. IEEE Transactions on Mobile Computing 8, 6: 792--806. https://doi.org/10.1109/TMC.2009.51
22. Abhinav Mehrotra, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2015. Challenges in Managing Multi-Device Notifications. In Cross-Surface: Workshop on Interacting with Multi-Device Ecologies in the Wild.
23. Thomas Pederson, Lars-Erik Janlert, and Dipak Surie. 2011. A Situative Space Model for Mobile Mixed-Reality Computing. IEEE Pervasive Computing 10, 4: 73--83. https://doi.org/10.1109/MPRV.2010.51
24. Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14), 45--54. https://doi.org/10.1145/2669485.2669500
25. Jun Rekimoto. 1997. Pick-and-drop: A Direct Manipulation Technique for Multiple Computer Environments. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97), 31--39. https://doi.org/10.1145/263407.263505
26. Jun Rekimoto. 2000. Multiple-computer User Interfaces: "Beyond the Desktop" Direct Manipulation Environments. In CHI '00 Extended Abstracts on Human Factors in Computing Systems (CHI EA '00), 6--7. https://doi.org/10.1145/633292.633297
27. Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99), 378--385. https://doi.org/10.1145/302979.303113
28. Sonja Rümelin, Enrico Rukzio, and Robert Hardy. 2011. NaviRadar: A Novel Tactile Information Display for Pedestrian Navigation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11), 293-- 302. https://doi.org/10.1145/2047196.2047234
29. Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A cross-device interaction style for mobiles and surfaces. In Proceedings of the Designing Interactive Systems Conference, 318--327. http://doi.acm.org/10.1145/2317956.2318005
30. Kashyap Todi and Kris Luyten. 2014. Suit Up!: Inconspicuous Interactions on Jacket Buttons. In CHI 2014 Workshop on Inconspicuous Interaction.
31. Koji Tsukada and Michiaki Yasumura. 2004. ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. In UbiComp 2004: Ubiquitous Computing, 384--399.
32. Jo Vermeulen, Steven Houben, and Nicolai Marquardt. 2016. Fluent Transitions Between Focused and Peripheral Interaction in Proxemic Interactions. In Peripheral Interaction, Saskia Bakker, Doris Hausen and Ted Selker (eds.). Springer International Publishing, 137--163.
33. Narrative Clip 2. Narrative Clip 2 - the world's most wearable camera. Retrieved January 6, 2017 from http://getnarrative.com/

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)