ABSTRACT
Live video streaming is becoming an increasingly popular form of interaction in social media, with mobile devices being used for sharing of remote situation "on the go." We are interested in how such forms of interaction can be applied to mobile telepresence, i.e., a quick and effortless way of "teleporting" users to a remote location, where they can share each others' viewpoints and collaborate. We developed an application that achieves such effect by taking advantage of spatial data inferred from mobile devices' onboard sensors and embeds realtime video streams into panoramic mixed reality displays. To validate our solution we conducted a preliminary study and observed a statistically significant decrease in cognitive workload as well as increase in spatial and situational awareness among users in comparison with a regular videoconferencing application. Believing in the novelty of our approach, we plan to extend our application with environment mapping and empathic interface functionality.
- Mark Billinghurst. 2017. Will Mixed Reality Replace Phone Calls? https://medium.com/super-ventures-blog/will-mixedreality-replace-phone-calls-29b1feb2c62a. (2017).Google Scholar
- Mark Billinghurst, Alaeddin Nassani, and Carolin Reichherzer. 2014. Social Panoramas: Using Wearable Computers to Share Experiences. In SIGGRAPH Asia Mobile Graphics and Interactive Applications (SA '14). ACM, New York, Article 25, 1 pages. Google ScholarDigital Library
- Antorweep Chakravorty and Chunming Rong. 2017. Ushare: user controlled social media based on blockchain. In Proc. of the 11th Int. Conf. on Ubiquitous Information Management and Communication. ACM, 99. Google ScholarDigital Library
- Steffen Gauglitz, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2014. World-stabilized annotations and virtual scene navigation for remote collaboration. In Proc. of the 27th annual ACM Symp. on User interface software and technology. ACM, 449--459. Google ScholarDigital Library
- William A Hamilton, John Tang, Gina Venolia, Kori Inkpen, Jakob Zillner, and Derek Huang. 2016. Rivulet: Exploring participation in live events through multi-stream experiences. In Proc. of the ACM Int. Conf. on Interactive Experiences for TV and Online Video. ACM, 31--42. Google ScholarDigital Library
- Nicolas Herbaut and Nicolas Negru. 2017. A model for collaborative blockchain-based video delivery relying on advanced network services chains. IEEE Communications Magazine 55, 9 (2017), 70--76.Google ScholarDigital Library
- Shunichi Kasahara, Shohei Nagai, and Jun Rekimoto. 2017. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera. IEEE trans. on visualization and computer graphics 23, 3 (2017), 1222--1234. Google ScholarDigital Library
- Katsutoshi Masai, Kai Kunze, Mark Billinghurst, and others. 2016. Empathy Glasses. In Proc. of the 2016 CHI Conf. Extended Abstracts on Human Factors in Computing Systems. ACM, 1257--1263. Google ScholarDigital Library
- Jörg Müller, Tobias Langlotz, and Holger Regenbrecht. 2016. PanoVC: Pervasive telepresence using mobile phones. In Pervasive Computing and Communications (PerCom). IEEE, 1--10.Google Scholar
- Holger Schnädelbach, Alan Penn, and Philip Steadman. 2007. Mixed reality architecture: a dynamic architectural topology. (2007).Google Scholar
Index Terms
- Spatial Social Media: Towards Collaborative Mixed Reality Telepresence “On The Go”
Recommendations
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Distributed Metaverse: Creating Decentralized Blockchain-based Model for Peer-to-peer Sharing of Virtual Spaces for Mixed Reality Applications
AH '18: Proceedings of the 9th Augmented Human International ConferenceMixed reality telepresence is becoming an increasingly popular form of interaction in social and collaborative applications. We are interested in how created virtual spaces can be archived, mapped, shared, and reused among different applications. ...
Spotility: Crowdsourced Telepresence for Social and Collaborative Experiences in Mobile Mixed Reality
CSCW '18 Companion: Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social ComputingLive video streaming is becoming increasingly popular as a form of interaction in social applications. One of its main advantages is an ability to immediately create and connect a community of remote users on the spot. In this paper we discuss how this ...
Comments