Marius Noreikis
ABSTRACT
Augmented Reality (AR) based navigation has emerged as an impressive, yet seamless way of guiding users in unknown environments. Its quality of experience depends on many factors, including the accuracy of camera pose estimation, response delay, and energy consumption. In this paper, we present SeeNav - a seamless and energy-efficient AR navigation system for indoor environments. SeeNav combines image-based localization and inertial tracking to provide an accurate and robust camera pose estimation. As vision processing is much more compute intensive than the processing of inertial sensor data, SeeNav offloads the former one from resource-constrained mobile devices to a cloud to improve tracking performance and reduce power consumption. More than that, SeeNav implements a context-aware task scheduling algorithm that further minimizes energy consumption while maintaining the accuracy of camera pose estimation. Our experimental results, including a user study, show that SeeNav provides seamless navigation experience and reduces the overall energy consumption by 21.56% with context-aware task scheduling.
- 2016. Pokemon GO Drains A LOT MORE Battery since the last update! https://pokemongohub.net/pokemon-go-drains-a-lot-more-battery-since-the-last-update/. (9 November 2016).Google Scholar
- Marzieh Jalal Abadi, Luca Luceri, Mahbub Hassan, Chun Tung Chou, and Monica Nicoli. 2014. A collaborative approach to heading estimation for smartphonebased PDR indoor localisation. In Indoor Positioning and Indoor Navigation (IPIN), 2014 International Conference on. IEEE, IEEE, 554--563.Google ScholarCross Ref
- Michael Abrash. 2017. After mixed year, mobile AR to drive $108 billion VR/AR market by 2021. http://www.digi-capital.com/news/2017/01/after-mixed-year-mobile-ar-to-drive-108-billion-vrar-market-by-2021/. (January 2017).Google Scholar
- Clemens Arth and Dieter Schmalstieg. 2011. Challenges of large-scale augmented reality on smartphones. Graz University of Technology, Graz (2011), 1--4.Google Scholar
- Jeffrey R. Blum, Daniel G. Greencorn, and Jeremy R. Cooperstock. 2012. Smartphone sensor reliability for augmented reality applications. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services. Springer, 127--138.Google Scholar
- Jiang Dong, Yu Xiao, Marius Noreikis, Zhonghong Ou, and Antti Ylä-Jääski. 2015. imoon: Using smartphones for image-based indoor navigation. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems. ACM, 85--97. Google ScholarDigital Library
- Georg Gerstweiler, Emanuel Vonach, and Hannes Kaufmann. 2015. Hymotrack: A mobile AR navigation system for complex indoor environments. Sensors 16, 1 (2015), 17.Google ScholarCross Ref
- Alexandru Gherghina, Alexandru-Corneliu Olteanu, and Nicolae Tapus. 2013. A marker-based augmented reality system for mobile devices. In Roedunet International Conference (RoEduNet), 2013 11th. IEEE, 1--6.Google ScholarCross Ref
- Jared Heinly, Johannes L. Schonberger, Enrique Dunn, and Jan-Michael Frahm. 2015. Reconstructing the world* in six days*(as captured by the yahoo 100 million image dataset). In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3287--3295.Google Scholar
- Yingjuan Hu, Xuewen Liao, Qian Lu, Shulin Xu, and Wei Zhu. 2016. A segment-based fusion algorithm of WiFingerprinting and pedestrian dead reckoning. In Communications in China (ICCC), 2016 IEEE/CIC International Conference on. IEEE, 1--6.Google ScholarCross Ref
- Baoqi Huang, Guodong Qi, Xiaokun Yang, Long Zhao, and Han Zou. 2016. Exploiting cyclic features of walking for pedestrian dead reckoning with unconstrained smartphones. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 374--385. Google ScholarDigital Library
- Jiung-Yao Huang, Su-Hui Lee, and Chung-Hsien Tsai. 2016. A fast image matching technique for the panoramic-based localization. In Computer and Information Science (ICIS), 2016 IEEE/ACIS 15th International Conference on. IEEE, 1--6.Google ScholarCross Ref
- Christian Koch, Matthias Neges, Markus König, and Michael Abramovici. 2014. Natural markers for augmented reality-based indoor navigation and facility maintenance. Automation in Construction 48 (2014), 18--30.Google ScholarCross Ref
- Fan Li, Chunshui Zhao, Guanzhong Ding, Jian Gong, Chenxing Liu, and Feng Zhao. 2012. A reliable and accurate indoor localization method using phone inertial sensors. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 421--430. Google ScholarDigital Library
- Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of psychology (1932).Google Scholar
- Kaikai Liu and Xiaolin Li. 2015. Enabling context-aware indoor augmented reality via smartphone sensing and vision tracking. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 1s (2015), 15. Google ScholarDigital Library
- Zhenguang Liu, Luming Zhang, Qi Liu, Yifang Yin, Li Cheng, and Roger Zimmermann. 2017. Fusion of Magnetic and Visual Sensors for Indoor Localization: Infrastructure-Free and More Effective. IEEE Transactions on Multimedia 19, 4 (2017), 874--888. Google ScholarDigital Library
- F Landis Markley, Yang Cheng, John Lucas Crassidis, and Yaakov Oshman. 2007. Averaging quaternions. Journal of Guidance, Control, and Dynamics 30, 4 (2007), 1193--1197.Google ScholarCross Ref
- Alessandro Mulloni, Hartmut Seichter, and Dieter Schmalstieg. 2011. Handheld augmented reality indoor navigation with activity-based instructions. In Proceedings of the 13th international conference on human computer interaction with mobile devices and services. ACM, 211--220. Google ScholarDigital Library
- Karl Pauwels, Leonardo Rubio, and Eduardo Ros. 2016. Real-time pose detection and tracking of hundreds of objects. IEEE Transactions on Circuits and Systems for Video Technology 26, 12 (2016), 2200--2214. Google ScholarDigital Library
- Hollister Sean and Fleenor Rebecca. 2016. How Pokemon Go affects your phone's battery life and data. https://www.cnet.com/how-to/pokemon-go-battery-test-data-usage/. (13 July 2016).Google Scholar
- Guowei Shi and Ying Ming. 2016. Survey of Indoor Positioning Systems Based on Ultra-wideband (UWB) Technology. In Wireless Communications, Networking and Applications. Springer, 1269--1278.Google Scholar
- Jonathan Ventura, Clemens Arth, Gerhard Reitmayr, and Dieter Schmalstieg. 2014. Global localization from monocular slam on a mobile phone. IEEE transactions on visualization and computer graphics 20, 4 (2014), 531--539. Google ScholarDigital Library
- Lauri Wirola, Tommi A Laine, and Jari Syrjärinne. 2010. Mass-market requirements for indoor positioning and indoor navigation. In Indoor Positioning and Indoor Navigation (IPIN), 2010 International Conference on. IEEE, 1--7.Google ScholarCross Ref
- R. G. Yudanto and F. Petr. 2015. Sensor fusion for indoor navigation and tracking of automated guided vehicles. In 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN). 1--8.Google Scholar
Index Terms
- SeeNav: Seamless and Energy-Efficient Indoor Navigation using Augmented Reality
Recommendations
Handheld augmented reality indoor navigation with activity-based instructions
MobileHCI '11: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and ServicesWe present a novel design of an augmented reality interface to support indoor navigation. We combine activity-based instructions with sparse 3D localisation at selected info points in the building. Based on localisation accuracy and the users' ...
Indoor navigation with mixed reality world-in-miniature views and sparse localization on mobile devices
AVI '12: Proceedings of the International Working Conference on Advanced Visual InterfacesWe present the design of an interface that provides continuous navigational support for indoor scenarios where localization is only available at sparse, discrete locations (info points). Our interface combines turn-by-turn instructions with a World-in-...
A mobile indoor navigation system interface adapted to vision-based localization
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous MultimediaVision-based approaches for mobile indoor localization do not rely on the infrastructure and are therefore scalable and cheap. The particular requirements to a navigation user interface for a vision-based system, however, have not been investigated so ...
Comments