Geospatial Access to Lifelogging Photos in Virtual Reality

ABSTRACT

We present a virtual reality system for accessing geotagged photos taken with a lifelogging camera. Photos are spatially located on a world map that can be explored with a head-mounted display. Using a virtual reality headset allows users to easily and intuitively explore this large information space. Images are initially represented by icons but become visible once a user gets closer to a particular area of interest. While not suitable for all search tasks, this visualisation has benefits in situations where location plays a significant role; be it because the actual content is location-related or because the owner of the lifelog remembers and associates the related event with certain places. Likewise, our spatial representation of the data often implicitly reveals a temporal relationship, which can be helpful in the search process as well.

References

1. Soumyadeb Chowdhury, Md Sadek Ferdous, and Joemon M Jose . 2016. A user-study examining visualization of lifelogs. In Content-Based Multimedia Indexing (CBMI), 2016 14th International Workshop on. IEEE, 1--6.
2. Aaron Duane, Rashmi Gupta, Liting Zhou, and Cathal Gurrin . 2016. Visual insights from personal lifelogs. In Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, Tokyo. 386--389.
3. Aaron Duane and Cathal Gurrin . 2017. Pilot Study to Investigate Feasibility of Visual Lifelog Exploration in Virtual Reality. In Proceedings of the 2nd Workshop on Lifelogging Tools and Applications. ACM, 29--32.
4. Aaron Duane and Cathal Gurrin . 2018. Lifelog exploration prototype in virtual reality. In International Conference on Multimedia Modeling. Springer, 377--380.
5. Cathal Gurrin, Alan F Smeaton, Aiden R Doherty, et almbox. . 2014. Lifelogging: Personal big data. Foundations and Trends® in Information Retrieval Vol. 8, 1 (2014), 1--125.
6. Jae Ho Jeon, Jongheum Yeon, Sang-goo Lee, and Jinwook Seo . 2014. Exploratory visualization of smarphone-based life-logging data using Smart Reality Testbed. In Big Data and Smart Computing (BIGCOMP), 2014 International Conference on. IEEE, 29--33.
7. Sanket Khanwalkar, Shonali Balakrishna, and Ramesh Jain . 2016. Exploration of large image corpuses in virtual reality Proceedings of the 2016 ACM on Multimedia Conference. ACM, 596--600.
8. Sojung Kwak, Joeun Lee, and Jieun Kwon . 2015. An Analysis of Infographic Design for Life-Logging Application. In Advances in Computer Science and Ubiquitous Computing. Springer, 185--191.
9. Gerald Schaefer, Mateusz Budnik, and Bartosz Krawczyk . 2017. Immersive browsing in an image sphere. In Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication. ACM, 26.
10. LSC website . 2018. Lifelog Search Challenge 2018. deftempurl%http://lsc.dcu.ie/ tempurl
11. Yang Yang and Cathal Gurrin . 2013. Personal lifelog visualization. In Proceedings of the 4th International SenseCam & Pervasive Imaging Conference. ACM, 82--83.
12. Y Yang, H Lee, and C Gurrin . 2013 a. Lifelogging: New Challenges for Information Visualization on Mobile Platforms. CHI'11 Extended Abstracts on Human Factors in Computing Systems (2013).
13. Yang Yang, Hyowon Lee, and Cathal Gurrin . 2013 b. Visualizing lifelog data for different interaction platforms CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 1785--1790.

Index Terms

• Applied computing

  • Education

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Virtual reality

  • Visualization

    • Visualization systems and tools