Wolfgang Büschel
Annett Mitschick
Raimund Dachselt
ABSTRACT
With this work, we demonstrate our concept of Reality-Based Information Retrieval. Our principal idea is to bring Information Retrieval closer to the real world, for a new class of future, immersive IR interfaces. Technological advances in computer vision and machine learning will allow mobile Information Retrieval to make even better use of the people's surroundings and their ability to interact with the physical world. Reality-Based Information Retrieval augments the classic Information Retrieval process with context-dependent search cues and situated query and result visualizations using Augmented Reality technologies. We briefly describe our concept as an extension of the Information Retrieval pipeline and present two prototype implementations that showcase the potential of Reality-Based Information Retrieval.
Supplemental Material
- Antti Ajanki, Mark Billinghurst, Toni Järvenpää, Melih Kandemir, Samuel Kaski, Markus Koskela, Mikko Kurimo, Jorma Laaksonen, Kai Puolamäki, Teemu Ruokolainen, and others. 2010. Contextual information access with augmented reality. In Proc. 2010 IEEE Int. Workshop MLSP. IEEE, 95--100.Google Scholar
Cross Ref
- Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Found. Trends Hum.-Comput. Interact. 8, 2-3 (March 2015), 73--272. Google ScholarDigital Library
- Wolfgang Büschel, Annett Mitschick, and Raimund Dachselt. 2018. Here and Now: Reality-Based Information Retrieval. In Proc. CHIIR '18. ACM, New York, NY, USA, to appear. Google ScholarDigital Library
- Neven ElSayed, Bruce Thomas, Kim Marriott, Julia Piantadosi, and Ross Smith. 2015. Situated Analytics. In 2015 Big Data Visual Analytics (BDVA). 1--8.Google Scholar
- Barrett Ens and Pourang Irani. 2017. Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics. IEEE Comp. Graph. Appl. 37, 2 (2017), 66--79. Google ScholarDigital Library
- Xin Fan, Xing Xie, Zhiwei Li, Mingjing Li, and Wei-Ying Ma. 2005. Photo-to-search: Using Multimodal Queries to Search the Web from Mobile Devices. In Proc. MIR '05. ACM, New York, NY, USA, 143--150. Google ScholarDigital Library
- Masakazu Iwamura, Kai Kunze, Yuya Kato, Yuzuko Utsumi, and Koichi Kise. 2014. Haven't We Met Before?: A Realistic Memory Assistance System to Remind You of the Person in Front of You. In Proc. AH '14. ACM, New York, NY, USA, Article 32, 4 pages. Google ScholarDigital Library
- Bradley J. Rhodes and Pattie Maes. 2000. Just-in-time Information Retrieval Agents. IBM Syst. J. 39, 3-4 (July 2000), 685--704. Google ScholarDigital Library
Index Terms
- Demonstrating Reality-Based Information Retrieval
Recommendations
Here and Now: Reality-Based Information Retrieval: Perspective Paper
CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & RetrievalToday, the widespread use of mobile devices allows users to search information "on the go»», whenever and wherever they want, no longer confining Information Retrieval to classic desktop interfaces. We believe that technical advances in Augmented ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical SystemsAs shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Comments