Alex Butler
Otmar Hilliges
David Kim
ABSTRACT
We present Vermeer, a novel interactive 360° viewable 3D display. Like prior systems in this area, Vermeer provides viewpoint-corrected, stereoscopic 3D graphics to simultaneous users, 360° around the display, without the need for eyewear or other user instrumentation. Our goal is to over-come an issue inherent in these prior systems which - typically due to moving parts - restrict interactions to outside the display volume. Our system leverages a known optical illusion to demonstrate, for the first time, how users can reach into and directly touch 3D objects inside the display volume. Vermeer is intended to be a new enabling technology for interaction, and we therefore describe our hardware implementation in full, focusing on the challenges of combining this optical configuration with an existing approach for creating a 360° viewable 3D display. Initially we demonstrate direct involume interaction by sensing user input with a Kinect camera placed above the display. However, by exploiting the properties of the optical configuration, we also demonstrate novel prototypes for fully integrated input sensing alongside simultaneous display. We conclude by discussing limitations, implications for interaction, and ideas for future work.
Supplemental Material
- Adhya, S. and Noé, J. A Complete Ray-trace Analysis of the 'Mirage' Toy. In SPIE Education and Training in Optics and Photonics Conference (ETOP). 2007.Google Scholar
- Agrawala, M., Beers, A., McDowall, I., Froehhlich, B., Bolas, M., Hanrahan, P. The two-user Responsive Workbench: support for collaboration through individual views of a shared space. In ACM SIGGRAPH '97. Google ScholarDigital Library
- Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Natick, MA, USA. Google ScholarDigital Library
- Bimber, O. Fröhlich, B., Schmalstieg, D. Encarnacao, L.M. The virtual showcase: a projection-based multi-user augmented reality display. In ACM SIGGRAPH'0. Google ScholarDigital Library
- Blundell, B. and Schwarz, A.J. Volumetric Three-Dimensional Display Systems, Wiley-IEEE Press, 200. Google ScholarDigital Library
- Blundell, B. and Schwarz, A.J. Creative 3-D Display and Interaction Interfaces: A Trans-Disciplinary Approach, Wily-Interscience, 2005.Google Scholar
- Cobb, S., Nichols, S., Ramsey, A., Wilson, J. Virtual Reality-Induced Symptoms and Effects (VRISE). Presence: Teleoper. Virtual Environ. 8, 2 (April 1999. Google ScholarDigital Library
- Cossairt, O.S., Napoli, J., Hill, S.L., Dorval, R.K., Favalora, E. Occlusion-capable multiview three-dimensional display. In Applied Optics (46). (2007).Google Scholar
- Dodgson, N. A. 2005. Autostereoscopic 3D displays. Computer 38, 8, 31--36. Google ScholarDigital Library
- Dorval, R.K., Thomas, M., Bareau, J. Volumetric three-dimensional display system. US Patent #6,554,430 (issued 29 Apr 2003).Google Scholar
- 1Elings, V.B., Landry, C.J. Optical Display Device. US Patent #3647284. Issued March 7, 1972.Google Scholar
- Endo, T., Sato, M., Kajiki, Y., Honda, T. Cylindrical 3D Video Display Observable from All Directions. In Proc Pacific Conference on Computer Graphics and Applications (PG '00). Google ScholarDigital Library
- Favalora, G. E. 2005. Volumetric 3D displays and application infrastructure. In Computer 38, 8, 37--44. Google ScholarDigital Library
- Grossman, T. and Balakrishnan, R., An Evaluation of Depth Perception on Volumetric Displays, In AVI 200. Google ScholarDigital Library
- Grossman, T. and Balakrishnan, R., The Design and Evaluation of Selection Techniques for 3D Volumetric Displays, In Proceedings of UIST 2006. Google ScholarDigital Library
- Grossman, T., Wigdor, D. and Balakrishnan, R., Multi-Finger Gestural Interaction with 3D Volumetric Dis-plays, In Proceedings of UIST 2004. Google ScholarDigital Library
- Halle, M., Autostereoscopic displays and computer graphics. In Proceedings of ACM SIGGRAPH '9. Google ScholarDigital Library
- Hoffman, D., Girshick, A., Akeley, K. and Banks, S. 2008. Vergence--accommodation conflicts hinder visual performance and cause visual fatigue. In Journal of Vision 2008 8(3): 3.Google Scholar
- Jones, A., Bolas, M., McDowall, I., Yamada, H., & Debevec, P. Rendering for an Interactive 360 Degree Light Field Display, In Proceedings of ACM SIGGRAPH 2007. Google ScholarDigital Library
- Kimura, H., Uchiyama, T., and Yoshikawa, H. 2006. Laser produced 3D display in the air. In Proceedings of ACM SIGGRAPH 2006 Emerging Technologies. Google ScholarDigital Library
- 2Kiyokawa, K. , Kurata, K., Ohno, H. An Optical See-Through Display for Mutual Occlusion of Real and Virtual Environments. In Proc ACM ISAR 2000.Google Scholar
- 2Maeda, H., Hirose, K., Yamashita, J., Hirota, K., and Hirose, M. 2003. All-around display for video avatar in real world. In Proceedings of ISMAR 2003. Google ScholarDigital Library
- Malik, S., McDonald, C. and Roth, G. "Hand Tracking for Interactive Pattern-based Augmented Reality". In Proceedings of ISMAR 2002. Google ScholarDigital Library
- OptiGone, http://www.optigone.com/m22.htm (verified July 2011).Google Scholar
- Poston, T., Serra, L. Dextrous virtual work. Commun. ACM 39, 5 (May 1996), 37--45. Google ScholarDigital Library
- Scharver, C., Evenhouse, R., Johnson, A., Leigh, J. Designing Cranial Implants in a Haptic Augmented Reality Environment. Comm. of the ACM, Volume 47, Issue 8, August 200. Google ScholarDigital Library
- Shin-Etsu View Control Film, http://www.shinetsu.info/index.php/products/view-control-film/view-control-fil.Google Scholar
- Suffern, K., Ray tracing from the Ground-up. AK Peters, pp. 22, 2007. Google ScholarDigital Library
- Sullivan, A. A Solid-State Multi-Planar Volumetric Display, SID Symposium Digest Tech Papers 34, 1531--1533 (2003).Google ScholarCross Ref
- Travis, A. R. L. The display of three-dimensional video images. Proceedings of the IEEE 85, 11 (Nov).Google Scholar
- 3von Wiegand, T., Schloerb, D., Sachtler, W.L. Virtual Workbench: Near-Field Virtual Environment System with Applications. Presence: Virt. Environ. 8, 5 (October 1999). Google ScholarDigital Library
- 3Yendo, T., Kawakami, N., and Tachi, S. 2005. Seelinder: the cylindrical lightfield display. In Proceedings of SIGGRAPH 2005 Emerging Technologies. Google ScholarDigital Library
Index Terms
- Vermeer: direct interaction with a 360° viewable 3D display
Recommendations
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesIn this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal InteractionThe proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets ...
Comments