Exploring 3D manipulation on large stereoscopic displays

ABSTRACT

In the last years stereoscopic 3D has seen a drastic increase in popularity especially in terms of consumer-ready hardware and software. While the technology for input (smart-phone, Kinect, etc.) as well as output (passive/active stereoscopic and auto-stereoscopic displays etc.) is market ready, only few solutions for natural interaction with such devices exist. In this paper we propose an approach for mobile and gestural interaction with stereoscopic 3D content. We evaluate our technique in a 3D docking task on a large 3D display. In an experiment the interaction technique was evaluated for monoscopic and stereoscopic displayed data. Our results show that the translation and rotation precision benefits from the usage of stereoscopic 3D. Especially for tasks that require simultaneous rotation on all three axes stereoscopic displays outperform monoscopic 3D drastically.

References

1. James Boritz and Kellogg S Booth. 1998. A study of interactive 6 DOF docking in a computerised virtual environment. In Virtual Reality Annual International Symposium, 1998. Proceedings., IEEE 1998. IEEE, 139--146. DOI:http://dx.doi.org/10.1109/VRAIS.1998.658476
2. Doug A. Bowman, Ernst Kruijff, Joseph J. LaViola, and Ivan Poupyrev. 2004. 3D User Interfaces: Theory and Practice. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA. 3D interaction.
3. Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A Study in Interactive 3-D Rotation Using 2-D Control Devices. SIGGRAPH Comput. Graph. 22, 4 (June 1988), 121--129. DOI:http://dx.doi.org/10.1145/378456.378497
4. Florian Daiber, Andrey Krekhov, Marco Speicher, Jens Krüger, and Antonio Krüger. 2013. A Framework for Prototyping and Evaluation of Sensor-based Mobile Interaction with Stereoscopic 3D. In ACM ITS Workshop on Interactive Surfaces for Interaction with Stereoscopic 3D (ISIS3D). Workshop on Interactive Surfaces for Interaction with Stereoscopic 3D (ISIS3D-13), located at ITS 2013, October 6--9, St. Andrews, United Kingdom. online, 13--16. http://www.dfki.de/~fdaiber/t3d/downloads/ISIS3D-proceedings/Daiber.pdf
5. Florian Daiber, Marco Speicher, Sven Gehring, Markus Löchtefeld, and Antonio Krüger. 2014. Interacting with 3D Content on Stereoscopic Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14). ACM, New York, NY, USA, Article 32, 6 pages. DOI:http://dx.doi.org/10.1145/2611009.2611024
6. Sven Gehring, Elias Hartz, Markus Löchtefeld, and Antonio Krüger. 2013. The Media FaçAde Toolkit: Prototyping and Simulating Interaction with Media FaçAdes. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, New York, NY, USA, 763--772. DOI:http://dx.doi.org/10.1145/2493432.2493471
7. Sven Gehring and Antonio Krüger. 2012. FaçAde Map: Continuous Interaction with Media FaçAdes Using Cartographic Map Projections. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 471--480. DOI:http://dx.doi.org/10.1145/2370216.2370286
8. Kim Halskov, Peter Dalsgaard, and Louise Bak Stolze. 2014. Analysing Engaging Experiences with a Tangible 3D Tabletop. In Proceedings of the 11th Conference on Advances in Computer Entertainment Technology (ACE '14). ACM, New York, NY, USA, Article 29, 10 pages. DOI:http://dx.doi.org/10.1145/2663806.2663831
9. S. G. Hart and L. E. Stavenland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload, P. A. Hancock and N. Meshkati (Eds.). Elsevier, Chapter 7, 139--183. http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20000004342_1999205624.pdf
10. Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive real-world interface props for neurosurgical visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 452--458. DOI: http://dx.doi.org/10.1145/191666.191821
11. Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz. 2000. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST '00). ACM, New York, NY, USA, 91--100. DOI:http://dx.doi.org/10.1145/354401.354417
12. Ken Hinckley, Joe Tullio, Randy Pausch, Dennis Proffitt, and Neal Kassell. 1997. Usability Analysis of 3D Rotation Techniques. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97). ACM, New York, NY, USA, 1--10. DOI:http://dx.doi.org/10.1145/263407.263408
13. Richard H Jacoby, Mark Ferneau, and Jim Humphries. 1994. Gestural interaction in a virtual environment. In IS&T/SPIE 1994 International Symposium on Electronic Imaging: Science and Technology. International Society for Optics and Photonics, 355--364. DOI:http://dx.doi.org/10.1117/12.173892
14. Marcel Köster, Michael Schmitz, and Sven Gehring. 2015. Gravity Games: A Framework for Interactive Space Physics on Media Facades. In Proceedings of the 4th International Symposium on Pervasive Displays (PerDis '15). ACM, New York, NY, USA, 115--121. DOI:http://dx.doi.org/10.1145/2757710.2757717
15. J. J. Kuffner. 2004. Effective sampling and distance metrics for 3D rigid body path planning. In Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference on, Vol. 4. 3993--3998 Vol.4. DOI:http://dx.doi.org/10.1109/ROBOT.2004.1308895
16. André Kunert, Alexander Kulik, Anke Huckauf, and Bernd Fröhlich. 2007. A comparison of tracking- and controller-based input for complex bimanual interaction in virtual environments. In Proceedings of the 13th Eurographics conference on Virtual Environments (EGVE'07). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 43--52. DOI:http://dx.doi.org/10.2312/EGVE/IPT_EGVE2007/043-052
17. Hai-Ning Liang, Cary Williams, Myron Semegen, Wolfgang Stuerzlinger, and Pourang Irani. 2013. An Investigation of Suitable Interactions for 3D Manipulation of Distant Objects through a Mobile Device. International Journal of Innovative Computing, Information and Control (IJICIC) 9, 12 (Dec. 2013), 4737--4752. http://www.ijicic.org/apchi12-291.pdf
18. Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2010. The Effect of DOF Separation in 3D Manipulation Tasks with Multi-touch Displays. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (VRST '10). ACM, New York, NY, USA, 111--118. DOI:http://dx.doi.org/10.1145/1889863.1889888
19. Maurice R. Masliah and Paul Milgram. 2000. Measuring the allocation of control in a 6 degree-of-freedom docking experiment. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 25--32. DOI:http://dx.doi.org/10.1145/332040.332403
20. Kasözacar, Kazuki Takashima, and Yoshifumi Kitamura. 2013. Direct 3D Object Manipulation on a Collaborative Stereoscopic Display. In Proceedings of the 1st Symposium on Spatial User Interaction (SUI '13). ACM, New York, NY, USA, 69--72. DOI:http://dx.doi.org/10.1145/2491367.2491374
21. Krzysztof Pietroszek, Anastasia Kuzminykh, James R. Wallace, and Edward Lank. 2014. Smartcasting: A Discount 3D Interaction Technique for Public Displays. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, New York, NY, USA, 119--128. DOI:http://dx.doi.org/10.1145/2686612.2686629
22. Krzysztof Pietroszek, James R Wallace, and Edward Lank. 2015. Tiltcasting: 3D Interaction on Large Displays using a Mobile Device. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 57--62. DOI:http://dx.doi.org/10.1145/2807442.2807471
23. Frank Steinicke, Klaus H. Hinrichs, Johannes Schöning, and Antonio Krüger. 2008. Multi-Touching 3D Data: Towards Direct Interaction in Stereoscopic Display Environments coupled with Mobile Devices. In Advanced Visual Interfaces (AVI) Workshop on Designing Multi-Touch Interaction Techniques for Coupled Public and Private Displays. 46--49. http://viscg.uni-muenster.de/publications/2008/SHSK08
24. Yanqing Wang, Christine L. MacKenzie, Valerie A. Summers, and Kellogg S. Booth. 1998. The Structure of Object Transportation and Orientation in Human-computer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '98). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 312--319. DOI:http://dx.doi.org/10.1145/274644.274688
25. Shumin Zhai and Paul Milgram. 1998. Quantifying Coordination in Multiple DOF Movement and Its Application to Evaluating 6 DOF Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '98). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 320--327. DOI:http://dx.doi.org/10.1145/274644.274689

Index Terms

• Human-centered computing