T(ether): spatially-aware handhelds, gestures and proprioception for multi-user 3D modeling and animation

ABSTRACT

T(ether) is a spatially-aware display system for multi-user, collaborative manipulation and animation of virtual 3D objects. The handheld display acts as a window into virtual reality, providing users with a perspective view of 3D data. T(ether) tracks users' heads, hands, fingers and pinching, in addition to a handheld touch screen, to enable rich interaction with the virtual scene. We introduce gestural interaction techniques that exploit proprioception to adapt the UI based on the hand's position above, behind or on the surface of the display. These spatial interactions use a tangible frame of reference to help users manipulate and animate the model in addition to controlling environment properties. We report on initial user observations from an experiment for 3D modeling, which indicate T(ether)'s potential for embodied viewport control and 3D modeling interactions.

References

1. Agrawala, M., Beers, A., McDowall, I., Fröhlich, B., Bolas, M., and Hanrahan, P. The two-user Responsive Workbench: support for collaboration through individual views of a shared space. Proc. SIGGRAPH '97, 327--332.
2. Bau, O., Poupyrev, I., Israr, A., and Harrison, C. TeslaTouch: electrovibration for touch surfaces. Proc. UIST '10. 283--292.
3. Bowman, D., and Hodges, L., F. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proc. I3D '97, 35--39.
4. Fitzmaurice, G.W. Situated Information Spaces and Spatially Aware Palmtop Computers. Com. ACM (1993), 36(7), 38--49.
5. Grossman, T. and Balakrishnan, R.. Collaborative interaction with volumetric displays. Proc. CHI '08, 383--392.
6. Henrysson, A., Billinghurst, M., and Ollila, M. Virtual object manipulation using a mobile phone. Proc. ICAT '05, 164--171.
7. Leithinger, D., Lakatos, D., DeVincenzi, A., Blackshaw, M., and Ishii, H. Direct and gestural interaction with relief: a 2.5D shape display. Proc. UIST '11, 541--548.
8. McKenna, M. Interactive viewpoint control and threedimensional operations. Proc. I3D '92, 53--56.
9. Mine, M. R. 1996. Working in a Virtual World: Interaction Techniques Used in the Chapel Hill Immersive Modeling Program. Technical Report.
10. Piekarski, W., Thomas, B. H. Through-Walls Collaboration. IEEE Pervasive Computing 8(3), 42--49.
11. Poupyrev, I., Tomokazu, N., Weghorst, S., Virtual Notepad: handwriting in immersive VR. Proc. VR '98. 126--132.
12. Shaw, C. Pain and Fatigue in Desktop VR. Proc. GI '98. 185192.
13. Spindler, M., Büschel, W., and Dachselt, R. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop environment. Proc. ITS '12, 245--254.
14. Szalavári, Z., Schmalstieg, D., Fuhrmann, A. and Gervautz, M. Studierstube: An environment for collaboration in augmented reality. Virtual Reality (1998), 3:37--48.
15. Szalavári, Zs,, Gervautz, M. The Personal Interaction Panel -- a Two-Handed Interface for Augmented Reality. Computer Graphics Forum (1997), 16(3).
16. Tsang, M., Fitzmaurice, G, Kurtenbach, G., Khan A., and Buxton, B. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. Proc. UIST '02, 111--120.
17. Yee, K-P. Peephole displays: pen interaction on spatially aware handheld computers. Proc. CHI '03, 1--8.
18. Yokokohji, Y., Hollis, R. L., and Kanade, T. What you can see is what you can feel Development of a visual/haptic interface to virtual environment. Proc. VRAIS '96, 46--53.

Index Terms

• Computing methodologies

  • Computer graphics

• Human-centered computing

  • Human computer interaction (HCI)