Sphere: multi-touch interactions on a spherical display

ABSTRACT

Sphere is a multi-user, multi-touch-sensitive spherical display in which an infrared camera used for touch sensing shares the same optical path with the projector used for the display. This novel configuration permits: (1) the enclosure of both the projection and the sensing mechanism in the base of the device, and (2) easy 360-degree access for multiple users, with a high degree of interactivity without shadowing or occlusion. In addition to the hardware and software solution, we present a set of multi-touch interaction techniques and interface concepts that facilitate collaborative interactions around Sphere. We designed four spherical application concepts and report on several important observations of collaborative activity from our initial Sphere installation in three high-traffic locations.

References

1. Bowman, D. A., Kruijff, E., LaViola, J. J., and Poupyrev, I. (2004). 3D User Interfaces: Theory and Practice. Addison-Wesley, Boston.
2. Companje, R., van Dijk, N., Hogenbirk, H. and Mast, D. (2007). Globe4D, Time-Traveling with an Interactive Four-Dimensional Globe. ACM MULTIMEDIA. p. 959--960.
3. Chan, L.-W., Chuang, Y.-F., Yu, M.-C., Chao, Y.-L., Lee, M.-S., Hung, Y.-P. and Hsu, J. (2007). Gesture-based Interaction for a Magic Crystal Ball. ACM VRST Virtual Reality Software and Technology. p. 157--164.
4. Chen, Y., Au, J., Kazlas, P., Ritenour, A., Gates, H. and McCreary, M. (2003). Flexible Active-Matrix Electronic Ink Display. Nature. 423. p. 136.
5. Dietz, P. and Leigh, D. (2001). DiamondTouch: A Multi-User Touch Technology. ACM UIST. p. 219--226.
6. Fitzmaurice, G., Khan, A., Buxton, W., Kurtenbach, G., and Balakrishnan, R. (2003). Sentient data access via a diverse society of devices. ACM Queue. p. 53--62.
7. Grossman, T., Wigdor, D. and Balakrishnan, R. (2004). Multi-Finger Gestural Interaction with 3D Volumetric Displays. ACM UIST. p. 61--70.
8. Grossman, T. and Balakrishnan, R. (2006). The design and evaluation of selection techniques for 3D volumetric displays. ACM UIST. p. 3--12.
9. Han, J. (2005). Low-cost multi-touch sensing through frustrated total internal reflection. ACM UIST. p. 115--118.
10. Kettner, S., Madden, C. and Ziegler, R. (2004). Direct Rotational Interaction with a Spherical Projection. Creativity & Cognition Symposium on Interaction: Systems, Practice and Theory.
11. Kruger, R., Carpendale, S., Scott, S. and Greenberg, S. (2003). How People Use Orientation on Tables: Comprehension, Coordination and Communication. ACM SIGGROUP Conference on Supporting Group Work. p. 369--378.
12. Liang, J. and Green, M. (2004). JDCAD: A Highly Interactive 3D Modeling System. Computers and Graphics. 18(4). p. 499--506.
13. Magic Planet by Global Imagination. www.globalimagination.com.
14. Marchese, F. and Rose, J. (2006). Projected Hemispherical Display with a Gestural Interface. ACM SIGGRAPH Research Posters.
15. Matsushita, N. and Rekimoto, J. (1997). HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. ACM UIST. p. 209--210.
16. Morris, M., Ryall, K., Shen, C., Forlines, C. and Vernier, F. (2004). Beyond "Social Protocols": Multi-User Coordination Policies for Co--located Groupware. ACM CSCW. p. 262--265.
17. OmniGlobe by ARC Science Simulations. www.arcscience.com.
18. PufferSphere by Pufferfish. www.pufferfishdisplays.co.uk.
19. Rekimoto, J. (2002). SmartSkin: An Infrastructure for Free-hand Manipulation on Interactive Surfaces. ACM CHI. p. 113--120.
20. Scott, S., Sheelagh, M., Carpandale, T. and Inkpen, K. (2004). Territoriality in Collaborative Tabletop Work-spaces. ACM CSCW. p. 294--303.
21. Shen, C., Vernier, F., Forlines, C. and Ringel, M. (2004). DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. ACM CHI. p. 167--174.
22. Shoemake, K. (1985). Animating Rotation with Quaternion Curves. ACM SIGGRAPH. p. 245--253.
23. Shoemake, K. (1992). ARCBALL: A User Interface for Specifying Three-Dimensional Orientation Using a Mouse. Graphics Interface. p. 151--156.
24. Ushida, K., Harashima, H., and Ishikawa, J. (2003). i-ball2: An Interaction Platform with a Crystal-ball-like Display for Multiple Users. International Conference on Artificial Reality and Teleexistence.
25. Wilson, A. (2004). TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction. ICMI Conference on Multimodal Interfaces. p. 69--76.
26. Wilson, A. (2005). PlayAnywhere: A Compact Tabletop Computer Vision System. ACM UIST. p. 83--92.
27. Wu, M. and Balakrishnan, R. (2003). Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. ACM UIST. p. 193--202.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms

      • Graphical user interfaces