reacTIVision and TUIO: a tangible tabletop toolkit

ABSTRACT

This article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, which has been primarily designed as an abstraction layer for the description and transmission of pointers and tangible object states in the context of interactive tabletop surfaces. The initial protocol definition proved to be rather robust due to the simple and straightforward implementation approach, which also supported its widespread adoption within the open source community. This article also discusses the current limitations of this simplistic approach and provides an outlook towards a next generation protocol definition, which will address the need for additional descriptors and the protocol's general extensibility.

References

1. S. Jordà, M. Kaltenbrunner, G. Geiger, and R. Bencina, "The reacTable," Proceedings of the International Computer Music Conference, 2005.
2. J. Y. Han, "Multi-touch sensing through frustrated total internal reflection," SIGGRAPH 2005 Sketches, 2005.
3. M. Kaltenbrunner, T. Bovermann, R. Bencina, and E. Costanza, "TUIO - A Protocol for Table Based Tangible User Interfaces," in GW '05: Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation, 2005.
4. G. Reitmayr and D. Schmalstieg, "An open software architecture for virtual reality interaction," VRST '01: Proceedings of the ACM symposium on Virtual reality software and technology, 2001.
5. M. Wright, A. Freed, and A. Momeni, "OpenSound Control: state of the art 2003," NIME '03: Proceedings of the 3rd conference on New interfaces for Musical Expression, 2003.
6. M. Kaltenbrunner and R. Bencina, "reacTIVision: a computer-vision framework for table-based tangible interaction," TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, 2007.
7. E. Costanza and J. A. Robinson, "A region adjacency tree approach to the detection and design of fiducials," Vision, Video and Graphics (VVG), pp. 63--70, 2003.
8. R. Bencina, M. Kaltenbrunner, and S. Jorda, "Improved Topological Fiducial Tracking in the reacTIVision System," Proceedings of the IEEE International Workshop on Projector-Camera Systems, 2005.
9. R. Bencina and M. Kaltenbrunner, "The Design and Evolution of Fiducials for the reacTIVision System," in Proceedings of the 3rd International Conference on Generative Systems in the Electronic Arts, 2005.
10. R. E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Transactions of the ASME--Journal of Basic Engineering, pp. 35--45, 1960.
11. J. Bernsen, "Dynamic thresholding of grey-level images," Proceedings of the 8th International Conference on Pattern Recognition, pp. 1251--1255, 1986.
12. A. Freed and A. Schneider, "Features and Future of Open Sound Control version 1.1 for NIME," NIME '09: Proceedings of the 9th Conference on New Interfaces for Musical Expression, 2009.
13. W. A. König, R. Rädle, and H. Reiterer, "Squidy: a zoomable design environment for natural user interfaces," CHI EA '09: Proceedings of the 27th international conference on Human factors in computing systems, 2009.
14. P. Hutterer and B. Thomas, "Groupware support in the windowing system," AUIC '07: Proceedings of the eight Australasian conference on User interface, 2007.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)