ABSTRACT
This article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, which has been primarily designed as an abstraction layer for the description and transmission of pointers and tangible object states in the context of interactive tabletop surfaces. The initial protocol definition proved to be rather robust due to the simple and straightforward implementation approach, which also supported its widespread adoption within the open source community. This article also discusses the current limitations of this simplistic approach and provides an outlook towards a next generation protocol definition, which will address the need for additional descriptors and the protocol's general extensibility.
- S. Jordà, M. Kaltenbrunner, G. Geiger, and R. Bencina, "The reacTable," Proceedings of the International Computer Music Conference, 2005.Google Scholar
- J. Y. Han, "Multi-touch sensing through frustrated total internal reflection," SIGGRAPH 2005 Sketches, 2005. Google ScholarDigital Library
- M. Kaltenbrunner, T. Bovermann, R. Bencina, and E. Costanza, "TUIO - A Protocol for Table Based Tangible User Interfaces," in GW '05: Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation, 2005.Google Scholar
- G. Reitmayr and D. Schmalstieg, "An open software architecture for virtual reality interaction," VRST '01: Proceedings of the ACM symposium on Virtual reality software and technology, 2001. Google ScholarDigital Library
- M. Wright, A. Freed, and A. Momeni, "OpenSound Control: state of the art 2003," NIME '03: Proceedings of the 3rd conference on New interfaces for Musical Expression, 2003. Google ScholarDigital Library
- M. Kaltenbrunner and R. Bencina, "reacTIVision: a computer-vision framework for table-based tangible interaction," TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction, 2007. Google ScholarDigital Library
- E. Costanza and J. A. Robinson, "A region adjacency tree approach to the detection and design of fiducials," Vision, Video and Graphics (VVG), pp. 63--70, 2003.Google Scholar
- R. Bencina, M. Kaltenbrunner, and S. Jorda, "Improved Topological Fiducial Tracking in the reacTIVision System," Proceedings of the IEEE International Workshop on Projector-Camera Systems, 2005.Google Scholar
- R. Bencina and M. Kaltenbrunner, "The Design and Evolution of Fiducials for the reacTIVision System," in Proceedings of the 3rd International Conference on Generative Systems in the Electronic Arts, 2005.Google Scholar
- R. E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Transactions of the ASME--Journal of Basic Engineering, pp. 35--45, 1960.Google Scholar
- J. Bernsen, "Dynamic thresholding of grey-level images," Proceedings of the 8th International Conference on Pattern Recognition, pp. 1251--1255, 1986.Google Scholar
- A. Freed and A. Schneider, "Features and Future of Open Sound Control version 1.1 for NIME," NIME '09: Proceedings of the 9th Conference on New Interfaces for Musical Expression, 2009.Google Scholar
- W. A. König, R. Rädle, and H. Reiterer, "Squidy: a zoomable design environment for natural user interfaces," CHI EA '09: Proceedings of the 27th international conference on Human factors in computing systems, 2009. Google ScholarDigital Library
- P. Hutterer and B. Thomas, "Groupware support in the windowing system," AUIC '07: Proceedings of the eight Australasian conference on User interface, 2007. Google ScholarDigital Library
Index Terms
- reacTIVision and TUIO: a tangible tabletop toolkit
Recommendations
reacTIVision: a computer-vision framework for table-based tangible interaction
TEI '07: Proceedings of the 1st international conference on Tangible and embedded interactionThis article provides an introductory overview to first-time users of the reacTIVision framework -- an open-source cross-platform computer-vision framework primarily designed for the construction of table-based tangible user interfaces. The central ...
T4 - transparent and translucent tangibles on tabletops
AVI '14: Proceedings of the 2014 International Working Conference on Advanced Visual InterfacesIn many cases, Tangible User Interfaces allow the manipulation of digital content with physical objects recognized by an interactive tabletop. Usually, such tangible objects are made of opaque wood or synthetic materials, thereby occluding the display. ...
TUIO Hackathon
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and SurfacesTUIO is an open framework that defines a common protocol and API for tangible- and multitouch-surfaces. The protocol is based on Open Sound Control and allows the platform-independent encoding and transmission of an abstract description of interactive ...
Comments