AudioCubes: a distributed cube tangible interface based on interaction range for sound design

ABSTRACT

AudioCubes is a novel tangible user interface allowing any person interested by sound design such as sound creators, and music trainers to intuitively explore and create dynamically changing sound. A new sound is created by manipulating distributed cube tangible user interface that can be coupled wirelessly by locating them in the interaction range of each other on a table. At any time, a sound processing network combines operational properties of AudioCubes, such as location on a plane or in space, movement, arrangement with other cubes, and layout. Sound algorithm parameters and the configuration of the sound processing network can be changed simultaneously, allowing a fast and convenient exploration of sound creation space that creates a new interaction technique for creating sounds.

REFERENCES

• 1: Arfib Daniel , Dudon Jacques, A digital emulator of the photosonic instrument, Proceedings of the 2002 conference on New interfaces for musical expression, May 24-26, 2002, Dublin, Ireland
• 2: Bérard, F. Vision par ordinateur pour l'interaction homme-machine fortement couplée. PhD thesis, Grenoble (1999).
• 3: Rodney Berry , Mao Makino , Naoto Hikawa , Masumi Suzuki, The Augmented Composer Project: The Music Table, Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, p.338, October 07-10, 2003
• 4: Coutaz, J. and Rey, G Foundations for a Theory of Contextors. Proc. of CADUI'2002, Kluwer, Drodrecht (2002), 13--34.
• 5: Joëlle Coutaz , Stanislaw Borkowski , Nicolas Barralon, Coupling interaction resources: an analytical model, Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies, October 12-14, 2005, Grenoble, France [doi>10.1145/1107548.1107596]
• 6: Kenneth P. Fishkin, A taxonomy for and analysis of tangible interfaces, Personal and Ubiquitous Computing, v.8 n.5, p.347-358, September 2004 [doi>10.1007/s00779-004-0297-4]
• 7: Andy Hunt , Marcelo M. Wanderley , Matthew Paradis, The importance of parameter mapping in electronic instrument design, Proceedings of the 2002 conference on New interfaces for musical expression, May 24-26, 2002, Dublin, Ireland
• 8: Elliot Jaffe , Aviva Dayan , Amnon Dekel, Cube management system: a tangible interface for monitoring large scale systems, Proceedings of the 2007 symposium on Computer human interaction for the management of information technology, March 30-31, 2007, Cambridge, Massachusetts [doi>10.1145/1234772.1234778]
• 9: Sergi Jordà , Günter Geiger , Marcos Alonso , Martin Kaltenbrunner, The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226998]
• 10: Kranz, M., Schmidt, D., Holleis, P., and Schmidt, A. A Display Cube as a Tangible User Interface. Adj. Proc. of Ubi-Comp'2005, Springer, Berlin (2005).
• 11: Nicolai Marquardt , Saul Greenberg, Distributed physical interfaces with shared phidgets, Proceedings of the 1st international conference on Tangible and embedded interaction, February 15-17, 2007, Baton Rouge, Louisiana [doi>10.1145/1226969.1226973]
• 12: Henry Newton-Dunn , Hiroaki Nakano , James Gibson, Block jam: a tangible interface for interactive music, Proceedings of the 2003 conference on New interfaces for musical expression, May 22-24, 2003, Montreal, Quebec, Canada
• 13: Joseph A. Paradiso , Kai-yuh Hsiao , Ari Benbasat, Tangible music interfaces using passive magnetic tags, Proceedings of the 2001 conference on New interfaces for musical expression, April 01-02, 2001, Seattle, Washington
• 14: James Patten , Hiroshi Ishii, A comparison of spatial organization strategies in graphical and tangible user interfaces, Proceedings of DARE 2000 on Designing augmented reality environments, p.41-50, April 2000, Elsinore, Denmark [doi>10.1145/354666.354671]
• 15: Poupyrev, I., Berry, R., Kurumisawa, J., Billinghurst, M., Airola, C., and Kato, H. Augmented Groove: Collaborative Jamming in Augmented Reality. Proc. of Conference Abstracts and Applications, ACM Press, New York (2000), 77.
• 16: Jun Rekimoto , Brygg Ullmer , Haruo Oba, DataTiles: a modular platform for mixed physical and graphical interactions, Proceedings of the SIGCHI conference on Human factors in computing systems, p.269-276, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365115]
• 17: Ronveaux, A. and Saint Aubin, Y. Harmonic polynomials invariant under a finite subgroup of O(n), Journal of Mathematical Physics 24, 5 (1983), 1037--1040.
• 18: Salem, B. and Peeters, H. InterCUBE: A study into merging action and interaction spaces. Proc. of Interact'2007, 57--70.
• 19: Ehud Sharlin , Yuichi Itoh , Benjamin Watson , Yoshifumi Kitamura , Steve Sutphen , Lili Liu, Cognitive cubes: a tangible user interface for cognitive assessment, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA [doi>10.1145/503376.503438]
• 20: Sheridan, J., Short, B., Van Laerhoven, K., Villar, N., and Kortuem, G. Exploring Cube Affordances: Towards A Classification of Non-Verbal Dynamics of Physical Interfaces for Wearable Computing. Proc. of IEE Eurowearable'2003.
• 21: Song, H., Guimbretière, F., Ambrose, M. A., and Lostritto, C. CubeExplorer: An Evaluation of Interaction Techniques in Architectural Education. Proc. of Interact'2007, 43--56.
• 22: Hideyuki Suzuki , Hiroshi Kato, Interaction-level support for collaborative learning: AlgoBlock—an open programming language, The first international conference on Computer support for collaborative learning, p.349-355, October 1995, Indiana Univ., Bloomington, Indiana, United States
• 23: Lucia Terrenghi , Matthias Kranz , Paul Holleis , Albrecht Schmidt, A cube to learn: a tangible user interface for the design of a learning appliance, Personal and Ubiquitous Computing, v.10 n.2-3, p.153-158, January 2006 [doi>10.1007/s00779-005-0025-8]
• 24: Brygg Ullmer , Hiroshi Ishii , Dylan Glas, mediaBlocks: physical containers, transports, and controls for online media, Proceedings of the 25th annual conference on Computer graphics and interactive techniques, p.379-386, July 1998 [doi>10.1145/280814.280940]
• 25: B. Ullmer , H. Ishii, Emerging frameworks for tangible user interfaces, IBM Systems Journal, v.39 n.3-4, p.915-931, July 2000
• 26: Brygg Ullmer , Hiroshi Ishii , Robert J. K. Jacob, Token+constraint systems for tangible interaction with digital information, ACM Transactions on Computer-Human Interaction (TOCHI), v.12 n.1, p.81-118, March 2005 [doi>10.1145/1057237.1057242]
• 27: Kristof Van Laerhoven , Nicolas Villar , Albrecht Schmidt , Gerd Kortuem , Hans Gellersen, Using an autonomous cube for basic navigation and input, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada [doi>10.1145/958432.958472]
• 28: Ryoichi Watanabe , Yuichi Itoh , Masatsugu Asai , Yoshifumi Kitamura , Fumio Kishino , Hideo Kikuchi, The soul of ActiveCube: implementing a flexible, multimodal, three-dimensional spatial tangible interface, Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology, p.173-180, June 03-05, 2005, Singapore [doi>10.1145/1067343.1067364]
• 29: ZhiYing Zhou , Adrian David Cheok , JiunHorng Pan, 3D story cube: an interactive tangible user interface for storytelling with 3D graphics and audio, Personal and Ubiquitous Computing, v.8 n.5, p.374-376, September 2004 [doi>10.1007/s00779-004-0300-0]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Audio input/output

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Interaction styles (e.g., commands, menus, forms, direct manipulation); Prototyping; User-centered design; Input devices and strategies (e.g., mouse, touchscreen)
      H.5.5 Sound and Music Computing
          Subjects: Signal analysis, synthesis, and processing

  J. Computer Applications
  J.5 ARTS AND HUMANITIES

Keywords:
contextor, interaction range, interface coupling, sound design, tangible user interface