Daniel Bisig
ABSTRACT
Complex systems abound in nature and are becoming increasingly important in artificial systems. The understanding and controlling of such systems is a major challenge. This paper tries to take a fresh approach to these issues by describing an interactive art project that involves cross-modal interaction with a complex system. By combining sound and vision, the temporal and spatial dynamics of the system are conveyed simultaneously. Users can influence its dynamics in real time by using acoustics. Preliminary experiments with this system show that the combination of sound and vision can help users to obtain an intuitive understanding of the system's behavior. In addition, usability profits from the fact that the same modality is employed for both interaction and feedback.
- SONY, "Lemmings", 1998, http://www.us.playstation.com/games/slus-00760.aspGoogle Scholar
- Electronic Arts, "SimCity 4", 2003, http://simcity.ea.comGoogle Scholar
- Massive Limited, "MASSIVE", 2002, http://www.massivesoftware.comGoogle Scholar
- Fleischer, K. The Biological Simulator Behind "Cellular Texture Generation". Siggraph Course Notes, 1997.Google Scholar
- Milicevic, M. The Impact of Fractals, Chaos and Complexity on Computer Music Composition. In Proceedings International Computer Music Association (San Francisco, 1996), 473--476.Google Scholar
- Sommerer, C., and Mignonneau, L. A-Volve, 1994.Google Scholar
- Sommerer, C., and Mignonneau, L. Phototropy, 1995.Google Scholar
- Sommerer, C., and Mignonneau, L. Life Spacies I & II, 1999. Google ScholarDigital Library
- Sommerer, C., and Mignonneau, L. PICO_SCAN, 2000.Google Scholar
- Plancton Art Studio, Relationi Emergenti, 2000.Google Scholar
- Rinaldo, K., Autopoiesis, 2001.Google Scholar
- Sommerer, C., and Mignonneau, L. Modeling Complex Systems for Interactive Art. In Applied Complexity - From Neural Nets to Managed Landscapes (Institute for Crop & Food Research, Christchurch, New Zealand, 2000), 25--38.Google Scholar
- Turing, A. The Chemical Basis of Morphogenesis. Philosophical Transactions of the Royal Society (London, 1952), 237, 37--72.Google Scholar
- Dittrich, P., Ziegler, J., and Banzhaf, W. Artificial Chemistries A Review. Artificial Life, 2001, 7(3), 225--275. Google ScholarDigital Library
- Shneiderman B., Direct Manipulation for Comprehensible, Predictable and Controllable User Interfaces. In Proceedings of International Conference on Intelligent User Interfaces (Orlando, FL. 1997). Google ScholarDigital Library
- Waibel, A., Vo, M. T., Duchnowski, P., and Manke, S. Multimodal interfaces. Artificial Intelligence Review, Special Volume on Integration of Natural Language and Vision Processing, 1995, 10(3-4), 299--319. Google ScholarDigital Library
- Mulder, J., van Wijk, J., and van Liere, R. A Survey of Computational Steering Environments. Future Generation Computer Systems, 1999, 15(2), 91--102. Google ScholarDigital Library
- Bernstein, L. and Benoit, C. For Speech Perception By Humans or Machines, Three Senses Are Better Than One. In Proceedings of the International Conference on Spoken Language Processing, 1996, 3, 1477--1480.Google Scholar
Index Terms
- BioSonics: sensual explorations of a complex system
Recommendations
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineMulti-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Exploring and Understanding Unintended Touch during Direct Pen Interaction
The user experience on tablets that support both touch and styli is less than ideal, due in large part to the problem of unintended touch or palm rejection. Devices are often unable to distinguish between intended touch (i.e., interaction on the screen ...
Non-Visual Menu Navigation: the Effect of an Audio-Tactile Display
BCS-HCI '14: Proceedings of the 28th International BCS Human Computer Interaction Conference on HCI 2014 - Sand, Sea and Sky - Holiday HCIWe present a preliminary study examining non-visual menu navigation in terms of task completion times and cognitive workload. We asked 12 participants to locate items on menus presented using visual, audio-only and audio-tactile displays on a touch ...
Comments