skip to main content
10.1145/3294109.3295643acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article
Open access

A Conversation with Actuators: An Exploratory Design Environment for Hybrid Materials

Published: 17 March 2019 Publication History

Abstract

An exciting, expanding palette of hybrid materials is emerging that can be programmed to actuate by a range of external and internal stimuli. However, there exists a dichotomy between the physicality of the actuators and the intangible computational signal that is used to program them. For material practitioners, this lack of physical cues limits their ability to engage in a "conversation with materials" (CwM). This paper presents a creative workstation for supporting this epistemological style by bringing a stronger physicality to the computational signal and balance the conversation between physical and digital actors. The station utilizes a streaming architecture to distribute control across multiple devices and leverage the rich spatial cognition that a physical space affords. Through a formal user study, we characterize the actuation design practice supported by the CwM workstation and discuss opportunities for tangible interfaces to hybrid materials.

Supplementary Material

suppl.mov (teifp1109.mp4)
Supplemental video

References

[1]
2003. Light-O-Rama. (2003). http://www1.lightorama.com/
[2]
2010. Finale Fireworks. (2010). http://www.finalefireworks.com/
[3]
Sylvan Barnet. 2011. A short guide to writing about art. Pearson/Prentice Hall.
[4]
Glenn Blauvelt, Tom Wrensch, and Michael Eisenberg. 1999. Integrating Craft Materials and Computation . In Proceedings of the 3rd Conference on Creativity & Cognition (C&C '99). ACM, New York, NY, USA, 50--56.
[5]
Tracey Booth, Simone Stumpf, Jon Bird, and Sara Jones. 2016. Crossed Wires: Investigating the Problems of End-User Developers in a Physical Computing Task. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3485--3497.
[6]
Matthew Chalmers, Ian MacColl, and Marek Bell. 2003. Seamful design: Showing the seams in wearable computing. (2003).
[7]
Karen Collins. 2007. In the Loop: Creativity and Constraint in 8-bit Video Game Audio . Twentieth-Century Music 4, 2 (Sept. 2007), 209--227.
[8]
Tejaswi Digumarti, Javier Alonso-Mora, Roland Siegwart, and Paul Beardsley. 2016. Pixelbots 2014. In ACM SIGGRAPH 2016 Art Gallery (SIGGRAPH '16). ACM, New York, NY, USA, 366--367.
[9]
W Keith Edwards and Rebecca E Grinter. 2001. At home with ubiquitous computing: Seven challenges. In International conference on ubiquitous computing. Springer, 256--272.
[10]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 417--426.
[11]
Verena Fuchsberger, Martin Murer, and Manfred Tscheligi. 2013. Materials, Materiality, and Media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2853--2862.
[12]
Elisa Giaccardi and Elvin Karana. 2015. Foundations of materials experience: An approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2447--2456.
[13]
Björn Hartmann, Scott Doorley, and Scott R. Klemmer. 2008. Hacking, Mashing, Gluing: Understanding Opportunistic Design . IEEE Pervasive Computing 7, 3 (July 2008), 46--54.
[14]
Björn Hartmann, Scott R. Klemmer, Michael Bernstein, Leith Abdulla, Brandon Burr, Avi Robinson-Mosher, and Jennifer Gee. 2006. Reflective Physical Prototyping Through Integrated Design, Test, and Analysis. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 299--308.
[15]
N. Katherine Hayles. 2004. Print Is Flat, Code Is Deep: The Importance of Media-Specific Analysis . Poetics Today 25, 1 (March 2004), 67--90.
[16]
Kelly Bowman Heaton. 2000. Physical pixels. Ph.D. Dissertation. Massachusetts Institute of Technology. http://xenia.media.mit.edu/ kelly/physPix/heatonThesis.pdf
[17]
Pat Hutchings. 2005. Aesthetic Literacy Across The Curriculum: A Conversation. Published by The Carnegie Foundation for the Advancement of Teaching. https://www.researchgate.net/profile/Nader_Aghakhani/post/Is_there_any_study_on_aesthetic_literacy_in_Adult_Education/
[18]
Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems. 234--241. http://dl.acm.org/citation.cfm?id=258715
[19]
Yuichi Ito, Carl Stone, Masashi Yamada, and Shinya Miyazaki. 2014. Datamoshing Technique for Video Art Production . The journal of the Society For Art and Science 13, 3 (2014), 154--168. http://art-science.org/journal/v13n3/v13n3pp154/artsci-v13n3pp154.pdf
[20]
Malte F. Jung, Nik Martelaro, Halsey Hoster, and Clifford Nass. 2014. Participatory Materials: Having a Reflective Conversation with an Artifact in the Making. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 25--34.
[21]
Maximos A. Kaliakatsos--Papakostas, Michael G. Epitropakis, Andreas Floros, and Michael N. Vrahatis. 2012. Interactive Evolution of 8--bit melodies with Genetic Programming towards finding aesthetic measures for sound. In Evolutionary and Biologically Inspired Music, Sound, Art and Design. Springer, 141--152. http://link.springer.com/chapter/10.1007/978--3--642--29142--5_13
[22]
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, and George Fitzmaurice. 2014a. Kitty: Sketching Dynamic and Interactive Illustrations. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 395--405.
[23]
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George Fitzmaurice. 2014b. Draco: Bringing Life to Illustrations with Kinetic Textures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 351--360.
[24]
Han-Jong Kim, Yunwoo Jeong, Ju-Whan Kim, and Tek-Jin Nam. 2016. M.Sketch: Prototyping Tool for Linkage-Based Mechanism Design. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 75--77.
[25]
Brian Knep. 2017. Brian Knep :: Healing Pool. (2017). http://www.blep.com/works/healing-series/healing-pool/
[26]
Jarrod Knibbe, Tovi Grossman, and George Fitzmaurice. 2015. Smart makerspace: An immersive instructional space for physical tasks. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces. ACM, 83--92.
[27]
Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 97--109.
[28]
Szu-Yu Liu, Tung-Jen Tsai, and Daniel Alenquer. 2016. Exploring Computational Composite: An Approach To Sensorial Interaction. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW '16 Companion). ACM, New York, NY, USA, 337--340.
[29]
Lev Manovich. 1999. Database as Symbolic Form . Convergence 5, 2 (June 1999), 80--99.
[30]
Marshall McLuhan. 1994. Understanding media: The extensions of man. MIT press.
[31]
Rosa Menkman. 2011. Glitch studies manifesto. Video vortex reader II: Moving images beyond YouTube (2011), 336--347.
[32]
Marjorie Munsterberg. 2009. Writing about art. http://writingaboutart.org/pages/formalanalysis.html
[33]
Michael Nitsche, Andrew Quitmeyer, Kate Farina, Samuel Zwaan, and Hye Yeon Nam. 2014. Teaching Digital Craft. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 719--730.
[34]
William Odom, Richard Banks, David Kirk, Richard Harper, Siân Lindley, and Abigail Sellen. 2012a. Technology Heirlooms?: Considerations for Passing Down and Inheriting Digital Materials. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 337--346.
[35]
William Odom, Mark Selby, Abigail Sellen, David Kirk, Richard Banks, and Tim Regan. 2012b. Photobox: On the Design of a Slow Technology. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 665--668.
[36]
Pablo Paredes, Ryuka Ko, Eduardo Calle-Ortiz, John Canny, Björn Hartmann, and Greg Niemeyer. 2016. Fiat-Lux: Interactive Urban Lights for Combining Positive Emotion and Efficiency. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 785--795.
[37]
Irene Posch and Geraldine Fitzpatrick. 2018. Integrating Textile Materials with Electronic Making: Creating New Tools and Practices. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 158--165.
[38]
M Puckette and D Zicarelli. 1990. Max MSP software. (1990).
[39]
Isabel P. S. Qamar, Rainer Groh, David Holman, and Anne Roudaut. 2018. HCI Meets Material Science: A Literature Review of Morphing Materials for the Design of Shape-Changing Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 374, 23 pages.
[40]
Hayes Raffle. 2010. Topobo: Programming by Example to Create Complex Behaviors. In Proceedings of the 9th International Conference of the Learning Sciences - Volume 2 (ICLS '10). International Society of the Learning Sciences, Chicago, Illinois, 126--127. http://dl.acm.org/citation.cfm?id=1854509.1854565
[41]
Daniela K. Rosner. 2012. The Material Practices of Collaboration. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 1155--1164.
[42]
Markus Lorenz Schilling, Ron Wakkary, and William Odom. 2018. Focus Framework: Tracking Prototypes' Back-Talk. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 684--693.
[43]
Oliver S. Schneider, Ali Israr, and Karon E. MacLean. 2015. Tactile Animation by Direct Manipulation of Grid Displays. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 21--30.
[44]
Donald Schon. 1983. The reflective practitioner. (1983).
[45]
Julia Schwarz, David Klionsky, Chris Harrison, Paul Dietz, and Andrew Wilson. 2012. Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems. ACM, 2235--2238. http://dl.acm.org/citation.cfm?id=2208378
[46]
Scott Snibbe. 2005. Central Mosaic. (2005). https://www.snibbe.com/digital-art/
[47]
Cesar Torres, Jasper O'Leary, Molly Nicholas, and Eric Paulos. 2017. Illumination Aesthetics: Light As a Creative Material Within Computational Design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6111--6122.
[48]
Cesar Torres, Sarah Sterman, Molly Nicholas, Richard Lin, Eric Pai, and Eric Paulos. 2018. Guardians of Practice: A Contextual Inquiry of Failure-Mitigation Strategies Within Creative Practices. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, New York, NY, USA, 1259--1267.
[49]
Camille Utterback. 2000. Liquid Time Series. (2000). http://camilleutterback.com/projects/liquid-time-series/
[50]
Anna Vallgrarda, Laurens Boer, Vasiliki Tsaknaki, and Dag Svanaes. 2016. Material Programming: A New Interaction Design Practice. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems (DIS '16 Companion). ACM, New York, NY, USA, 149--152.
[51]
Anna Vallgrarda and Johan Redström. 2007. Computational Composites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 513--522.
[52]
Lisa K Wells and Jeffrey Travis. 1996. LabVIEW for everyone: graphical programming made even easier. Prentice-Hall, Inc.
[53]
Terry Winograd. 1996. Reflective conversation with materials an interview with Donald Schön by John Bennett. Bringing Design to Software (1st ed.) Harlow: Addison Wesley (1996), 171--189.

Cited By

View all
  • (2024)Clothing suggestions based on comfort extracted from physiological and emotional parametersInternational Journal of Clothing Science and Technology10.1108/IJCST-10-2022-0141Online publication date: 4-Jul-2024
  • (2023)Thermoplastic Kilnforms: Extending Glass Kilnforming Techniques to Thermoplastic Materials using Ontology-Driven DesignProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596027(263-281)Online publication date: 10-Jul-2023
  • (2021)Compressables: A Haptic Prototyping Toolkit for Wearable Compression-based InterfacesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462057(1101-1114)Online publication date: 28-Jun-2021
  • Show More Cited By

Index Terms

  1. A Conversation with Actuators: An Exploratory Design Environment for Hybrid Materials

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      TEI '19: Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction
      March 2019
      785 pages
      ISBN:9781450361965
      DOI:10.1145/3294109
      This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 17 March 2019

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. computational design
      2. creativity support tools
      3. new media

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      TEI '19
      Sponsor:

      Acceptance Rates

      TEI '19 Paper Acceptance Rate 36 of 110 submissions, 33%;
      Overall Acceptance Rate 393 of 1,367 submissions, 29%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)103
      • Downloads (Last 6 weeks)11
      Reflects downloads up to 02 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Clothing suggestions based on comfort extracted from physiological and emotional parametersInternational Journal of Clothing Science and Technology10.1108/IJCST-10-2022-0141Online publication date: 4-Jul-2024
      • (2023)Thermoplastic Kilnforms: Extending Glass Kilnforming Techniques to Thermoplastic Materials using Ontology-Driven DesignProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596027(263-281)Online publication date: 10-Jul-2023
      • (2021)Compressables: A Haptic Prototyping Toolkit for Wearable Compression-based InterfacesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462057(1101-1114)Online publication date: 28-Jun-2021
      • (2019)ClothSurface: Exploring a Low-Cost Prototyping Tool to Support Ideation for Shape DisplaysMultimodal Technologies and Interaction10.3390/mti30300643:3(64)Online publication date: 19-Sep-2019

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media