JDLED: Towards Visio-Tactile Displays Based on Electrochemical Locomotion of Liquid-Metal Janus Droplets

ABSTRACT

An actuated shape-changing interface with faster response and smaller pixel size using a liquid material can provide real time tangible interaction with the digital world in physical space. To this end, we demonstrate an interface that displays user-defined patterns dynamically using liquid metal droplets as programmable micro robots on a flat surface. We built a prototype using an array of embedded electrodes and a switching circuit to control the jump of the droplets from electrode to electrode. The actuation and dynamics of the droplets under the finger provides mild tactile feedback to the user. Our demo is the first to show a planar visio-tactile display using liquid metal, and is a first step to make shape-changing physical ephemeral widgets on a tabletop interface.

References

1. Choi, K., Ng, A. H., Fobel, R., and Wheeler, A. R. Digital microfluidics. Annual Review of Analytical Chemistry 5, 1 (2012), 413--440. PMID: 22524226.
2. Coelho, M., Ishii, H., and Maes, P. Surflex: A programmable surface for the design of tangible interfaces. In CHI '08 Extended Abstracts on Human Factors in Computing Systems, CHI EA '08, ACM (New York, NY, USA, 2008), 3429--3434.
3. Follmer, S., Leithinger, D., Olwal, A., Hogge, A., and Ishii, H. inform: Dynamic physical affordances and constraints through shape and object actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST '13, ACM (New York, NY, USA, 2013), 417--426.
4. Hardy, J., Weichel, C., Taher, F., Vidler, J., and Alexander, J. Shapeclip: Towards rapid prototyping with shape-changing displays for designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 19--28.
5. Harrison, C., and Hudson, S. E. Providing dynamically changeable physical buttons on a visual display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '09, ACM (New York, NY, USA, 2009), 299--308.
6. Hook, J., Taylor, S., Butler, A., Villar, N., and Izadi, S. A reconfigurable ferromagnetic input device. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology, UIST '09, ACM (New York, NY, USA, 2009), 51--54.
7. Ishii, H., Lakatos, D., Bonanni, L., and Labrune, J.-B. Radical atoms: Beyond tangible bits, toward transformable materials. interactions 19, 1 (Jan. 2012), 38--51.
8. Jansen, Y. Mudpad: Fluid haptics for multitouch surfaces. In CHI '10 Extended Abstracts on Human Factors in Computing Systems, CHI EA '10, ACM (New York, NY, USA, 2010), 4351--4356.
9. Leithinger, D., and Ishii, H. Relief: A scalable actuated shape display. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '10, ACM (New York, NY, USA, 2010), 221--222.
10. Loget, G., Zigah, D., Bouffier, L., Sojic, N., and Kuhn, A. Bipolar electrochemistry: From materials science to motion and beyond. Accounts of Chemical Research 46, 11 (2013), 2513--2523. PMID: 23719628.
11. Lu, Q., Mao, C., Wang, L., and Mi, H. Lime: Liquid metal interfaces for non-rigid interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST '16, ACM (New York, NY, USA, 2016), 449--452.
12. Ochiai, Y., Hoshi, T., and Rekimoto, J. Pixie dust: Graphics generated by levitated and animated objects in computational acoustic-potential field. ACM Trans. Graph. 33, 4 (July 2014), 85:1--85:13.
13. Ogata, M., and Fukumoto, M. Fluxpaper: Reinventing paper with dynamic actuation powered by magnetic flux. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, ACM (New York, NY, USA, 2015), 29--38.
14. Robinson, S., Coutrix, C., Pearson, J., Rosso, J., Torquato, M. F., Nigay, L., and Jones, M. Emergeables: Deformable displays for continuous eyes-free mobile interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, ACM (New York, NY, USA, 2016), 3793--3805.
15. Sahoo, D. R., Hornbæk, K., and Subramanian, S. Tablehop: An actuated fabric display using transparent electrodes. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, ACM (New York, NY, USA, 2016), 3767--3780.
16. Sahoo, D. R., Nakamura, T., Marzo, A., Omirou, T., Asakawa, M., and Subramanian, S. Joled: A mid-air display based on electrostatic rotation of levitated janus objects. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST '16, ACM (New York, NY, USA, 2016), 437--448.
17. Wakita, A., Nakano, A., and Kobayashi, N. Programmable blobs: A rheologic interface for organic shape design. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '11, ACM (New York, NY, USA, 2011), 273--276.
18. Yao, Y.-y., and Liu, J. A polarized liquid metal worm squeezing across a localized irregular gap. RSC Adv. 7 (2017), 11049--11056.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)