Foldwatch: using origami-inspired paper prototypes to explore the extension of output space in smartwatches

ABSTRACT

Smartwatches are highly portable, ubiquitous devices, allowing rich interaction at a small scale. However, the display size can hinder user engagement, limit information display, and presentation style. Most research focuses on exploring ways in which the interaction area of smartwatches can be extended, although this mainly entails simple fold-out displays or additional screens. Conversely, added weight and size can hinder the wearable experience. In response, we took inspiration from origami and explored the design space for new types of lightweight, highly foldable smartwatch, by developing complex paper-prototypes which demonstrate novel ways of extending screen space. We collected data on potential input and output interaction with complex folded smartwatch displays during workshops with expert and non-expert users, discovering application ideas and additional input/output functionality. These insights were used to produce and evaluate a concept video for the FoldWatch prototype.

References

1. Jason Alexander, Andrés Lucero, and Sriram Subramanian. 2012. Tilt displays: designing display surfaces with multi-axis tilting and actuation. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 161--170.
2. Hani Buri and Yves Weinand. 2008. ORIGAMI - Folded plate structures, architecture. In 10th World Conference on Timber Engineering. 2--5.
3. Hatje Cantz, K Hatori, and P Jackson. 2005. Masters of Origami. Ostfildern-Ruit: Hatje Cantz Publishers (2005), 21--43.
4. Marta E Cecchinato, Anna L Cox, and Jon Bird. 2015. Smartwatches: the Good, the Bad and the Ugly?. In Proceedings of the 33rd Annual ACM Conference extended abstracts on human factors in computing systems. ACM, 2133--2138.
5. Barbara S Chaparro, Jibo He, Colton Turner, and Kirsten Turner. 2015. Is touch-based text input practical for a smartwatch?. In International Conference on Human-Computer Interaction. Springer, 3--8.
6. Mark D Dunlop, Andreas Komninos, and Naveen Durga. 2014. Towards high quality text entry on smartwatches. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 2365--2370.
7. Mireia Fernández-Ardèvol and Andrea Rosales. 2017. My interests, my activities: Learning from an intergenerational comparison of smartwatch use. In International Conference on Human Aspects of IT for the Aged Population. Springer, 114--129.
8. Danny Fundinger. 2013. Der Aufstieg der Smartwatch. Die Bank 10 (2013), 64--67.
9. David T Gallant, Andrew G Seniuk, and Roel Vertegaal. 2008. Towards more paper-like input: flexible input devices for foldable interaction styles. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 283--286.
10. Kentaro Go, Yuichiro Kinoshita, Kohei Kaneko, and Reiji Kozono. 2014. Creating Interactive Flexible Surfaces with Origami Tessellations. In International Conference on Collaboration Technologies. Springer, 119--126.
11. Antonio Gomes and Roel Vertegaal. 2014. Paperfold: a shape changing mobile device with multiple reconfigurable electrophoretic magnetic display tiles. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 535--538.
12. Antonio Gomes and Roel Vertegaal. 2015. PaperFold: evaluating shape changes for viewport transformations in foldable thin-film display devices. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 153--160.
13. Jun Gong, Lan Li, Daniel Vogel, and Xing-Dong Yang. 2017. Cito: An Actuated Smartwatch for Extended Interactions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5331--5345.
14. Marc Hassenzahl. 2006. Hedonic, emotional, and experiential perspectives on product quality. In Encyclopedia of human computer interaction. IGI Global, 266--272.
15. Felix Heibeck, Basheer Tome, Clark Della Silva, and Hiroshi Ishii. 2015. uniMorph: Fabricating thin film composites for shape-changing interfaces. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 233--242.
16. Horace Henley Jr. 2008. Combination watch and cell phone foldable onto each other for use around a wrist of a user. (March 3 2008). US Patent App. 12/074,491.
17. David Holman and Roel Vertegaal. 2008. Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51, 6 (2008), 48--55.
18. David Holman, Roel Vertegaal, Mark Altosaar, Nikolaus Troje, and Derek Johns. 2005. Paper windows: interaction techniques for digital paper. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 591--599.
19. Jonggi Hong, Seongkook Heo, Poika Isokoski, and Geehyuk Lee. 2015. SplitBoard: A simple split soft keyboard for wristwatch-sized touch screens. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1233--1236.
20. Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (2012), 38--51.
21. Yoonhyuk Jung, Seongcheol Kim, and Boreum Choi. 2016. Consumer valuation of the wearables: The case of smartwatches. Computers in Human Behavior 63 (2016), 899--905.
22. Tatsuya Kaihou and Akira Wakita. 2013. Electronic origami with the color-changing function. In Proceedings of the second international workshop on Smart material interfaces: another step to a material future. ACM, 7--12.
23. Keiko Katsuragawa, James R Wallace, and Edward Lank. 2016. Gestural text input using a smartwatch. In Proceedings of the International Working Conference on Advanced Visual Interfaces. ACM, 220--223.
24. Mohammadreza Khalilbeigi, Roman Lissermann, Wolfgang Kleine, and Jürgen Steimle. 2012. FoldMe: interacting with double-sided foldable displays. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, 33--40.
25. Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2011. Xpaaand: interaction techniques for rollable displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2729--2732.
26. Sunkook Kim, Hyuk-Jun Kwon, Sunghun Lee, Hongshik Shim, Youngtea Chun, Woong Choi, Jinho Kwack, Dongwon Han, MyoungSeop Song, Sungchul Kim, and others. 2011. Low-Power Flexible Organic Light-Emitting Diode Display Device. Advanced Materials 23, 31 (2011), 3511--3516.
27. Johnny C Lee, Scott E Hudson, and Edward Tse. 2008. Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 287--290.
28. Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How users manipulate deformable displays as input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1647--1656.
29. Luis A Leiva, Alireza Sahami, Alejandro Catala, Niels Henze, and Albrecht Schmidt. 2015. Text entry on tiny qwerty soft keyboards. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 669--678.
30. Kent Lyons, David Nguyen, Daniel Ashbrook, and Sean White. 2012. Facet: a multi-segment wrist worn system. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, 123--130.
31. Jun Mitani. 2011. A Method for Designing Crease Patterns for Flat-Foldable Origami With Numerical Optimization. J. Geom. Graphics 15, 2 (2011), 195--201.
32. David L Morgan. 1997. The focus group guidebook. Vol. 1. Sage publications.
33. Yusuke Nakagawa, Akiya Kamimura, and Yoichiro Kawaguchi. 2012. MimicTile: a variable stiffness deformable user interface for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 745--748.
34. Michael Nebeling, Alexandra To, Anhong Guo, Adrian A de Freitas, Jaime Teevan, Steven P Dow, and Jeffrey P Bigham. 2016. WearWrite: Crowd-assisted writing from smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 3834--3846.
35. David Nield. 2017. OK Google: Useful voice commands for your Android Wear smartwatch. Web article. (23 June 2017). Retrieved July 16, 2017 from http://www.wareable.com/android-wear/how-to-use-voice-commands-on-android-wear.
36. Ryuma Niiyama, Xu Sun, Lining Yao, Hiroshi Ishii, Daniela Rus, and Sangbae Kim. 2015. Sticky actuator: Free-form planar actuators for animated objects. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 77--84.
37. Hyunjoo Oh, Jeeeun Kim, Cory Morales, Mark Gross, Michael Eisenberg, and Sherry Hsi. 2017. FoldMecha: Exploratory Design and Engineering of Mechanical Papercraft. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 131--139.
38. Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital fabrication of interactive and shape-changing objects with foldable printed electronics. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 223--232.
39. Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. PrintScreen: fabricating highly customizable thin-film touch-displays. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 281--290.
40. Jifei Ou, Lining Yao, Daniel Tauber, Jürgen Steimle, Ryuma Niiyama, and Hiroshi Ishii. 2014. jamSheets: thin interfaces with tunable stiffness enabled by layer jamming. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 65--72.
41. Jason Pascoe. 2006. The smartwatch. In Proceedings of the Conference on Mobile and Ubiquitous Systems (CSMU), Guimaraes Portugal. 203--206.
42. Laura Perovich, Philippa Mothersill, and Jennifer Broutin Farah. 2014. Awakened apparel: embedded soft actuators for expressive fashion and functional garments. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 77--80.
43. Jie Qi and Leah Buechley. 2012. Animating paper using shape memory alloys. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 749--752.
44. Raf Ramakers, Johannes Schöning, and Kris Luyten. 2014. Paddle: highly deformable mobile devices with physical controls. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2569--2578.
45. Felix Richter. 2014. Activity Tracking Is The Most-Wanted Smartwatch Feature. Web article. (9 September 2014). Retrieved July 16, 2017 from http://www.statista.com/chart/2682/most-wanted-smartwatch-features/.
46. Felix Richter. 2015. Smartwatches Push Past Swiss Watches for the First Time. Web article. (19 February 2015). Retrieved June 5, 2017 from http://www.statista.com/chart/4386/smartwatches-vs-swiss-watches/.
47. Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: toward high shape resolution in self-actuated flexible mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 593--602.
48. Stefan Schneegass and Alexandra Voit. 2016. Gesturesleeve: Using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. ACM, 108--115.
49. Carsten Schwesig, Ivan Poupyrev, and Eijiro Mori. 2004. Gummi: a bendable computer. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 263--270.
50. Teddy Seyed, Xing-Dong Yang, and Daniel Vogel. 2016. Doppio: A Reconfigurable Dual-Face Smartwatch for Tangible Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4675--4686.
51. HongShik Shim, InSeo Kee, SunKook Kim, YoungTea Chun, HyukJun Kwon, YongWan Jin, SangYoon Lee, DongWon Han, JinHo Kwack, DongHun Kang, and others. 2010. 18.4: A new seamless foldable OLED display composed of multi display panels. In SID Symposium Digest of Technical Papers, Vol. 41. Wiley Online Library, 257--260.
52. Katie A Siek, Yvonne Rogers, and Kay H Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In INTERACT, Vol. 5. Springer, 267--280.
53. Jürgen Steimle, Andreas Jordt, and Pattie Maes. 2013. Flexpad: highly flexible bending interactions for projected handheld displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 237--246.
54. Miriam Sturdee and Jason Alexander. 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research. ACM Computing Surveys (CSUR) 51, 1 (2018), 2.
55. Dominique Tan, Maciej Kumorek, Andres A Garcia, Adam Mooney, and Derek Bekoe. 2015. Projectagami: A foldable mobile device with shape interactive applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1555--1560.
56. Aneesh P Tarun, Peng Wang, Audrey Girouard, Paul Strohmeier, Derek Reilly, and Roel Vertegaal. 2013. PaperTab: an electronic paper computer with multiple large flexible electrophoretic displays. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 3131--3134.
57. Michael T Tolley, Samuel M Felton, Shuhei Miyashita, Daniel Aukes, Daniela Rus, and Robert J Wood. 2014. Self-folding origami: shape memory composites activated by uniform heating. Smart Materials and Structures 23, 9 (2014), 094006.
58. Nirzaree Vadgama and Jürgen Steimle. 2017. Flexy: Shape-Customizable, Single-Layer, Inkjet Printable Patterns for 1D and 2D Flex Sensing. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 153--162.
59. Wouter Van Vlaenderen, Jens Brulmans, Jo Vermeulen, and Johannes Schoning. 2015. Watchme: A novel input method combining a smartwatch and bimanual interaction. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2091--2095.
60. Armando Vega and Sandi Ljubic. 2015. Smartwatch as a remote server monitoring device: implementation and interaction design. In Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2015 38th International Convention on. IEEE, 566--571.
61. Jun-ichiro Watanabe, Arito Mochizuki, and Youichi Horry. 2008. Bookisheet: bendable device for browsing content using the metaphor of leafing through the pages. In Proceedings of the 10th international conference on Ubiquitous computing. ACM, 360--369.
62. Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben, and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 716--721.
63. Hendrik Witt. 2007. Human-Computer Interfaces for Wearable Computers. PhD thesis (2007).
64. Robert Xiao, Gierad Laput, and Chris Harrison. 2014. Expanding the input expressivity of smartwatches with mechanical pan, twist, tilt and click. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 193--196.
65. Cheng Zhang, AbdelKareem Bedri, Gabriel Reyes, Bailey Bercik, Omer T Inan, Thad E Starner, and Gregory D Abowd. 2016. TapSkin: Recognizing On-Skin Input for Smartwatches. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ACM, 13--22.