Building Blocks for Designing Future Multi-Device Interaction

ABSTRACT

The paradigm of the Internet of Things predicts that not only typical computing devices but also mundane objects will soon cooperate to achieve certain goals and communicate with users. In this paper we present a new way of designing multi-device interaction to accommodate diverse types of devices and relations among them. We first held a design workshop wherein participants created new multi-device interaction ideas by using device cards. We then analyzed the ideas in terms of the roles of devices, relations of devices with the user/environment, data type and data flow direction. Based on the findings, we identified 10 device roles and developed the corresponding diagram building blocks, each of which clearly visualizes its interaction partner and data flow characteristics. Our own investigation and additional design workshop showed that the building blocks along with device cards can help quickly create and improve multi-device interaction ideas with completeness.

References

1. Atzori, L., Iera, A., & Morabito, G. 2010. The internet of things: a survey. Computer Networks, 54(15), 2787--2805.
2. Brotman, R., Burleson, W., Forlizzi, J., Heywood, W., & Lee, J. 2015. Building change: constructive design of smart domestic environments for goal achievement. In Proc. CHI '15, 3083--3092. ACM.
3. Dearman, D. & Pierce, J. S. 2008. It's on my other computer!: computing with multiple devices. In Proc. CHI '08, 767--776. ACM.
4. Edwards, W. K. & Grinter, R. E. 2001. At home with ubiquitous computing: seven challenges. In Proc. UbiComp '01, 256--272. Springer Berlin Heidelberg.
5. Hamilton, P. & Wigdor, D. 2014. Conductor: enabling and understanding cross-device interaction. In Proc. CHI '14, 2773--2782. ACM.
6. Hanington, B. & Martin, B. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers.
7. Jokela, T., Ojala, J., & Olsson, T. 2015. A diary study on combining multiple information devices in everyday activities and tasks. In Proc. CHI '15, 3903--3912. ACM.
8. Kortuem, G., Kray, C., & Gellersen, H. 2005. Sensing and visualizing spatial relations of mobile devices. In Proc. UIST '05, 93--102. ACM.
9. Marquardt, N., Hinckley, K., & Greenberg, S. 2012. Cross-device interaction via micro-mobility and fformations. In Proc. UIST '12, 13--22. ACM.
10. Mazurek, M. L., Arsenault, J. P., Bresee, J., Gupta, N., Ion, I., Johns, C., Lee, D., Liang, Y., Olsen, J., Salmon, B., Shay, R., Vaniea, K., Bauer, L., Cranor, L. F., Ganger, G. R., & Reiter, M. 2010. Access control for home data sharing: attitudes, needs and practices. In Proc. CHI '10, 645--654. ACM.
11. Nichols, J., Rothrock, B., Chau, D. H., & Myers, B. A. 2006. Huddle: automatically generating interfaces for systems of multiple connected appliances. In Proc. UIST '06, 279--288. ACM.
12. Oulasvirta, A. & Sumari, L. 2007. Mobile kits and laptop trays: managing multiple devices in mobile information work. In Proc. CHI '07, 1127--1136. ACM.
13. Rädle, R., Jetter, H. C., Schreiner, M., Lu, Z., Reiterer, H., & Rogers, Y. 2015. Spatially-aware or spatially-agnostic? Elicitation and evaluation of user-defined cross-device interactions. In Proc. CHI '15, 3913--3922. ACM.
14. Santosa, S. & Wigdor, D. 2013. A field study of multi-device workflows in distributed workspaces. In Proc. UbiComp '13, 63--72. ACM.
15. Suo, Y., Wu, C., Qin, Y., Yu, C., Zhong, Y., & Shi, Y. 2010. Housegenie: universal monitor and controller of networked devices on touchscreen phone in smart home. In Proc. UIC/ATC '10, 487--489. IEEE.
16. Weiser, M. 1991. The computer for the 21st century. Scientific American, 265(3), 94--104.

Index Terms

• Human-centered computing