Designing for Multiple Hand Grips and Body Postures within the UX of a moving Smartphone

ABSTRACT

In this paper we explore how screen-based smartphone interaction can be enriched when designers focus on the physical interaction issues surrounding the device. These consist of the hand grips used (Symmetric bimanual, Asymmetric bimanual with thumb, Single handed, Asymmetric bimanual with finger), body postures (Sitting at a table, Standing, Lying down) and the tilting of the smartphone itself. These physical interactions are well described in the literature and several research papers provide empirical metrics describing them. In this paper, we go one step further by using this data to generate new screen-based interactions. We achieved this by conducting two workshops to investigate how smartphone interaction design can be informed by the physicality of smartphone interaction. By analysing the outcomes, we provide 14 new screen interaction examples with additional insights comparing outcomes for various body postures and grips.

References

1. Azenkot S., Zhai, S. 2012. Touch behavior with different postures on soft smartphone keyboards. MobileHCI '12. ACM, New York, NY, USA, 251--260.
2. Bachynskyi, M., Palmas, G., Oulasvirta, A., Steimle, J. Weinkauf, T. 2015. Performance and Ergonomics of Touch Surfaces: A Comparative Study using Biomechanical Simulation. CHI '15. ACM, New York, NY, USA, 1817--1826.
3. Bergstrom-Lehtovirta, J., Oulasvirta, A. 2014. Modeling the functional area of the thumb on mobile touchscreen surfaces. CHI '14. ACM, New York,USA, 1991--2000.
4. Chang, Y., L'Yi, S., Koh, K, Seo, J. 2015. Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture. CHI '15. ACM, New York, NY, USA, 1499- 1508.
5. Cheng, L.P, Hsiao, F., Liu Y., Chen, M.Y. 2012. iRotate: automatic screen rotation based on face orientation. CHI '12. ACM, New York, NY, USA, 2203--2210.
6. Corsten C., Daehlmann B., Voelker S., Borchers, J. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. CHI17, ACM, New York, NY, USA, 4654--4666.
7. Dreyfuss, H. The Measure of Man: Human Factors in Design, Whitney Library of Design, 1967
8. Eardley, R., Gill, S., Roudaut, A., Thompson, S., Hare, J. 2016. Investigating how the hand interacts with different mobile phones. MobileHCI '16. ACM,
9. Eardley, R., Roudaut, A., Gill, S., and Thompson, S. J., 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. (CHI '17). ACM, New York, NY, USA, 4680--4691.
10. Eardley, R., Roudaut, A., Gill, S., and Thompson, S. J., 2018. Investigating How Smartphone Movement is Affected by Body Posture. (CHI '18). ACM, New York, NY, USA,
11. Frameless web browser Retrieved May 3, 2016 from http://stakes.github.io/Frameless/
12. Goel, M., Findlater, L., and Wobbrock, J. WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry. CHI'12, ACM (2012), 2687--2696.
13. Goetz, J. & LeCompte, M. (1981). Ethnographic research and the problem of data reduction. Anthropology and Education Quarterly, 12, 51--70.
14. Guiard, Y. (1987). Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model.
15. Heads-Up webcam viewer Retrieved May 3, 2016 from https://itunes.apple.com/gb/app/headsup-webcamviewer/id583912513?mt=12
16. Hinckley, K., Heo, S., Pahud, M., Holz, C., Benko, H., Sellen, A., Banks, R., O'Hara, K., Smyth, G., Buxton, W. 2016. Pre-Touch Sensing for Mobile Interaction. CHI '16. ACM, New York, NY, USA, 2869--2881.
17. Holz, C., Baudisch, P. 2010. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. CHI '10. ACM, USA, 581--590.
18. Kim, D.-S., and Chae, W.-S. Biomechanical analysis of a smartphone task with different postures. Korean Journal of Sport Biomechanics 22, 2 (2012), 253--259.
19. Kim, K., Chang, W., Cho, S., Shim, J., Lee, H., Park, J., Lee, Y., Kim, S. Hand Grip Pattern Recognition for Mobile User Interfaces. In Proceedings of the National Conference on Artificial Intelligence, vol 21, page 1789. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2006.
20. Mohd Noor, M.F., Ramsay, A., Hughes, S., Rogers, S., Williamson, J., and Murray-Smith, R. 28 Frames Later: Predicting Screen Touches from Back-of-device Grip Changes. CHI'14, ACM (2014), 2005--2008.
21. Napier, J., (1993) Hands, Published by Princeton University Press.
22. Negulescu, M., McGrenere, J. Grip Change as an Information Side Channel for Mobile Touch Interaction, CHI15, April 18--23, 2015, Seoul, Republic of Korea.
23. Ng, A., Brewster S.A, Williamson, J.H. 2014. Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices. CHI '14. ACM, New York, NY, USA, 1981--1990.
24. Perry K., Hourcade, J.P. 2008. Evaluating one handed thumb tapping on mobile touchscreen devices. GI '08. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 57--64.
25. Gold, J.E., J.B. Driban 1, N. Thomas, T. Chakravarty, V. Channell, E. Komaroff, Postures, typing strategies, and gender differences in mobile device usage: An observational study, 22 June 2011, Applied Ergonomics 43 (2012) 408e412
26. Silverback 2 Retrieved May 3, 2016 from https://silverbackapp.com/
27. Wilson, F. (1998). The Hand. Published by Vintage ISBN: 0--679--74047--3.
28. Wimmer, R., Boring, S., HandSense: discriminating different ways of grasping and holding a tangible user interface, TEI09, February 16--18, 2009, Cambridge, United Kingdom
29. Mehrnezhad M, Toreini E, Shahandashti SF, Hao F. Stealing PINs via mobile sensors: actual risk versus user perception. Information Security 2017.
30. Apple iOS design guidelines, January 6, 2016 from https://developer.apple.com/ios/human-interfaceguidelines/bars/toolbars/
31. Google android design guidelines, January 6, 2016 from https://material.io/guidelines/layout/structure.html - structure-ui-regions

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)