Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen

ABSTRACT

Previous research and recent smartphone development presented a wide range of input controls beyond the touchscreen. Fingerprint scanners, silent switches, and Back-of-Device (BoD) touch panels offer additional ways to perform input. However, with the increasing amount of input controls on the device, unintentional input or limited reachability can hinder interaction. In a one-handed scenario, we conducted a study to investigate the areas that can be reached without losing grip stability (comfortable area), and with stretched fingers (maximum range) using four different phone sizes. We describe the characteristics of the comfortable area and maximum range for different phone sizes and derive four design implications for the placement of input controls to support one-handed BoD and edge interaction. Amongst others, we show that the index and middle finger are the most suited fingers for BoD interaction and that the grip shifts towards the top edge with increasing phone sizes.

References

1. Patrick Bader, Valentin Schwind, Niels Henze, Stefan Schneegass, Nora Broy, and Albrecht Schmidt. 2014. Design and Evaluation of a Layered Handheld 3D Display with Touch-sensitive Front and Back. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). ACM, New York, NY, USA, 315--318.
2. Patrick Baudisch and Gerry Chu. 2009. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 1923--1932.
3. Joanna Bergstrom-Lehtovirta and Antti Oulasvirta. 2014. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1991--2000.
4. N Brook, J Mizrahi, M Shoham, and J Dayan. 1995. A biomechanical model of index finger dynamics. Medical engineering & physics 17, 1 (1995), 54--63.
5. W. Chang, K. E. Kim, H. Lee, J. K. Cho, B. S. Soh, J. H. Shim, G. Yang, S. j. Cho, and J. Park. 2006. Recognition of Grip-Patterns by Using Capacitive Touch Sensors. In 2006 IEEE International Symposium on Industrial Electronics, Vol. 4. 2936--2941.
6. Youli Chang, Sehi L'Yi, Kyle Koh, and Jinwook Seo. 2015. Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1499--1508.
7. Lung-Pan Cheng, Fang-I Hsiao, Yen-Ting Liu, and Mike Y. Chen. 2012. iRotate Grasp: Automatic Screen Rotation Based on Grasp of Mobile Devices. In Adjunct Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct Proceedings '12). ACM, New York, NY, USA, 15--16.
8. Lung-Pan Cheng, Hsiang-Sheng Liang, Che-Yang Wu, and Mike Y. Chen. 2013. iGrasp: Grasp-based Adaptive Keyboard for Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 3037--3046.
9. Christian Corsten, Christian Cherek, Thorsten Karrer, and Jan Borchers. 2015. HaptiCase: Back-of-Device Tactile Landmarks for Eyes-Free Absolute Indirect Touch. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2171--2180.
10. Christian Corsten, Bjoern Daehlmann, Simon Voelker, and Jan Borchers. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4654--4666.
11. Christian Corsten, Andreas Link, Thorsten Karrer, and Jan Borchers. 2016. Understanding Back-to-front Pinching for Eyes-free Mobile Touch Input. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 185--189.
12. Alexander De Luca, Emanuel von Zezschwitz, Ngo Dieu Huong Nguyen, Max-Emanuel Maurer, Elisa Rubegni, Marcello Paolo Scipioni, and Marc Langheinrich. 2013. Back-of-device Authentication on Smartphones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2389--2398.
13. Rachel Eardley, Steve Gill, Anne Roudaut, Stephen Thompson, and Joanna Hare. 2016. Investigating How the Hand Interacts with Different Mobile Phones. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, New York, NY, USA, 698--705.
14. Rachel Eardley, Anne Roudaut, Steve Gill, and Stephen J. Thompson. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4680--4691.
15. Anna Maria Feit, Daryl Weir, and Antti Oulasvirta. 2016. How We Type: Movement Strategies and Performance in Everyday Typing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4262--4273.
16. Shimin Feng, Graham Wilson, Alex Ng, and Stephen Brewster. 2015. Investigating Pressure-based Interactions with Mobile Phones While Walking and Encumbered. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '15). ACM, New York, NY, USA, 854--861.
17. Charlotte Häger-Ross and Marc H Schieber. 2000. Quantifying the independence of human finger movements: comparisons of digits, hands, and movement frequencies. The Journal of neuroscience 20, 22 (2000), 8542--8550.
18. David Holman, Andreas Hollatz, Amartya Banerjee, and Roel Vertegaal. 2013. Unifone: Designing for Auxiliary Finger Input in One-handed Mobile Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 177--184.
19. Amy K. Karlson and Benjamin B. Bederson. 2006. Studies in One-Handed Mobile Design: Habit, Desire and Agility. Technical Report. Proceedings of the 4th ERCIM Workshop on User Interfaces for All (UI4ALL '98.
20. Sunjun Kim, Jihyun Yu, and Geehyuk Lee. 2012. Interaction Techniques for Unreachable Objects on the Touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI '12). ACM, New York, NY, USA, 295--298.
21. Li-Chieh Kuo, Haw-Yen Chiu, Cheung-Wen Chang, Hsiu-Yun Hsu, and Yun-Nien Sun. 2009. Functional workspace for precision manipulation between thumb and fingers in normal hands. Journal of Electromyography and Kinesiology 19, 5 (2009), 829 -- 839.
22. Huy Viet Le, Patrick Bader, Thomas Kosch, and Niels Henze. 2016. Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, New York, NY, USA, Article 27, 10 pages.
23. Huy Viet Le, Thomas Kosch, Patrick Bader, Sven Mayer, and Niels Henze. 2018. PalmTouch: Using the Palm as an Additional Input Modality on Commodity Smartphones. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). ACM, New York, NY, USA.
24. Huy Viet Le, Sven Mayer, Patrick Bader, Frank Bastian, and Niels Henze. 2017b. Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 2730--2737.
25. Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2017a. A Smartphone Prototype for Touch Interaction on the Whole Device Surface. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '17). ACM, New York, NY, USA.
26. Huy Viet Le, Sven Mayer, Katrin Wolf, and Niels Henze. 2016. Finger Placement and Hand Grasp During Smartphone Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2576--2584.
27. Songil Lee, Gyouhyung Kyung, Jungyong Lee, Seung Ki Moon, and Kyoung Jong Park. 2016. Grasp and index finger reach zone during one-handed smartphone rear interaction: effects of task type, phone width and hand length. Ergonomics 0, 0 (2016), 1--11.
28. Luis A. Leiva and Alejandro Català. 2014. BoD Taps: An Improved Back-of-device Authentication Technique on Smartphones. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 63--66.
29. Markus Löchtefeld, Christoph Hirtz, and Sven Gehring. 2013. Evaluation of Hybrid Front- and Back-of-device Interaction on Mobile Devices. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM '13). ACM, New York, NY, USA, Article 17, 4 pages.
30. Andrew Martonik. 2015. How to use the Heart Rate Monitor on the Galaxy S5 (Androidcentral.com). (2015). http://www.androidcentral.com/how-use-heart-rate-mon itor-galaxy-s5 Last access: 2017-09-09.
31. William McGrath and Yang Li. 2014. Detecting Tapping Motion on the Side of Mobile Devices by Probabilistically Combining Hand Postures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 215--219.
32. Mohammad Faizuddin Mohd Noor, Andrew Ramsay, Stephen Hughes, Simon Rogers, John Williamson, and Roderick Murray-Smith. 2014. 28 Frames Later: Predicting Screen Touches from Back-of-device Grip Changes. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2005--2008.
33. Mohammad Faizuddin Mohd Noor, Simon Rogers, and John Williamson. 2016. Detecting Swipe Errors on Touchscreens Using Grip Modulation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1909--1920.
34. John R Napier. 1956. The prehensile movements of the human hand. Bone & Joint Journal 38, 4 (1956), 902--913.
35. Alexander Ng, Stephen A Brewster, and John Williamson. 2013. The impact of encumbrance on mobile interactions. In IFIP Conference on Human-Computer Interaction. Springer, 92--109.
36. Anna Ostberg, Mohamed Sheik-Nainar, and Nada Matic. 2016. Using a Mobile Device Fingerprint Sensor As a Gestural Input Device. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2625--2631.
37. Yong S. Park and Sung H. Han. 2010. One-handed thumb interaction of mobile devices from the input accuracy perspective. International Journal of Industrial Ergonomics 40, 6 (2010), 746 -- 756.
38. A Poston. 2000. Human engineering design data digest. Washington, DC: Department of Defense Human Factors Engineering Technical Advisory Group (2000).
39. Simon Robinson, Nitendra Rajput, Matt Jones, Anupam Jain, Shrey Sahay, and Amit Nanavati. 2011. TapBack: Towards Richer Mobile Interfaces in Impoverished Contexts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2733--2736.
40. Joaqu?Ì An L Sancho-Bru, A Perez-Gonzalez, M Vergara, and DJ Giurintano. 2003. A 3D biomechanical model of the hand for power grip. Journal of biomechanical engineering 125, 1 (2003), 78--83.
41. Erh-li Early Shen, Sung-sheng Daniel Tsai, Hao-hua Chu, Yung-jen Jane Hsu, and Chi-wen Euro Chen. 2009. Double-side Multi-touch Input for Mobile Devices. In CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). ACM, New York, NY, USA, 4339--4344.
42. Shaikh Shawon Arefin Shimon, Sarah Morrison-Smith, Noah John, Ghazal Fahimi, and Jaime Ruiz. 2015. Exploring User-Defined Back-Of-Device Gestures for Mobile Devices. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 227--232.
43. Daniel Spelmezan, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2013. Side Pressure for Bidirectional Navigation on Small Devices. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM, New York, NY, USA, 11--20.
44. Brandon T. Taylor and V Michael Bove. 2008. The Bar of Soap: A Grasp Recognition System Implemented in a Multi-functional Handheld Device. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 3459--3464.
45. Matthieu B. Trudeau, Justin G. Young, Devin L. Jindrich, and Jack T. Dennerlein. 2012. Thumb motor performance varies with thumb and wrist posture during single-handed mobile phone use. Journal of Biomechanics 45, 14 (2012), 2349 -- 2354.
46. Graham Wilson, Stephen Brewster, and Martin Halvey. 2013. Towards Utilising One-handed Multi-digit Pressure Input. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1317--1322.
47. Raphael Wimmer. 2011. Grasp Sensing for Human-computer Interaction. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 221--228.
48. Jacob O. Wobbrock, Brad A. Myers, and Htet Htet Aung. 2008. The performance of hand postures in front- and back-of-device interaction for mobile computing. International Journal of Human-Computer Studies 66, 12 (2008), 857 -- 875.
49. Katrin Wolf, Robert Schleicher, and Michael Rohs. 2014. Ergonomic Characteristics of Gestures for Front- and Back-of-tablets Interaction with Grasping Hands. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI '14). ACM, New York, NY, USA, 453--458.
50. Xiang Xiao, Teng Han, and Jingtao Wang. 2013. LensGesture: Augmenting Mobile Interactions with Back-of-device Finger Gestures. In Proceedings of the 15th ACM on International Conference on Multimodal Interaction (ICMI '13). ACM, New York, NY, USA, 287--294.
51. Jinghong Xiong and Satoshi Muraki. 2014. An ergonomics study of thumb movements on smartphone touch screen. Ergonomics 57, 6 (2014), 943--955.
52. Koji Yatani, Kurt Partridge, Marshall Bern, and Mark W. Newman. 2008. Escape: A Target Selection Technique Using Visually-cued Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 285--294.
53. Shen Ye. 2015. The science behind Force Touch and the Taptic Engine (iMore.com). (2015). http://www.imore.co m/science-behind-taptics-and-force-touch Last access: 2017-09-09.
54. Hyunjin Yoo, Jungwon Yoon, and Hyunsoo Ji. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '15). ACM, New York, NY, USA, 803--810.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)