Sharing Touch Interfaces: Proximity-Sensitive Touch Targets for Tablet-Mediated Collaboration

ABSTRACT

During conversational practices, such as a tablet-mediated sales conversation between a salesperson and a customer, tablets are often used by two users who prefer specific bodily formations in order to easily face each other and the surface of the touchscreen. In a series of studies, we investigated bodily formations that are preferred during tablet-mediated sales conversations, and explored the effect of these formations on performance in acquiring touch targets (e.g., buttons) on a tablet device. We found that bodily formations cause decreased viewing angles to the shared screen, which results in a decreased performance in target acquisition. In order to address this issue, a multi-modal design consideration is presented, which combines mid-air finger movement and touch into a unified input modality, allowing the design of proximity sensitive touch targets. We conclude that the proposed embodied interaction design not only has potential to improve targeting performance, but also adapts the ``agency' of touch targets for multi-user settings.

References

1. P.-A. Albinsson and S. Zhai. High precision touch screen interaction. In Proc. of CHI '03, pages 105--112, New York, NY, USA, 2003.
2. I. Aslan, A. Krischkowsky, A. Meschtscherjakov, M. Wuchse, and M. Tscheligi. A leap for touch: proximity sensitive touch targets in cars. In Proc. of AutomotiveUI'15, pages 39--46. ACM, 2015.
3. I. Aslan, M. Murer, V. Fuchsberger, A. Fugard, and M. Tscheligi. Drag and drop the apple: The semantic weight of words and images in touch-based interaction. In Proc. of TEI '13, pages 159--166, New York, NY, USA, 2013. ACM.
4. V. Braun and V. Clarke. Using thematic analysis in psychology. Qualitative research in psychology, 3(2):77--101, 2006.
5. B. Brown, M. McGregor, and E. Laurier. iphone in vivo: Video analysis of mobile device use. In Proc. of CHI '13, pages 1031--1040, New York, NY, USA, 2013. ACM.
6. M. Buchenau and J. F. Suri. Experience prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS '00, pages 424--433, New York, NY, USA, 2000. ACM.
7. X. A. Chen, J. Schwarz, C. Harrison, J. Mankoff, and S. E. Hudson. Air+touch: Interweaving touch & in-air gestures. In Proc of UIST '14, pages 519--525, New York, NY, USA, 2014. ACM.
8. P. Dourish. Where the Action is: The Foundations of Embodied Interaction. A Bradford book. Bradford Books, 2004.
9. P. M. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. 1954. J Exp Psychol Gen, 121(3):262--269, Sept. 1992.
10. A. Gell. Art and agency. An anthropological theory, pages 19--34, 1998.
11. T. Grossman and R. Balakrishnan. The bubble cursor: Enhancing target acquisition by dynamic resizing of the cursor's activation area. In Proc. of CHI '05, pages 281--290, New York, NY, USA, 2005.
12. E. T. Hall and E. T. Hall. The hidden dimension, volume 1990. Anchor Books New York, 1969.
13. N. Henze, E. Rukzio, and S. Boll. 100,000,000 taps: analysis and improvement of touch performance in the large. MobileHCI '11, pages 133--142, New York, NY, USA, 2011. ACM.
14. S. Heo and G. Lee. Force gestures: Augmented touch screen gestures using normal and tangential force. In CHI '11 Extended Abstracts on Human Factors in Computing Systems, pages 1909--1914, New York, NY, USA, 2011. ACM.
15. C. Holz and P. Baudisch. Understanding touch. CHI '11, pages 2501--2510, New York, NY, USA, 2011.
16. E. Hornecker and J. Buur. Getting a grip on tangible interaction: A framework on physical space and social interaction. In Proc. of CHI '06, pages 437--446, New York, NY, USA, 2006. ACM.
17. E. Hornecker, P. Marshall, N. S. Dalton, and Y. Rogers. Collaboration and interference: Awareness with mice or touch input. In Proc. of CSCW '08, pages 167--176, New York, NY, USA, 2008. ACM.
18. I. Jamil, K. O'Hara, M. Perry, A. Karnik, and S. Subramanian. The effects of interaction techniques on talk patterns in collaborative peer learning around interactive tables. In Proc. of CHI '11, CHI '11, pages 3043--3052, New York, NY, USA, 2011.
19. A. Kendon. Conducting Interaction: Patterns of Behavior in Focused Encounters (Studies in Interactional Sociolinguistics). Cambridge University Press, Nov. 1990.
20. J. B. Lehtovirta, A. Oulasvirta, and S. Brewster. The effects of walking speed on target acquisition on a touchscreen interface. In Proc.of MobileHCI '11, MobileHCI '11, pages 143--146, New York, NY, USA, 2011. ACM.
21. Y. Li, K. Hinckley, Z. Guan, and J. A. Landay. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. of CHI '05, pages 461--470, New York, NY, USA, 2005. ACM.
22. P. Marshall, R. Morris, Y. Rogers, S. Kreitmayer, and M. Davies. Rethinking "multi-user": An in-the-wild study of how groups approach a walk-up-and-use tabletop interface. In Proc. of CHI '11, CHI '11, pages 3033--3042, New York, NY, USA, 2011. ACM.
23. P. Marshall, Y. Rogers, and N. Pantidi. Using f-formations to analyse spatial patterns of interaction in physical environments. CSCW '11, pages 445--454, New York, NY, USA, 2011.
24. M. McGuffin and R. Balakrishnan. Acquisition of expanding targets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '02, pages 57--64, New York, NY, USA, 2002.
25. D. E. Meyer, R. A. Abrams, S. Kornblum, C. E. Wright, and J. Keith Smith. Optimality in human motor performance: ideal control of rapid aimed movements. Psychological review, 95(3), 1988.
26. S. Rogers, J. Williamson, C. Stewart, and R. Murray-Smith. Anglepose: Robust, precise capacitive touch tracking via 3d orientation estimation. In In Proc. of CHI'11, pages 2575--2584, New York, NY, USA, 2011. ACM.
27. A. Roudaut, S. Huot, and E. Lecolinet. Taptap and magstick: Improving one-handed target acquisition on small touch-screens. In Proc. of AVI'08, pages 146--153, New York, NY, USA, 2008. ACM.
28. B. Schildbach and E. Rukzio. Investigating selection and reading performance on a mobile phone while walking. In Proc. MobileHCI '10, pages 93--102, New York, NY, USA, 2010. ACM.
29. X.-D. Yang, T. Grossman, P. Irani, and G. Fitzmaurice. Touchcuts and touchzoom: Enhanced target selection for touch displays using finger proximity sensing. In Proc. of CHI '11, pages 2585--2594, New York, NY, USA, 2011. ACM.
30. N. Yuill and Y. Rogers. Mechanisms for collaboration: A design and evaluation framework for multi-user interfaces. ACM Trans. Comput.-Hum. Interact., 19(1):1:1--1:25, May 2012.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)