Spatial gestures using a tactile-proprioceptive display

ABSTRACT

Proprioception --the human ability to sense the orientation of limbs without vision or hearing-- is one of the main drivers of motor operations and plays a significant role in input modalities such as touch and gestures. As an output modality proprioception has remained largely unexplored --though it can convey information to a user using their own body. Spatial interaction requires users to visually acquire the location of an object, which can then be manipulated using a touch or gesture. This is challenging if you are unable to see or in mobile contexts where the use of a display may be undesirable. This paper evaluates a tactile-proprioceptive display for eye and ear free 2D target acquisition and spatial interaction.

References

1. T. T. Ahmaniemi and V. T. Lantz. Augmented reality target finding based on tactile cues. In Proc. of ICMI-MLMI '09, pages 335--342, New York, NY, USA, 2009.
2. D. Ashbrook, P. Baudisch, and S. White. Nenya: subtle and eyes-free mobile input with a magnetically-tracked finger ring. In Proc. of CHI '11, pages 2043--2046, New York, NY, USA, 2011. ACM.
3. S. Gustafson, D. Bierwirth, and P. Baudisch. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. In Proc. of UIST '10, pages 3--12, New York, NY, USA, 2010. ACM.
4. S. K. Kane, J. P. Bigham, and J. O. Wobbrock. Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In Proceedings ASSETS'08, pages 73--80, New York, NY, USA, 2008. ACM.
5. F. C. Y. Li, D. Dearman, and K. N. Truong. Virtual shelves: interactions with orientation aware devices. In Proceedings of UIST'09, pages 125--128, New York, NY, USA, 2009. ACM.
6. T. Morelli, J. Foley, and E. Folmer. VI-Bowling: a tactile spatial exergame for individuals with visual impairments. In Proc. of ASSETS'10, pages 179--186, New York, NY, USA, 2010. ACM.
7. T. Oron-Gilad, J. L. Downs, R. D. Gilson, and P. A. Hancock. Vibrotactile guidance cues for target acquisition. IEEE Transactions on Systems, Man, and Cybernetics, Part C, 37(5) pages 993--1004, 2007.
8. I. Poupyrev, S. Maruyama, and J. Rekimoto. Ambient touch: designing tactile interfaces for handheld devices. In UIST '02: Proceedings of the 15th annual ACM symposium on User interface software and technology, pages 51--60, New York, NY, USA, 2002. ACM.
9. S. Robinson, P. Eslambolchilar, and M. Jones. Sweep-shake: finding digital resources in physical environments. In Proc. of MobileHCI'09, pages 12:1--12:10, New York, NY, USA, 2009. ACM.
10. D. Vlasic, R. Adelsberger, G. Vannucci, J. Barnwell, M. Gross, W. Matusik, and J. Popović. Practical motion capture in everyday surroundings. In proc. of SIGGRAPH '07, page 35, New York, NY, USA, 2007. ACM.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Haptic devices