Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces

ABSTRACT

We present Scratch Input, an acoustic-based input technique that relies on the unique sound produced when a fingernail is dragged over the surface of a textured material, such as wood, fabric, or wall paint. We employ a simple sensor that can be easily coupled with existing surfaces, such as walls and tables, turning them into large, unpowered and ad hoc finger input surfaces. Our sensor is sufficiently small that it could be incorporated into a mobile device, allowing any suitable surface on which it rests to be appropriated as a gestural input surface. Several example applications were developed to demonstrate possible interactions. We conclude with a study that shows users can perform six Scratch Input gestures at about 90% accuracy with less than five minutes of training and on wide variety of surfaces.

References

1. Amento, B., Hill, W., and Terveen, L. The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface. In Proceedings of CHI '02 Ext. Abstracts, pp. 724--725.
2. Buxton, W., Hill, R., and Rowley, P. Issues and techniques in touch-sensitive tablet input. In SIGGRAPH '85, pp. 215--224.
3. Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. In Proceedings of UIST '01, pp. 219--226.
4. Han, J. Y. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST '05, pp. 115--118.
5. Hinckley, K., Baudisch, P., Ramos, G., and Guimbretiere, F. Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. In Proc. of CHI '05, pp. 451--460.
6. Kim, J., Sunwoo, J., Son, Y., Lee, D., Lee, D., and Cho, I. A gestural input through finger writing on a textured pad. In Proceedings of CHI '07 Ext. Abstracts, pp. 2495--2500.
7. Murray-Smith, R., Williamson, J., Williamson, J., Hughes, S., and Quaade, T. Stane: synthesized surfaces for tactile input. In Proceedings of CHI '08, pp. 1299--1302.
8. Patel, S. N. and Abowd, G. D. Blui: low-cost localized blow-able user interfaces. In Proceedings of UIST'07, pp. 217--220.
9. Paradiso, J. A., Hsiao, K., Strickon, J., Lifton, J., and Adler, A. Sensor systems for interactive surfaces. IBM Systems Journal, 39, 3-4 (Jul. 2000), 892--914.
10. Paradiso, J., Leo, C., Checka, N., and Hsiao, K. Passive acoustic sensing for tracking knocks atop large interactive displays. In Proc. of IEEE Sensors Conference, 2002, pp. 521--527.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens