Adiyan Mujibiya
Jun Rekimoto
ABSTRACT
In this paper, touch typing enabled virtual keyboard system using depth sensing on arbitrary surface is proposed. Keystroke event detection is conducted using 3-dimensional hand appearance database matching combined with fingertip's surface touch sensing. Our prototype system acquired hand posture depth map by implementing phase shift algorithm for Digital Light Processor (DLP) fringe projection on arbitrary flat surface. The system robustly detects hand postures on the sensible surface with no requirement of hand position alignment on virtual keyboard frame. The keystroke feedback is the physical touch to the surface, thus no specific hardware must be worn. The system works real-time in average of 20 frames per second.
Supplemental Material
- }}Mathias Kolsch and Matthew Turk. Keyboards without keyboards: A survey of virtual keyboards. In Proc. of Sensing and Input for Media-centric Systems, 2002.Google Scholar
- }}Du H., Oggier T., Lustenberger F., and Charbon E. A virtual keyboard based on true-3d optical ranging. In Proc. of British Machine Vision Conference, 2005.Google ScholarCross Ref
- }}P. S. Huang, C. Zhang, and F. P. Chiang. High-speed 3-d shape measurement based on digital fringe projection. Optical Engineering, 42(1):163--168, 2003.Google ScholarCross Ref
- }}Blindtype. {Online}. http://www.blindtype.com.Google Scholar
Index Terms
- Anywhere touchtyping: text input on arbitrary surface using depth sensing
Recommendations
Visual touchpad: a two-handed gestural input device
ICMI '04: Proceedings of the 6th international conference on Multimodal interfacesThis paper presents the Visual Touchpad, a low-cost vision-based input device that allows for fluid two-handed interactions with desktop PCs, laptops, public kiosks, or large wall displays. Two downward-pointing cameras are attached above a planar ...
Comparative performance analysis of a commercial wearable EOG glasses for an asynchronous virtual keyboard
HCI '18: Proceedings of the 32nd International BCS Human Computer Interaction ConferenceConventional electrooculography (EOG) signal acquisition systems, apart from requiring expensive equipment, necessitate electrode gel for conductivity and electrode wires, which may obstruct the field of view and restrict user movements, thus making the ...
Design a Real-Time Eye Tracker
ICVIP '18: Proceedings of the 2018 2nd International Conference on Video and Image ProcessingAn eye tracker is a device for measuring eye positions and eye movement. During the past decades, various approaches have been presented for eye tracking systems such as helping disabled people in various tasks including communication, writing emails, ...
Comments