Sven Kratz
ABSTRACT
We present PointPose, a prototype that allows finger pose information (tilt and rotation) to be obtained at the point of touch on touch-based mobile device, thus adding to the expressiveness of touch input. PointPose uses a short-range depth sensor viewing the touch screen that provides a point cloud that is used to infer finger pose information. Our prototype is lightweight, does not require any additional tracking, and can be adapted to work with most touch-based mobile devices, making it ideal for prototyping touch-based applications that make use of finger pose information.
- Buxton, W. Multi-touch systems that I have known and loved.hboxhttp://www.billbuxton.com/multitouchOverview.html, June 2013.Google Scholar
- Enrico Guizzo, IEEE Robotics Blog. Hands-On With the Next Generation Kinect: PrimeSense Capri. http://spectrum.ieee.org/automaton/robotics/robotics-hardware/handson-with-the-next-generation-kinect-primesense-capri, May 2013.Google Scholar
- Fischler, M. A., and Bolles, R. C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 6 (1981), 381--395. Google ScholarDigital Library
- Holz, C., and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proceedings of the 28th international conference on Human factors in computing systems, ACM (2010), 581--590. Google ScholarDigital Library
- Holz, C., and Baudisch, P. Understanding touch. In Proceedings of the 2011 annual conference on Human factors in computing systems, ACM (2011), 2501--2510. Google ScholarDigital Library
- Kratz, S., Chiu, P., and Back, M. Pointpose: Finger pose estimation for touch input on mobile devices using a depth sensor. Interactive Tabletops and Systems (ITS) 2013, ACM (October 2013). Google ScholarDigital Library
- Rogers, S., Williamson, J., Stewart, C., and Murray-Smith, R. Anglepose: robust, precise capacitive touch tracking via 3d orientation estimation. In Proceedings of the 2011 annual conference on Human factors in computing systems, ACM (2011), 2575--2584. Google ScholarDigital Library
- Takeoka, Y., Miyaki, T., and Rekimoto, J. Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces. In ACM International Conference on Interactive Tabletops and Surfaces, ACM (2010), 91--94. Google ScholarDigital Library
Index Terms
- PointPose demo: using a depth camera for finger pose estimation on touch-based mobile devices
Recommendations
PointPose: finger pose estimation for touch input on mobile devices using a depth sensor
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfacesThe expressiveness of touch input can be increased by detecting additional finger pose information at the point of touch such as finger rotation and tilt. PointPose is a prototype that performs finger pose estimation at the location of touch using a ...
Extending a mobile device's interaction space through body-centric interaction
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and servicesModern mobile devices rely on the screen as a primary input modality. Yet the small screen real-estate limits interaction possibilities, motivating researchers to explore alternate input techniques. Within this arena, our goal is to develop Body-Centric ...
Tiltcasting: 3D Interaction on Large Displays using a Mobile Device
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyWe develop and formally evaluate a metaphor for smartphone interaction with 3D environments: Tiltcasting. Under the Tiltcasting metaphor, users interact within a rotatable 2D plane that is "cast" from their phone's interactive display into 3D space. ...
Comments