Junjun Fan
ABSTRACT
Smartphone has become a commodity device that makes life convenient whereas its capability of user interaction is often limited by its small touch screen. Employing built-in accelerometer to reconstruct gesture motions is considered as a promising solution for gesture interaction. However, the inability to separate unintentional movement from gesture motion, which often misleads the gesture recognition systems, limits the application of those acceleration-based methods. We present AccPen, a method that using smartphone as a pen for gesture interaction on physical surfaces, such as walls and tables. We utilize the high frequency portion of acceleration signals caused by friction when using the AccPen to write on physical surfaces to detect intentional gestures and reconstruct a representation of the gesture trajectory for gesture recognition. We conduct a study with 10 participants and present robust gesture recognition with an average accuracy of 92.22% across surfaces of desktops, wall, and paper.
- Agrawal S, Constandache I, Gaonkar S, et al. 2011. Using mobile phones to write in air. International conference on mobile systems, applications, and services, 15--28. Google Scholar
Digital Library
- G. Laput, R. Xiao, and C. Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 321--333. Google ScholarDigital Library
- T. Miyagawa, Y. Yonezawa, K. Itoh, and M. Hashimoto. 2014. Handwritten pattern reproduction using 3D pen acceleration and angular velocity. The transactions of the Institute of Electronics, Information and Communication Engineers. 83: 1137--1140.Google Scholar
- J. A. Ward, P. Lukowicz, G. Troster, and T. E Starner. 2006. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(10), 1553--1567. Google ScholarDigital Library
- Wobbrock, Jacob O., Andrew D. Wilson, and Yang Li. 2007. Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. User interface software and technology, 159--168. Google ScholarDigital Library
Index Terms
- AccPen: Using Smartphone with Accelerometer to Interact as Pen
Recommendations
Drag-and-drop for older adults using touchscreen devices: effects of screen sizes and interaction techniques on accuracy
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineThis study investigates the accuracy of drag-and-drop interaction for older adults by analyzing the number of supplementary attempts for positioning a target during the execution of tactile puzzle games on two different screen sizes, tablet and ...
The Study of User Interactions Based on Pen Tilt
FCST '10: Proceedings of the 2010 Fifth International Conference on Frontier of Computer Science and TechnologyPen tilt is an additional input from digital pens, which indicates the posture information of holding a pen. In this study we couple tilt input with user interactions and explore its potential of improving user interactions. We first investigate human ...
Investigating multi-touch and pen gestures for diagram editing on interactive surfaces
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesCreating and editing large graphs and node-link diagrams are crucial activities in many application areas. For them, we consider multi-touch and pen input on interactive surfaces as very promising. This fundamental work presents a user study ...
Comments