Lucas Paletta
Gerald Lodron
ABSTRACT
Human Interaction with mobile devices has recently been estab-lished as application field in eye tracking research. Current technologies for gaze recovery on mobile displays cannot enable fully natural interaction with the mobile device: users are condi-tioned to interact with tightly mounted displays or distracted by markers in their view. We propose a novel approach that cap-tures point-of-regards (PORs) with eye tracking glasses (ETG) and then uses computer vision methodology for the robust local-ization of the smartphone in the head camera video. We present an integrated software package, i.e., the Smartphone Eye Track-ing Toolbox (SMET) that enables accurate gaze recovery on mobile displays with heat mapping of recent attention. We re-port the performance of the computer vision approach and demonstrate it with various natural interaction scenarios using the SMET Toolbox, enable ROI settings on the mobile display and show results from eye movement analysis, such as, ROI dwell time and statistics on eye gaze event (saccades, fixations).
Supplemental Material
- Barnard, L., Yi, J.S., Jacko, J.A., & Sears, A. (2007). Capturing the effects of context on human performance in mobile computing systems. PUC, 11(46), pp. 81-96. Google Scholar
Digital Library
- Cauchard, J.R., Löchtefeld, M., Irani, P., Schoening, J., Krüger, A., Fraser, M., & Subramanian, S. (2011), Visual separation in mobile multi-display environments, Proc. UIST 2011. Google ScholarDigital Library
- Fritz, G. and Paletta, L. (2010), Semantic Analysis of Human Visual Attention in Mobile Eye Tracking Applications, Proc. ICIP 2010, pp. 4565 - 4568.Google ScholarCross Ref
- Giannopoulos, Ioannis, Peter Kiefer, and Martin Raubal (2012), GeoGazemarks: Providing gaze history for the orientation on small display maps, Proc. ICMI 2012. Google ScholarDigital Library
- Paletta, L., Santner, K., Fritz, G., Mayer, H., Schrammel, J. (2013). 3D Attention: Measurement of Visual Saliency Using Eye Tracking Glasses, Proc. CHI extended abstracts, pp. 199-204. Google ScholarDigital Library
- Kluge, M. & Asche, H. (2012). Validating a smartphonebased pedestrian navigation system prototype - An informal eyetracking pilot test. Proc. ICCSA 2012, Springer, pp. 386-396. Google ScholarDigital Library
- Miluzzo, M., Wang, T., & Campbell, A.T. (2010). EyePhone: Activating Mobile Phones With Your Eyes; Proc. MobiHeld, pp. 15-20. Google ScholarDigital Library
- Nagata, S (2003) Multitasking and interruptions during mobile web tasks. Proc. Human Factors and Ergonomics Society, 47th Annual Meeting, pp. 1341-1346.Google ScholarCross Ref
- Yeoh, P.Y. & Abu-Bajar, S. A. R. (2003), Accurate realtime object tracking with linear prediction method, Proc. ICIP 2003, Vol. 3, pp. 941-944.Google ScholarCross Ref
Index Terms
- Smartphone eye tracking toolbox: accurate gaze recovery on mobile displays
Recommendations
Remote Eye Tracking Systems: Technologies and Applications
SIBGRAPI-T '13: Proceedings of the 2013 26th Conference on Graphics, Patterns and Images TutorialsEye tracking is an active multidisciplinary research field, which has shown great progress in the last decades. Eye tracking is the process of monitoring eye movements in order to determine the point of gaze or to analyze motion patterns of an eye ...
Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art
Robust and accurate detection of the pupil position is a key building block for head-mounted eye tracking and prerequisite for applications on top, such as gaze-based human---computer interaction or attention analysis. Despite a large body of work, ...
Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone
ICCVW '13: Proceedings of the 2013 IEEE International Conference on Computer Vision WorkshopsThere is a increasing interest in creating wearable smartphone interaction technologies. A novel smartphone wearable hybrid interaction framework based on mixed low-cost hardware and software is proposed in this work. The software application renders ...
Comments