skip to main content
10.1145/1344471.1344517acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

3D point-of-regard, position and head orientation from a portable monocular video-based eye tracker

Published: 26 March 2008 Publication History

Abstract

To study an observer's eye movements during realistic tasks, the observer should be free to move naturally throughout our three-dimensional world. Therefore, a technique to determine an observer's point-of-regard (POR) as well as his/her motion throughout a scene in three dimensions with minor user input is proposed. This requires robust feature tracking and calibration of the scene camera in order to determine the 3D location and orientation of the scene camera in the world. With this information, calibrated 2D PORs can be triangulated to 3D positions in the world; the scale of the world coordinate system can be obtained via input of the distance between two known points in the scene. Information about scene camera movement and tracked features can also be used to obtain observer position and head orientation for all video frames. The final observer motion -- including the observer's positions and head orientations -- and PORs are expressed in 3D world coordinates. The result is knowledge of not only eye movements but head movements as well allowing for the evaluation of how an observer combines head and eye movements to perform a visual task. Additionally, knowledge of 3D information opens the door for many more options for visualization of eye-tracking results.

References

[1]
Babcock, J. S., and Pelz, J. B. 2004. Building a lightweight eyetracking headgear. In ETRA'2004: Proceedings of the Eye tracking research & applications symposium, ACM Press, New York, NY, USA, 109--114.
[2]
Bouguet, J., 2007. Camera Calibration Toolbox for Matlab®. http://www.vision.caltech.edu/bouguetj/calib_doc/.
[3]
Duchowski, A. T., Shivashankaraiah, V., Rawls, T., Gramopadhye, A. K., Melloy, B. J., and Kanki, B. 2000. Binocular eye tracking in virtual reality for inspection training. In ETRA '00: Proceedings of the 2000 symposium on Eye tracking research & applications, ACM Press, New York, NY, USA, 89--96.
[4]
Duchowski, A. T., Medlin, E., Cournia, N., Gramopadhye, A., Melloy, B., and Nair, S. 2002. 3D eye movement analysis for VR visual inspection training. In ETRA '02: Proceedings of the 2002 symposium on Eye tracking research & applications, ACM Press, New York, NY, USA, 103--110.
[5]
Duchowski, A. T. 2007. Eye Tracking Methodology: Theory and Practice, 2nd ed. Springer-Verlag, London, UK.
[6]
Felsberg, M. 2006. Optical flow estimation from monogenic phase. In 1st International Workshop on Complex Motion, B. Jähne, R. Mester, E. Barth, and H. Scharr, Eds., vol. 3417, 1--13.
[7]
Harris, C., and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the 4th Alvey Vision Conference, 147--151.
[8]
Hartley, R., and Zisserman, A. 2004. Multiple View Geometry in Computer Vision, second ed. Cambridge University Press, ISBN: 0521540518.
[9]
He, X., and Yung, N. 2004. Curvature scale space corner detector with adaptive threshold and dynamic region of support. In Proceedings of the 17th International Conference on Pattern Recognition, 791--79.
[10]
Huynh, D., 2004. School of Computer Science & Software Engineering, The University of Western Australia. http://www.csse.uwa.edu.au/~du/Software/Welcome.html.
[11]
Kim, J.-S., and Hong, K.-S. 2007. A recursive camera resectioning technique for off-line video-based augmented reality. Pattern Recogn. Lett. 28, 7, 842--853.
[12]
Kolakowski, S. M., and Pelz, J. B. 2006. Compensating for eye tracker camera movement. In ETRA '06: Proceedings of the 2006 symposium on Eye tracking research & applications, ACM Press, New York, NY, USA, 79--85.
[13]
Kovesi, P. D., 2007. MATLAB and Octave functions for computer vision and image processing. School of Computer Science & Software Engineering, The University of Western Australia. http://www.csse.uwa.edu.au/~pk/research/matlabfns/.
[14]
Li, F., Munn, S., and Pelz, J. 2008. A model-based approach to video-based eye tracking. Journal of Modern Optics, Special Issue on Physiological Optics.
[15]
Pogalin, E. 2004. Gaze Tracking by Using Factorized Likelihoods Particle Filtering and Stereo Vision. Master's thesis, Delft University of Technology.
[16]
Smith, P., Shah, M., and da Vitoria Lobo, N. 2000. Monitoring head/eye motion for driver alertness with one camera. International Conference on Pattern Recognition 04, 4636.
[17]
Trucco, E., and Verri, A. 1998. Introductory Techniques for 3D Computer Vision. Prentice Hall PTR, Upper Saddle River, NJ, USA.
[18]
Visual Geometry Group, 2005. MATLAB functions for multiple view geometry. Department of Engineering Science, University of Oxford. http://www.robots.ox.ac.uk/~vgg/hzbook/code/.
[19]
Wang, W., and Tsui, H.-T. 2000. An SVD decomposition of essential matrix with eight solutions for the relative positions of two perspective cameras. In ICPR '00: Proceedings of the International Conference on Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 1362--1365.

Cited By

View all
  • (2023)Error Metric Using Correlation Between Binocular Corneal Images2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394251(5140-5145)Online publication date: 1-Oct-2023
  • (2022)High-Accuracy 3D Gaze Estimation with Efficient Recalibration for Head-Mounted Gaze Tracking SystemsSensors10.3390/s2212435722:12(4357)Online publication date: 8-Jun-2022
  • (2021)4D Attention: Comprehensive Framework for Spatio-Temporal Gaze MappingIEEE Robotics and Automation Letters10.1109/LRA.2021.30972746:4(7240-7247)Online publication date: Oct-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications
March 2008
285 pages
ISBN:9781595939821
DOI:10.1145/1344471
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. ego-motion
  2. eye tracking
  3. eye-head coordination
  4. head orientation
  5. point-of-regard
  6. three-dimensional

Qualifiers

  • Research-article

Conference

ETRA '08
ETRA '08: Eye Tracking Research and Applications
March 26 - 28, 2008
Georgia, Savannah

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Error Metric Using Correlation Between Binocular Corneal Images2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394251(5140-5145)Online publication date: 1-Oct-2023
  • (2022)High-Accuracy 3D Gaze Estimation with Efficient Recalibration for Head-Mounted Gaze Tracking SystemsSensors10.3390/s2212435722:12(4357)Online publication date: 8-Jun-2022
  • (2021)4D Attention: Comprehensive Framework for Spatio-Temporal Gaze MappingIEEE Robotics and Automation Letters10.1109/LRA.2021.30972746:4(7240-7247)Online publication date: Oct-2021
  • (2021)Attention Analysis for Assistance in Assembly ProcessesSmart Technologies for Precision Assembly10.1007/978-3-030-72632-4_23(310-323)Online publication date: 2-Apr-2021
  • (2020)Comment saisir et comprendre la marche en ville ?Parcours anthropologiques10.4000/pa.1181(127-162)Online publication date: 28-Jul-2020
  • (2020)Accurate Real‐time 3D Gaze Tracking Using a Lightweight Eyeball CalibrationComputer Graphics Forum10.1111/cgf.1394539:2(475-485)Online publication date: 13-Jul-2020
  • (2019)Semantic 3D gaze mapping for estimating focused objectsProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3344396(1-6)Online publication date: 1-Oct-2019
  • (2019)Indoor human localization based on the corneal reflection of illuminationProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3344388(1-6)Online publication date: 1-Oct-2019
  • (2019)Monocular gaze depth estimation using the vestibulo-ocular reflexProceedings of the 11th ACM Symposium on Eye Tracking Research & Applications10.1145/3314111.3319822(1-9)Online publication date: 25-Jun-2019
  • (2019)A Design Space for Gaze Interaction on Head-mounted DisplaysProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300855(1-12)Online publication date: 2-May-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media