Article

Region extraction of a gaze object using the gaze point and view image sequences

Authors:

Norimichi Ukita,

Masatsugu KidodeAuthors Info & Claims

ICMI '05: Proceedings of the 7th international conference on Multimodal interfaces

Pages 129 - 136

https://doi.org/10.1145/1088463.1088487

Published: 04 October 2005 Publication History

Abstract

Analysis of the human gaze is a basic way to investigate human attention. Similarly, the view image of a human being includes the visual information of what he/she pays attention to.This paper proposes an interface system for extracting the region of an object viewed by a human from a view image sequence by analyzing the history of gaze points. All the gaze points, each of which is recorded as a 2D point in a view image, are transfered to an image in which the object region is extracted. These points are then divided into several groups based on their colors and positions. The gaze points in each group compose an initial region. After all the regions are extended, outlier regions are removed by comparing the colors and optical flows in the extended regions. All the remaining regions are merged into one in order to compose a gaze region.

References

[1]

R. Tenmoku, M. Kanbara, and N. Yokoya: "A wearable augmented reality system for navigation using positioning infrastructures and a pedometer," in Proc. of IEEE and ACM International Symposium on Mixed Augmented Reality, pp.344--345, 2003.

Digital Library

[2]

P. Daehne and J. Karigiannis: "Aecheoguide: System Architecture of a Mobile Outdoor Augmented Reality System," in Proc. of International Symposium on Mixed Augmented Reality, pp.263--264, 2002.

Digital Library

[3]

S. Feiner, B. MacIntyre, T. Holler, and A. Webster: "A Touring Machine: Prototyping 3D Mobile Augmented Reality Systems for Exploring the Urban Environment," in Proc. of International Symposium on Wearable Computers, pp.74--81, 1997.

Digital Library

[4]

R. Cipolla and H. J. Hollinghurst, "Human-robot interface by pointing with uncalibrated stereo vision", Image and Vision Computing, Vol.14, No.3, pp.178--178, 1996.

[5]

T. Ohno and N. Mukawa: "Gaze-Based Interaction for Anyone, Anytime", in Proc. of HCI International 2003, Vol.4, pp.1452--1456, 2003.

[6]

Y. Matsumoto, T. Ino, and T. Ogasawara: "Development of Intelligent Wheelchair System with Face and Gaze Based Interface", in Proc. of 10th IEEE Int. Workshop on Robot and Human Communication (ROMAN 2001), pp.262--267, 2001.

[7]

R. Atienza, A. Zelinsky: "Interactive skills using active gaze tracking", in Proc. of International Conference on Multimodal Interfaces, pp.188--195, 2003.

Digital Library

[8]

A. Sugimoto, A. Nakayama, and T. Matsuyama: "Detecting Gazing Region by Visual Direction and Stereo Cameras", in Proc. of International Conference on Pattern Recognition 2002, Vol.3, pp.278--282, 2002.

Digital Library

[9]

Y. Rosenberg and M. Werman: "Real-Time Object Tracking from a Moving Video Camera: A Software Approach on a PC," in Proc. of IEEE Workshop on Applications of Computer Vision, pp.238--239, 1998.

Digital Library

[10]

J. Frazier and R. Nevatia, "Detecting Moving Objects from a Moving Platform," in Proc. of International Conference on Robotics and Automation, pp.1627--1633, 1992.

[11]

Y. Sugaya and K. Kanatani: "Extracting moving objects from a moving camera video sequence," in Proc. of the 10th Symposium on Sensing via Imaging Information, pp.279--284, 2004.

[12]

N. Ukita, A. Sakakihara, and M. Kidode: "Extracting a Gaze Region with the History of View Directions," in Proc. of 17th International Conference on Pattern Recognition, Vol.4, pp.957--960, 2004.

Digital Library

[13]

D. I. Barnea and H. F. Silverman: "A class of algorithms for fast digital image registration," IEEE Trans. Computers, Vol.21, pp.179--186, 1972.

Digital Library

[14]

Q. Zheng, R. Chellappa: "Automatic Feature Point Exaction and Tracking in image Sequences for Arbitrary Camera Motion," International Journal of Computer Vision, Vol.9, No.2, pp.31--76, 1995.

Digital Library

[15]

J. Shi and C. Tomasi: "Good Features to Track," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp.593--600, 1994.

[16]

S. Wesolkowski and E. Jernigan: "Color Edge Detection in RGB Using Jointly Euclidean Distance and Vector Angle," in Proc. of Vision interface '99, pp.19--21, 1999.

[17]

M. Kass, A. Witkin, and D. Terzopoulos: "Snakes: Active Contour Models," International Journal of Computer Vision, Vol.1, No.4, pp.321--331, 1988.

[18]

R. J. Rousseeuw and A. M. Leroy: "Robust Regression and Outlier Detection," John Wiley & Sons, 1987.

Digital Library

[19]

C. B. Barber, D. P. Dobkin, H. Huhdanpaa: "The Quickhull Algorithm for Convex Hulls", ACM Trans. on Mathematical Software, Vol.22, No.4, 1996.

Digital Library

[20]

S. Finer, B. MacIntyre, and D. Seligmann: "Knowledge-based Augmented Reality," Communication of the ACM, Vol.37, No.7, pp.52--62, 1993.

Digital Library

[21]

Y. Rathi, N. Vaswani, A. Tannenbaum, and A. Yezzi: "Particle Filtering for Geometric Active Contours with Applications to Tracking Moving and Deformable Objects," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, Vol.2, pp.2--9, 2005.

Digital Library

[22]

I. Mitsugamai, N. Ukita and M. Kidode: "Estimation of a 3D Gaze Position using View Lines," in Proc. of 12th International Conference on Image Analysis and Processing, pp.466--473, 2003.

Digital Library

Cited By

Büschel WMitschick ADachselt RShah CBelkin NByström KHuang JScholer F(2018)Here and NowProceedings of the 2018 Conference on Human Information Interaction & Retrieval10.1145/3176349.3176384(171-180)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1145/3176349.3176384
Mate SCurcio IEronen ALehtiniemi AWainwright RCorchado JBechini AHong J(2015)Automatic multi-camera remix from single videoProceedings of the 30th Annual ACM Symposium on Applied Computing10.1145/2695664.2695881(1270-1277)Online publication date: 13-Apr-2015
https://dl.acm.org/doi/10.1145/2695664.2695881
Lou YYao TChen YWu WHsu CMohapatra S(2013)A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencingProceedings of the 5th Workshop on Mobile Video10.1145/2457413.2457421(31-36)Online publication date: 27-Feb-2013
https://dl.acm.org/doi/10.1145/2457413.2457421
Show More Cited By

Index Terms

Region extraction of a gaze object using the gaze point and view image sequences
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Interest point and salient region detections

Recommendations

Extracting a Gaze Region with the History of View Directions
ICPR '04: Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04

We propose a method for extracting a gaze region from an observed image by analyzing human's view directions and image information. The view direction of the user, which is represented as a 2D gaze point in the observed image, is obtained by an eye-mark ...
Beyond gaze: preliminary analysis of pupil dilation and blink rates in an fMRI study of program comprehension
EMIP '18: Proceedings of the Workshop on Eye Movements in Programming

Researchers have been employing psycho-physiological measures to better understand program comprehension, for example simultaneous fMRI and eye tracking to validate top-down comprehension models. In this paper, we argue that there is additional value in ...
Hide my Gaze with EOG!: Towards Closed-Eye Gaze Gesture Passwords that Resist Observation-Attacks with Electrooculography in Smart Glasses
MoMM2019: Proceedings of the 17th International Conference on Advances in Mobile Computing & Multimedia

Smart glasses allow for gaze gesture passwords as a hands-free form of mobile authentication. However, pupil movements for password input are easily observed by attackers, who thereby can derive the password. In this paper we investigate closed-eye gaze ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '05: Proceedings of the 7th international conference on Multimodal interfaces

October 2005

344 pages

ISBN:1595930280

DOI:10.1145/1088463

General Chairs:
Gianni Lazzari
ITC-irst, Trento (Italy)
,
Fabio Pianesi
ITC-irst, Trento (Italy)
,
Program Chairs:
James Crowley
I.N.P. Grenoble (France)
,
Kenji Mase
Nagoya University (Japan)
,
Sharon Oviatt
Oregon Health & Sciences University

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI05

Sponsor:

ICMI05: Seventh International Conference on Multimodal Interfaces 2005

October 4 - 6, 2005

Torento, Italy

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
354
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Büschel WMitschick ADachselt RShah CBelkin NByström KHuang JScholer F(2018)Here and NowProceedings of the 2018 Conference on Human Information Interaction & Retrieval10.1145/3176349.3176384(171-180)Online publication date: 1-Mar-2018
https://dl.acm.org/doi/10.1145/3176349.3176384
Mate SCurcio IEronen ALehtiniemi AWainwright RCorchado JBechini AHong J(2015)Automatic multi-camera remix from single videoProceedings of the 30th Annual ACM Symposium on Applied Computing10.1145/2695664.2695881(1270-1277)Online publication date: 13-Apr-2015
https://dl.acm.org/doi/10.1145/2695664.2695881
Lou YYao TChen YWu WHsu CMohapatra S(2013)A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencingProceedings of the 5th Workshop on Mobile Video10.1145/2457413.2457421(31-36)Online publication date: 27-Feb-2013
https://dl.acm.org/doi/10.1145/2457413.2457421
Carlier ARavindra GCharvillat VOoi WCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Combining content-based analysis and crowdsourcing to improve user interaction with zoomable videoProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072306(43-52)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072306
Carlier ACharvillat VOoi WGrigoras RMorin Gdel Bimbo AChang SSmeulders A(2010)Crowdsourced automatic zoom and scroll for video retargetingProceedings of the 18th ACM international conference on Multimedia10.1145/1873951.1873962(201-210)Online publication date: 25-Oct-2010
https://dl.acm.org/doi/10.1145/1873951.1873962

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten