skip to main content
10.1145/1344471.1344481acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

Testing for statistically significant differences between groups of scan patterns

Published: 26 March 2008 Publication History

Abstract

Pairwise sequence alignment methods are now often used when analyzing eyetracking data [Hacisalihzade et al. 1992; Brandt and Stark 1997; Josephson and Holmes 2002, 2006; Pan et al. 2004; Heminghous and Duchowski 2006]. While optimal sequence alignment scores provide a valuation of similarity and difference, they do not readily provide a statistical test of similarity or difference. Furthermore, pairwise alignment scores cannot be used to compare groups of scan patterns directly. Using a statistic that compiles these pairwise alignment scores, a statistical evaluation of similarity can be made by repeatedly computing scores from different permutations of scan pattern groupings. This test produces a p-value as a level of statistical significance.

References

[1]
Aittokallio, T., Ojala, P., Nevalainen, T. J., and Nevalainen, O. 2000. Analysis of similarity of electrophoretic patterns in mRNA differential display. Electrophoresis, 21, 2947--56.
[2]
Brandt, S. A., and Stark, L. W. 1997. Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience, 9, 27--38.
[3]
Dixon, T. D., Li, J., Noyes, J. M., Troscianko, T., Nikolov, S. G., Lewis, J., Canga, E. F., Bull, D. R., and Canagarajah, C. N. 2006. Scanpath analysis of fused multi-sensor images with luminance change: a pilot study. 9th International Conference on Information Fusion (ICIF '06), 1--8.
[4]
Dixon, T. D., Nikolov, S. G., Lewis, J. J., Li, J., Canga, E. F., Noyes, J. M., Troscianko, T., Bull, D. R., and Canagarajah, C. N. 2007. Assessment of fused videos using scanpaths: a comparison of data analysis methods. Spatial Vision, 20, 437--466.
[5]
Goldberg, J. H., and Kotval, X. P. 1999. Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics, 24, 631--645.
[6]
Hacisalihzade, S., Stark, L., and Allen, J. 1992. Visual perception and sequences of eye movement fixations: a stochastic modeling approach. IEEE Transactions on Systems, Man and Cybernetics, 22, 474--481.
[7]
Hembrooke, H., Feusner, M., and Gay, G. 2006. Averaging scan patterns and what they can tell us. Proceedings of the 2006 symposium on Eye Tracking Research & Applications, 41.
[8]
Heminghous, J. and Duchowski, A. D. 2006. iComp: a tool for scanpath visualization and comparison. Proceedings of the 3rd symposium on Applied Perception in Graphics and Visualization (APGV '06), 152.
[9]
Josephson, S. and Holmes, M. E. 2002. Visual attention to repeated internet images: testing the scanpath theory on the world wide web. Proceedings of the 2002 symposium on Eye Tracking Research & Applications, 43--49.
[10]
Josephson, S. and Holmes, M. E. 2006. Clutter or content? How on-screen enhancements affect how TV viewers scan and what they learn. Proceedings of the 2006 symposium on Eye Tracking Research & Applications, 155--162.
[11]
Kropf, S., Lux, A., Eszlinger, M., Heuer, H., and Smalla, K. 2006. Comparison of independent samples of high-dimensional data by pairwise distance measures. Biometrical Journal, 48, 1--12.
[12]
Mantel, N. 1967. The detection of disease clustering and a generalized regression approach. Cancer Research, 27, 209--220.
[13]
Myers, CW. 2005. Toward a method of objectively determining scanpath similarity. Journal of Vision, 5, 693
[14]
Nettleton D. and Doerge R. W. 2000. Accounting for Variability in the use of permutation testing to detect quantitative trait loci. Biometrics, 56, 52--58.
[15]
Pan, B., Hembrooke, H. A., Gay, G. K., Granka, L. A., Feusner, M. K., Newman, J. K. 2004. The determinants of web page viewing behavior: an eye-tracking study. Proceedings of the 2004 symposium on Eye Tracking Research & Applications, 147--154.
[16]
Salvucci, D. D. and Anderson, J. R. 2001. Automated eye-movement protocol analysis. Human Computer Interaction, 6, 39--86.
[17]
Salvucci, D. D. and Goldberg, J. H. 2000. Identifying fixations and saccades in eye-tracking protocols. Proceedings of the 2000 symposium on Eye Tracking Research & Applications, 71--78.
[18]
West, J. M., Haake, A. R., Rozanski, E. P., and Karn, K. S. 2006. eyePatterns: software for identifying patterns and similarities across fixation sequences. Proceedings of the 2006 symposium on Eye Tracking Research & Applications, 149--154.

Cited By

View all
  • (2021)Statistical modeling of dynamic eye-tracking experiments: Relative importance of visual stimulus elements for gaze behavior in the multi-group caseBehavior Research Methods10.3758/s13428-021-01576-853:6(2650-2667)Online publication date: 23-May-2021
  • (2021)The influence of training level on manual flight in connection to performance, scan pattern, and task loadCognition, Technology and Work10.1007/s10111-020-00663-823:4(715-730)Online publication date: 9-Mar-2021
  • (2019)Eye tracking student strategies for solving stoichiometry problems involving particulate nature of matter diagramsChemistry Teacher International10.1515/cti-2018-00031:1Online publication date: 28-Feb-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications
March 2008
285 pages
ISBN:9781595939821
DOI:10.1145/1344471
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. analysis
  2. comparison
  3. eye tracking
  4. scan pattern
  5. scanpath
  6. sequence comparison
  7. similarity test
  8. statistics

Qualifiers

  • Research-article

Conference

ETRA '08
ETRA '08: Eye Tracking Research and Applications
March 26 - 28, 2008
Georgia, Savannah

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Upcoming Conference

ETRA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)38
  • Downloads (Last 6 weeks)2
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2021)Statistical modeling of dynamic eye-tracking experiments: Relative importance of visual stimulus elements for gaze behavior in the multi-group caseBehavior Research Methods10.3758/s13428-021-01576-853:6(2650-2667)Online publication date: 23-May-2021
  • (2021)The influence of training level on manual flight in connection to performance, scan pattern, and task loadCognition, Technology and Work10.1007/s10111-020-00663-823:4(715-730)Online publication date: 9-Mar-2021
  • (2019)Eye tracking student strategies for solving stoichiometry problems involving particulate nature of matter diagramsChemistry Teacher International10.1515/cti-2018-00031:1Online publication date: 28-Feb-2019
  • (2018)EyeMSAProceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications10.1145/3204493.3204565(1-5)Online publication date: 14-Jun-2018
  • (2018)Assessing Representational Competence with Eye Tracking TechnologyTowards a Framework for Representational Competence in Science Education10.1007/978-3-319-89945-9_11(229-245)Online publication date: 21-Jun-2018
  • (2017)Robust Gaze Features for Enabling Language Proficiency AwarenessProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025601(2998-3010)Online publication date: 2-May-2017
  • (2016)SubsMatch 2.0: Scanpath comparison and classification based on subsequence frequenciesBehavior Research Methods10.3758/s13428-016-0765-649:3(1048-1064)Online publication date: 21-Jul-2016
  • (2016)Flipping the stimulus: Effects on scanpath coherence?Behavior Research Methods10.3758/s13428-016-0708-249:1(382-393)Online publication date: 2-Mar-2016
  • (2016)Towards Using Gaze Properties to Detect Language ProficiencyProceedings of the 9th Nordic Conference on Human-Computer Interaction10.1145/2971485.2996753(1-6)Online publication date: 23-Oct-2016
  • (2014)Determinants of Scanpath Regularity in ReadingCognitive Science10.1111/cogs.1220839:7(1675-1703)Online publication date: 22-Dec-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media