Pupil dilations during target-pointing respect Fitts' law

ABSTRACT

Pupil size is known to correlate with changes of cognitive task workloads, but the pupillary response to requirements of basic goal-directed motor tasks is not yet clear, although pointing with tools is a ubiquitous human task. This work describes a user study to investigate the pupil dilations during aiming in two tele-operation tasks with different target settings, one aiming at targets with different sizes located at constant distance apart, and the other aiming at targets varying in different distances. The task requirements in each task were defined by Fitts' index of difficulty (ID). The purpose of this work is to further explore how the changes in task requirements are reflected by the changes of pupil size, i.e., whether the pupil responds to either target size or target distance, or to both of them. Pupil responses to different task IDs were recorded in each task. The results showed that the pupil responds to the changes of ID, not just to the change of target size. This implies that pupil diameter can be employed as an indicator of task requirement in goal-directed movements, because higher task difficulty evoked higher peak pupil dilation which occurred with longer delay. These findings can be used for detailed understanding of eye-hand coordination mechanisms in interactive systems and contribute to the foundation for developing methods to objectively evaluate interactive task requirements using pupil parameters during goal-directed movements.

References

1. Abrams, R. A., Meyer, D. E., and Kornblum, S. 1990. Eye-hand coordination: oculomotor control in rapid aimed limb movements. Journal of Experimental Psychology: Human Perception and Performance 16, 2, 248--267.
2. Beatty, J. 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin 91, 2, 276--292.
3. Bednarik, R., Vrzakova, H., and Hradis, M. 2012. What do you want to do next: a novel approach for intent prediction in gaze-based interaction. In Proc. ETRA 2012, ACM, 83--90.
4. Berguer, R., Smith, W. D., and Chung, Y. H. 2001. Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surgical Endoscopy 15, 10, 1204--1207.
5. Bradshaw, J. 1967. Pupil size as a measure of arousal during information processing. Nature 216, 5114, 515--516.
6. Cassenti, D. N., and Kelley, T. D. 2006. Towards the shape of mental workload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 11, 1147--1151.
7. Chen, H.-J., and Lin, C. J. 2011. The investigation of laparoscopic instrument movement control. Lecture Notes in Engineering and Computer Science 2198, 1, 1309--1313.
8. Elliott, D., Helsen, W. F., and Chua, R. 2001. A century later: Woodworth's (1899) two-component model of goal-directed aiming. Psychological Bulletin 127, 3, 342--357.
9. Fitts, P. M., and Peterson, J. R. 1964. Information capacity of discrete motor responses. Journal of Experimental Psychology 67, 103--112.
10. Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6, 381--391.
11. Gao, Q., Wang, Y., Song, F., Li, Z., and Dong, X. 2013. Mental workload measurement for emergency operating procedures in digital nuclear power plants. Ergonomics 56, 7, 1070--1085.
12. Gawron, V. J. 2008. Human Workload. CRC Press, 87--230.
13. Goldinger, S. D., and Papesh, M. H. 2012. Pupil dilation reflects the creation and retrieval of memories. Current Directions in Psychological Science 21, 2, 90--95.
14. Guthrie, D., and Buchwald, J. S. 1991. Significance testing of difference potentials. Psychophysiology 28, 2, 240--244.
15. Hess, E. H., and Polt, J. M. 1964. Pupil size in relation to mental activity during simple problem-solving. Science 143, 3611, 1190--1192.
16. Hoeks, B., and Levelt, W. 1993. Pupillary dilation as a measure of attention: a quantitative system analysis. Behavior Research Methods 25, 1, 16--26.
17. Iqbal, S. T., Adamczyk, P. D., Zheng, X. S., and Bailey, B. P. 2005. Towards an index of opportunity: understanding changes in mental workload during task execution. In Proc. CHI 2005, ACM, 311--320.
18. Jiang, X., Zheng, B., Tien, G., and Atkins, M. S. 2013. Pupil response to precision in surgical task execution. Studies in Health Technology and Informatics 184, 210--214.
19. Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B. 2014. Pupil responses during discrete goal-directed movements. In Proc. CHI 2014, ACM, In press.
20. Klingner, J., Kumar, R., and Hanrahan, P. 2008. Measuring the task-evoked pupillary response with a remote eye tracker. In Proc. ETRA 2008, ACM, 69--72.
21. MacKenzie, I. S. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction 7, 1, 91--139.
22. Marshall, S. P. 2002. The index of cognitive activity: measuring cognitive workload. In Proc. the 2002 IEEE 7th Conference on Human Factors and Power Plants, IEEE, 7-5--7-9.
23. Moresi, S., Adam, J. J., Rijcken, J., Kuipers, H., Severens, M., and Van Gerven, P. W. M. 2011. Response preparation with adjacent versus overlapped hands: A pupillometric study. International Journal of Psychophysiology 79, 2, 280--286.
24. Otero, S. C., Weekes, B. S., and Hutton, S. B. 2011. Pupil size changes during recognition memory. Psychophysiology 48, 10, 1346--1353.
25. Privitera, C. M., Renninger, L. W., Carney, T., Klein, S., and Aguilar, M. 2010. Pupil dilation during visual target detection. Journal of Vision 10, 10, 1--14.
26. Prytz, E., Montano, M., and Scerbo, M. W. 2012. Using fitts law for a 3d pointing task on a 2d display: Effects of depth and vantage point. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, 1, 1391--1395.
27. Richer, F., and Beatty, J. 1985. Pupillary dilations in movement preparation and execution. Psychophysiology 22, 2, 204--207.
28. Richstone, L., Schwartz, M. J., Seideman, C., Cadeddu, J., Marshall, S., and Kavoussi, L. R. 2010. Eye metrics as an objective assessment of surgical skill. Annals Surgery 252, 1, 177--182.
29. Wickens, C. D. 2002. Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science 3, 2, 159--177.
30. Zheng, B., Cassera, M. A., Martinec, D. V., Spaun, G. O., and Swanstrom, L. L. 2010. Measuring mental workload during the performance of advanced laparoscopic tasks. Surgical Endoscopy 24, 1, 45--50.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods