research-article

Measuring multitasking behavior with activity-based metrics

Authors:

Raquel Benbunan-Fich,

Rachel F. Adler,

Tamilla MavlanovaAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 18, Issue 2

Article No.: 7, Pages 1 - 22

https://doi.org/10.1145/1970378.1970381

Published: 01 July 2011 Publication History

Abstract

Multitasking is the result of time allocation decisions made by individuals faced with multiple tasks. Multitasking research is important in order to improve the design of systems and applications. Since people typically use computers to perform multiple tasks at the same time, insights into this type of behavior can help develop better systems and ideal types of computer environments for modern multitasking users. In this paper, we define multitasking based on the principles of task independence and performance concurrency and develop a set of metrics for computer-based multitasking. The theoretical foundation of this metric development effort stems from an application of key principles of Activity Theory and a systematic analysis of computer usage from the perspective of the user, the task and the technology. The proposed metrics, which range from a lean dichotomous variable to a richer measure based on switches, were validated with data from a sample of users who self-reported their activities during a computer usage session. This set of metrics can be used to establish a conceptual and methodological foundation for future multitasking studies.

References

[1]

Bailey, B. P. and Iqbal, S. T. 2008. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Trans. Comput.-Hum. Interact. 14, 4, 21--56.

Digital Library

[2]

Bell, C. S., Compeau, D. R., and Olivera, F. 2005. Understanding the social implications of technological multitasking: A conceptual model. In Proceedings of the 4th Annual Worskshop on HCI Research in MIS. 80--84.

[3]

Bedny, G. Z., Chebykin, O., and Karwowski, W. 2005. The task as a basic object of study in an HCI system. In Proceedings of the 11th International Conference on Human-Computer Interaction (HCI'05). M. J. Smith and G. Salvendy Eds., Lawrence Erlbaum Associates, Mahwah, NJ.

[4]

Bedny, G. Z. and Harris, S. R. 2005. The systemic-structural theory of activity: Applications to the study of human work. Mind, Cult. Activ. 12, 2, 128--147.

[5]

Bedny, G. Z. and Harris, S. R. 2008. “Working sphere/engagement” and the concept of task in activity theory. Interact. Comput. 20, 251--255.

Digital Library

[6]

Bedny, G. Z. and Karwowski, W. 2007. A Systemic-Structural Theory of Activity: Applications to Human Performance and Work Design. CRC/Taylor & Francis, Boca Raton, FL.

[7]

Bedny, G. Z. and Karwowski, W. 2003. A systemic-structural activity approach to the design of human-computer interaction tasks. Int. J. Hum.-Comput. Interact. 16, 2, 235--260.

[8]

Bedny, G. Z., Seglin, M. H., and Meister, D. 2000. Activity theory: History, research and application. Theor. Iss. Ergon. Sci. 1, 2, 168--206.

[9]

Benbunan-Fich, R., and Truman, G. E. 2009. Multitasking with laptops during meetings. Comm. ACM, 52, 2, 139--141.

Digital Library

[10]

Bluedorn, A. C., Kaufman, C. F., and Lane, P. M. 1992. How many things do you like to do at once&quest; An introduction to monochronic and polychronic time. Acad. Manage. Exec. 6, 4, 17--26.

[11]

Bødker, S. 1989. A human activity approach to user interfaces. Hum.-Comput. Interact. 4, 3, 171--195.

Digital Library

[12]

Bødker, S. 1996. Applying Activity Theory to Video Analysis: How to make sense of video data in Human-Computer Interaction. In Context and Consciousness, Nardi, B. A. Ed., MIT Press, Cambridge, MA, 147--174.

Digital Library

[13]

Burton-Jones, A. and Straub, D. W. 2006. Reconceptualizing system usage: An approach and empirical test. Inform. Syst. Resear. 17, 3, 228--246.

Digital Library

[14]

Crook, C. and Barrowcliff, D. 2001. Ubiquitous computing on campus: Patterns of engagement by university students. Int. J. Hum.-Comput. Interact. 13, 2, 245--256.

[15]

Cutrell, E. B., Czerwinski, M., and Horvitz, E. 2000. Effects of instant messaging interruptions on computing tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 99--100.

Digital Library

[16]

Czerwinski, M., Horvitz, E., and Wilhite, S. 2004. A diary study of task switching and interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 175--182.

Digital Library

[17]

Deane, F. P., Podd, J., and Henderson, R. D. 1998. Relationship between self-report and log data estimates of information system usage. Comput. Hum. Behav. 14, 4, 621--636.

[18]

Gillie, T. and Broadbent, D. 1989. What makes interruptions disruptive&quest; A study of length, similarity, and complexity. Psych. Resear. 50, 4, 243--250.

[19]

González, V. M. and Mark, G. 2004. “Constant, constant, multi-tasking craziness”: Managing multiple working spheres. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 113--120.

Digital Library

[20]

Hackman, J. R. 1969. Toward understanding the role of tasks in behavioral research. Acta Psychologica, 31, 97--128.

[21]

Hall, E. T. 1983. The Dance of Life: The Other Dimension of Time. Anchor Books/Doubleday, Garden City, NY.

[22]

Hembrooke, H. and Gay, G. 2003. The laptop and the lecture: The effects of multitasking in learning environments. J. Comput. Higher Ed. 15, 1, 46--64.

[23]

Hodgetts, H. M. and Jones, D. M. 2006. Interruption of the Tower of London task: Support for a goal activation approach. J. Exper. Psych. Gen. 135, 1, 103--115.

[24]

Kaptelinin, V. 1996. Activity theory: Implications for human-computer interaction. In Context and Consciousness, Nardi, B. A. Ed., MIT Press, Cambridge, MA, 53--59.

[25]

Kaptelinin, V. and Nardi, B. A. 2006. Acting with Technology: Activity Theory and Interaction Design. MIT Press, Cambridge, MA.

Digital Library

[26]

Kuutti, K. 1991. Activity theory and its applications to information systems research and development. In Information Systems Research, H.-E. Nissen Ed., Elsevier Science Publishers, Amsterdam, 529--549.

[27]

Kuutti, K. 1996. Activity Theory as a potential framework for Human-Computer Interaction. In Context and Consciousness, Nardi, B. A. Ed., MIT Press, Cambridge, MA, 17--44.

Digital Library

[28]

Lee, H. 1999. Time and information technology: Monochronicity, polychronicity and temporal symmetry. Eur. J. Inform. Syst. 8, 1, 16--26.

Digital Library

[29]

Mark, G., González, V. M., and Harris, J. 2005. No task left behind&quest;: Examining the nature of fragmented work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 321--330.

Digital Library

[30]

McCrickard, D. S., Chewar, C. M., Somervell, J. P., and Ndiwalana, A. 2003. A model for notification systems evaluation—Assessing user goals for multitasking activity. ACM Trans. Comput.-Hum. Interact., 10, 4, 312--338.

Digital Library

[31]

McFarlane, D. C. 2002. Comparison of four primary methods for coordinating the interruption of people in human-computer interaction. Hum.-Comput. Interact. 17, 1, 63--139.

Digital Library

[32]

McFarlane, D. C. and Latorella, K.A. 2002. The scope and importance of human interruption in human-computer interaction design. Hum.-Comput. Interact. 17, 1, 1--61.

Digital Library

[33]

McGrath, J. E. 1991. Time, interaction and performance (TIP): A theory of groups. Small Group Resear. 22, 2, 147--174.

[34]

Nardi, B. A. 1996. Studying context: A comparison of activity theory, situated action models and distributed cognition. In Context and Consciousness, Nardi, B. A. Ed., MIT Press, Cambridge, MA, 69--102.

Digital Library

[35]

Ophir, E., Nass, C., and Wagner, A. D. 2009. Cognitive control in media multitaskers. Proc. Nat. Acad. Sci. 1--5.

[36]

Payne, S. J., Duggan, G. B., and Neth, H. 2007. Discretionary task interleaving: Heuristics for time allocation in cognitive foraging. J. Exper. Psych. Gen. 136, 3, 370--388.

[37]

Reinsch, N.L., Turner, J. W., and Tinsley, C. H. 2008. Multicommunicating: A practice whose time has come&quest; Acad. Manage. Rev. 33, 2, 391--403.

[38]

Renaud, K., Ramsay, J., and Hair. M. 2006. “You've got e-mail&excl;”… Shall I deal with it now&quest; Electronic mail from the recipient's perspective. Int. J. Hum.-Comput. Interact., 21, 3, 313--332.

[39]

Rubinstein, J. S., Meyer, D. E., and Evans, J. E. 2001. Executive control of cognitive processes in task switching. J. Exper. Psych. Hum. Percept. Perform. 27, 4, 763--797.

[40]

Salvucci, D. D. 2009. Rapid prototyping and evaluation of in-vehicle interfaces. ACM Trans. Comput.-Hum. Interact. 16, 2, 1--33.

Digital Library

[41]

Speier, C., Vessey, I., and Valacich, J. S. 2003. The effects of interruptions, task complexity, and information presentation on computer-supported decision-making performance. Decis. Sci. 34, 4, 771--797.

[42]

Speier, C., Vessey, I., and Valacich, J. S. 1999. The influence of task interruption on individual decision making: An information overload perspective. Decis. Sci. 30, 2, 337--361.

[43]

Wasson, C. 2004. Multitasking during virtual meetings. Hum. Resource Plan. 27, 4, 47--61.

[44]

Whittaker, S. 2005. Supporting collaborative task management in e-mail. Human-Comput. Interact. 20, 1--2, 49--88.

Digital Library

[45]

Wild, P. J., Johnson, P., and Johnson, H. 2004. Towards a composite modeling approach for multitasking. In Proceedings of the 3rd Annual Conference on Task Models and Diagrams. 17--24.

Digital Library

[46]

Wood, R. E. 1986. Task complexity: Definition of the construct. Organiz. Behav. Hum. Decis. Proc. 37, 1, 60--82.

Cited By

Wittschen CWas C(2025)Influence of mind wandering and increased attentional demands on multitasking and implicit learningEurope’s Journal of Psychology10.5964/ejop.1460521:1(65-76)Online publication date: 28-Feb-2025
https://doi.org/10.5964/ejop.14605
Abdelnour Nocera JClemmensen Tvan Biljon JKroeze JQin XParra-Agudelo L(2024)Towards a Research Agenda for Geopolitical Tensions in HCIInteracting with Computers10.1093/iwc/iwae024Online publication date: 14-Jun-2024
https://doi.org/10.1093/iwc/iwae024
Chen QYan ZMoeyaert MBangert-Drowns R(2024)Mobile Multitasking in Learning: A Meta-Analysis of Effects of Mobilephone Distraction on Young Adults’ Immediate RecallComputers in Human Behavior10.1016/j.chb.2024.108432(108432)Online publication date: Sep-2024
https://doi.org/10.1016/j.chb.2024.108432
Show More Cited By

Index Terms

Measuring multitasking behavior with activity-based metrics
1. Human-centered computing

Recommendations

Towards new metrics for multitasking behavior
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

In this paper we propose new metrics to investigate computer-based multitasking behavior. These metrics range from a very lean dichotomous variable to a very rich measure based on switches that combines user, task and technology considerations. We ...
Patterns of multitasking behaviours of adolescents in digital environments
Abstract
The centrality of multitasking in teenagers’ lives has triggered vast interest in popular and academic discussion. Due to a large inconsistency in the study and multitasking reporting, we endeavoured to better understand and characterize ...
Uncovering Task Based Behavioral Heterogeneities in Online Search Behavior
SIGIR '16: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval

While a major share of prior work have considered search sessions as the focal unit of analysis for seeking behavioral insights, search tasks are emerging as a competing perspective in this space. In the current work, we quantify user search task ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 18, Issue 2

June 2011

149 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/1970378

Issue’s Table of Contents

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2011

Accepted: 01 January 2011

Revised: 01 September 2010

Received: 01 June 2010

Published in TOCHI Volume 18, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

48
Total Citations
View Citations
1,779
Total Downloads

Downloads (Last 12 months)85
Downloads (Last 6 weeks)9

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wittschen CWas C(2025)Influence of mind wandering and increased attentional demands on multitasking and implicit learningEurope’s Journal of Psychology10.5964/ejop.1460521:1(65-76)Online publication date: 28-Feb-2025
https://doi.org/10.5964/ejop.14605
Abdelnour Nocera JClemmensen Tvan Biljon JKroeze JQin XParra-Agudelo L(2024)Towards a Research Agenda for Geopolitical Tensions in HCIInteracting with Computers10.1093/iwc/iwae024Online publication date: 14-Jun-2024
https://doi.org/10.1093/iwc/iwae024
Chen QYan ZMoeyaert MBangert-Drowns R(2024)Mobile Multitasking in Learning: A Meta-Analysis of Effects of Mobilephone Distraction on Young Adults’ Immediate RecallComputers in Human Behavior10.1016/j.chb.2024.108432(108432)Online publication date: Sep-2024
https://doi.org/10.1016/j.chb.2024.108432
Deng LZhou YBroadbent J(2024)Distraction, multitasking and self-regulation inside university classroomEducation and Information Technologies10.1007/s10639-024-12786-w29:18(23957-23979)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10639-024-12786-w
Lee HHsu FLi WTsai JChen YChang Y(2023)Get Distracted or Missed the Stop? Investigating Public Transit Passengers’ Travel-Based Multitasking Behaviors, Motives, and ChallengesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581391(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581391
Yang JXie PMing X(2023)The influence of multitasking on creative work involvement: a conservation of resources perspectiveJournal of Managerial Psychology10.1108/JMP-05-2022-0248Online publication date: 16-Jun-2023
https://doi.org/10.1108/JMP-05-2022-0248
Qin XClemmensen TXin H(2023)How Motivation, Nomophobic Design and Environmental Demands Predict Students’ Media Multitasking when Participating in Online Courses During COVID-19: An Empirical Study with a HCI Time and Temporality LensInteracting with Computers10.1093/iwc/iwad00235:5(707-724)Online publication date: 28-Feb-2023
https://doi.org/10.1093/iwc/iwad002
Yasue NSuda SSawaragi T(2023)Evaluating Worker Interactions in U-Shaped Production Lines Using Functional Resonance Analysis MethodIFAC-PapersOnLine10.1016/j.ifacol.2023.10.27756:2(9678-9683)Online publication date: 2023
https://doi.org/10.1016/j.ifacol.2023.10.277
Becker LKaltenegger HNowak DRohleder NWeigl M(2022)Differences in stress system (re-)activity between single and dual- or multitasking in healthy adults: a systematic review and meta-analysisHealth Psychology Review10.1080/17437199.2022.207132317:1(78-103)Online publication date: 5-May-2022
https://doi.org/10.1080/17437199.2022.2071323
Sidgman JBrown VBrazel J(2021)The Multitasking Audit Environment: The Effect of Alternative Modes of Communication on Team PerformanceJournal of Information Systems10.2308/ISYS-2020-01935:3(155-175)Online publication date: 22-Feb-2021
https://doi.org/10.2308/ISYS-2020-019
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents