skip to main content
10.1145/1639642.1639648acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
research-article

Context-aware prompting to transition autonomously through vocational tasks for individuals with cognitive impairments

Published: 25 October 2009 Publication History

Abstract

A challenge to individuals with cognitive impairments in workplaces is how to remain engaged, recall task routines, and transition autonomously across tasks in a way relying on limited cognitive capacity. A novel task prompting system is presented with an aim to increase workplace and life independence for people with traumatic brain injury, cerebral palsy, intellectual disability, schizophrenia, and Down syndromes. This paper describes an approach to providing distributed cognition support of work engagement for persons with cognitive disabilities. The unique strength of the system is the ability to provide unique-to-the-user prompts that are triggered by context. As this population is very sensitive to issues of abstraction (e.g. icons) and presents the designer with the need to tailor prompts to a 'universe-of-one' the use of picture or verbal cues specific to each user and context is implemented. The key to the approach is to spread the context awareness across the system, with the context being flagged by beacon sources and the appropriate response being evoked by displaying the appropriate task prompting cues indexed by the intersection of specific end-user and context ID embedded in the beacons. By separating the context trigger from the pictorial or verbal response, responses can be updated independently of the rest of the installed system, and a single beacon source can trigger multiple responses in the PDA depending on the end-user and their specific tasks. A prototype is built and tested in field experiments involving eight individuals with cognitive impairments. The experimental results show the task load of the human-device interface is low or very low and the capabilities of helping with task engagement are high and reliable.

References

[1]
McKay Moore Sohlberg, Stephen Fickas, Pei-Fang Hung, Andrew Fortier, "A Comparison of four prompt modes for route finding for community travelers with severe cognitive impairments," Brain Injury, Page: 531 -- 538, January 2007.
[2]
Tony Gentry, Joseph Wallace, Connie Kvarfordt, Kathleen Bodisch Lynch, "Personal digital assistants as cognitive aids for individuals with severe traumatic brain injury: A community-based trial," Brain Injury, Page: 19 -- 24, December 2007.
[3]
Mike Wu, Ron Baecker, Brian Richards, "Participatory design of an orientation aid for amnesics," Proceedings of the SIGCHI conference on Human factors in computing systems, Page: 511 -- 520, 2005.
[4]
S. Bohonos, A. Lee, A. Malik, C. Thai, R. Manduchi, "Universal real-time navigational assistance(URNA): An urban Bluetooth beacon for the blind," Proceedings of the 1st ACM SIGMOBILE international workshop on Systems and networking support for healthcare and assisted living environments, Page: 83 -- 88, 2007.
[5]
S. Carmien, M. Dawe, G. Fischer, A. Gorman, A. Kintsch, and J. F. Sullivan. "Socio-technical environments supporting people with cognitive disabilities using public transportation." ACM Trans. on Computer-Human Interaction, 12(2):233 -- 262, Jun 2005.
[6]
DK David, SE Stock, ML Wehmeyer, "Enhancing independent task performance for individuals with mental retardation through use of a handheld self-directed visual and audio prompting," Education and Training in Mental Retardation and Developmental Disabilities, Page: 209 -- 218, 2002.
[7]
David F. Cihaka, Kelby B. Kesslerb, Paul A. Alberto, "Generalized use of a handheld prompting system," Research in Developmental Disabilities, vol.28, page: 397 -- 408, 2007.
[8]
Linda C. Mechling, Fanny Ortega-Hurndon, "Computer-Based Video Instruction to Teach Young Adults with Moderate Intellectual Disabilities to Perform Multiple Step, Job Tasks in a Generalized Setting, " Education and Training in Developmental Disabilities, vol. 42, page: 24 -- 37, 2007.
[9]
Toni Van Laarhoven, Traci Van Laarhoven-Myers, "Comparison of Three Video-based Instructional Procedures for Teaching Daily Living Skills to Persons with Developmental Disabilities," Education and Training in Developmental Disabilities, vol.41, page: 365 -- 381, 2006.
[10]
Helen Cannella-Malone, Jeff Sigafoos, Mark O'Reilly, Berenice de la Cruz, Giulio E. Lancioni, "Comparing Video Prompting to Video Modeling for Teaching Daily Living Skills to Six Adults with Developmental Disabilities," Education and Training in Developmental Disabilities, vol.41, page: 344 -- 356, 2006.
[11]
David F. Cihak, Kelby Kessler, Paul A. Alberto, "Use of a Handheld Prompting System to Transition Independently Through Vocational Tasks for Student With Moderate and Severe Intellectual Disabilities, Education and Training in Developmental Disabilities, vol.43, pp.102--110, 2008.
[12]
Liu, Alan L., Hile, Harlan, Kautz, Henry, Borriello, Gaetano, Brown, Pat A., Harniss, Mark and Johnson, Kurt 'Indoor wayfinding: Developing a functional interface for individuals with cognitive impairments', Disability and Rehabilitation: Assistive Technology, 3:1, 69 -- 81. 2007.
[13]
Goodwin, S. Comparative mental health policy: From institutional to community care. Thousand Oaks: Sage. 1997.
[14]
Bond, G. R., R. E. Drake, et al. "Supported employment for people with severe mental illness: A review." Psychiatric Services. 1996.
[15]
Bond, G. R. and R. P. Liberman . Vocational rehabilitation. Handbook of psychiatric rehabilitation. New York, Macmillan. 1992.
[16]
Braddock, D., Hemp, R. Rizzolo,&M. Parish, S. The state of the states in developmental disabilities: Study summary. In Disability at the Dawn of the 21st Century and the State of the States. Braddock, D. (ed.), American Association in Mental Retardation, Washington DC, p. 124. 2002.
[17]
The Aphasia Institute. What is Aphasia? {Online}. Available: September 2005 at http://www.aphasia.ca/about/whatis.html.
[18]
L. Liu, H. Hile, H. Kautz, G. Borriello, P.A. Brown, M. Harniss, K. Johnson, "Indoor Wayfinding: Developing a Functional Interface for Individuals with Cognitive Impairments," Proceedings of Computers&Accessibility, ASSETS 2006, pp.95 -- 102, October 2006.
[19]
Taber-Doughty, T. "Considering student choice when selecting instructional strategies: a comparison of three prompting systems," Research in Developmental Disabilities, Vol 26, 2005. pp. 411--432.
[20]
S. Carmien, M. Dawe, G. Fischer, A. Gorman, A. Kintsch, and J. F. Sullivan. "Socio-technical environments supporting people with cognitive disabilities using public transportation." ACM Trans on Computer-Human Interaction, 12(2):233 -- 262, Jun 2005.
[21]
Yao-Jen Chang, Shih-Kai Tsai, Yao-Sheng Chang, Tseng-Yun Wang "A Novel Wayfinding System Based on Geo-coded QR Codes for Individuals with Cognitive Impairments," 9th International ACM SIGACCESS Conference on Computers and Accessibility, Tempe, Oct 15 17, 2007.
[22]
Yao-Jen Chang, Shih-Kai Tsai, Tseng-Yun Wang "A Context Aware Handheld Wayfinding System for Individuals with Cognitive Impairments," 10th International ACM SIGACCESS Conference on Computers and Accessibility, Halifax, Oct 13 15, 2008. pp. 27--34.
[23]
Yao-Jen Chang, Chien-Nien Chen, Li--Der Chou, Tsen-Yung Wang, "A Novel Wayfinding Systems Based on Passive RFID for Individuals with Cognitive Impairment," Proc. Pervasive Health 2008, Tempere, Finland. Jan. 31 Feb. 2. pp. 108--111.
[24]
Yao-Jen Chang, Yen-Yin Chu, Chien-Nien Chen, Tsen-Yung Wang, "Mobile Computing for Indoor Wayfinding Based on Bluetooth Sensors for Individuals with Cognitive Impairments," 3rd International Symposium on Wireless Pervasive Computing, ISWPC 2008, Greece, May 7-9. pp. 623--627.
[25]
Yao-Jen Chang, Yan-Ru Chen, Chia Yu Chang, Tsen-Yung Wang "Video Prompting and Indoor Wayfinding Based on Bluetooth Beacons: a Case Study in Supported Employment for People with Severe Mental Illness," Proc. 2009 International Conference on Communications and Mobile Computing, Kunming, China, Jan. 6 8, 2009. Vol 3, pp. 137--141.
[26]
Yao-Jen Chang, Hsin Yu Hsu, Wan Chih Chang, Shu-Min Peng, Yan-Ru Chen, Tsen Yun Wang Context-aware "Task Prompting: Sustaining of Supported Employment for People with Severe Mental Illness," Proc. 2009 International Conference on Communications and Mobile Computing, Kunming, China, Jan. 6 8, 2009. Vol. 3, pp. 127--131.
[27]
Cook, A. M., Polgar, J. M., and Hussey, S. M. Assistive Technology Principles and Practice, 3rd Edition, Mosby-Elsevier, 2008.
[28]
NASA Task Load Index (TLX) {Online}. Available: http://humansystems.arc.nasa.gov/groups/TLX/downloads/TLXScale.pdf

Cited By

View all
  • (2024)Helping or Hindering: Inclusive Design of Automated Task Prompting for Workers with Cognitive DisabilitiesACM Transactions on Accessible Computing10.1145/362844716:4(1-23)Online publication date: 9-Jan-2024
  • (2022)Mobile Phone Use by People with Mild to Moderate Dementia: Uncovering Challenges and Identifying OpportunitiesProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544809(1-16)Online publication date: 23-Oct-2022
  • (2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Assets '09: Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
October 2009
290 pages
ISBN:9781605585581
DOI:10.1145/1639642
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cognitively impaired
  2. social services
  3. task prompting
  4. ubiquitous computing

Qualifiers

  • Research-article

Conference

ASSETS09
Sponsor:

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

ASSETS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)3
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Helping or Hindering: Inclusive Design of Automated Task Prompting for Workers with Cognitive DisabilitiesACM Transactions on Accessible Computing10.1145/362844716:4(1-23)Online publication date: 9-Jan-2024
  • (2022)Mobile Phone Use by People with Mild to Moderate Dementia: Uncovering Challenges and Identifying OpportunitiesProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544809(1-16)Online publication date: 23-Oct-2022
  • (2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
  • (2021)Authoring Tool for the Creation of Learning Objects in Occupational Education to Support People with Cognitive DisabilitiesTrends and Applications in Information Systems and Technologies10.1007/978-3-030-72654-6_19(194-204)Online publication date: 29-Mar-2021
  • (2019)A symmetric objective function for ICPACM Transactions on Graphics10.1145/3306346.332303738:4(1-7)Online publication date: 12-Jul-2019
  • (2019)Perceptual rasterization for head-mounted display image synthesisACM Transactions on Graphics10.1145/3306346.332303338:4(1-14)Online publication date: 12-Jul-2019
  • (2019)SurfaceBrushACM Transactions on Graphics10.1145/3306346.332297038:4(1-15)Online publication date: 12-Jul-2019
  • (2019)Multi-robot collaborative dense scene reconstructionACM Transactions on Graphics10.1145/3306346.332294238:4(1-16)Online publication date: 12-Jul-2019
  • (2017)An Efficient WCET-Aware Instruction Scheduling and Register Allocation Approach for Clustered VLIW ProcessorsACM Transactions on Embedded Computing Systems10.1145/312652416:5s(1-21)Online publication date: 27-Sep-2017
  • (2017)High-Level Design of Wireless Sensor Networks for Performance Optimization Under Security HazardsACM Transactions on Sensor Networks10.1145/307835913:3(1-37)Online publication date: 1-Aug-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media