research-article

Comparing projected in-situ feedback at the manual assembly workplace with impaired workers

Authors:

Andreas Bächler,

Liane Bächler,

Christoph Krieger,

Thomas Heidenreich,

Albrecht SchmidtAuthors Info & Claims

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Article No.: 1, Pages 1 - 8

https://doi.org/10.1145/2769493.2769496

Published: 01 July 2015 Publication History

Abstract

With projectors and depth cameras getting cheaper, assistive systems in industrial manufacturing are becoming increasingly ubiquitous. As these systems are able to continuously provide feedback using in-situ projection, they are perfectly suited for supporting impaired workers in assembling products. However, so far little research has been conducted to understand the effects of projected instructions on impaired workers. In this paper, we identify common visualizations used by assistive systems for impaired workers and introduce a simple contour visualization. Through a user study with 64 impaired participants we compare the different visualizations to a control group using no visual feedback in a real world assembly scenario, i.e. assembling a clamp. Furthermore, we introduce a simplified version of the NASA-TLX questionnaire designed for impaired participants. The results reveal that the contour visualization is significantly better in perceived mental load and perceived performance of the participants. Further, participants made fewer errors and were able to assemble the clamp faster using the contour visualization compared to a video visualization, a pictorial visualization and a control group using no visual feedback.

References

[1]

Agrawala, M., Phan, D., Heiser, J., Haymaker, J., Klingner, J., Hanrahan, P., and Tversky, B. Designing effective step-by-step assembly instructions. In ACM Transactions on Graphics (TOG), vol. 22, ACM (2003), 828--837.

Digital Library

[2]

Bannat, A., Wallhoff, F., Rigoll, G., Friesdorf, F., Bubb, H., Stork, S., Müller, H., Schubö, A., Wiesbeck, M., and Zäh, M. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys (2008).

[3]

Bortz, J., and Döring, N. Forschungsmethoden und evaluation: für human-und sozialwissenschaftler. Springer, 2006.

[4]

Butz, A., Schneider, M., and Spassova, M. Searchlight--a lightweight search function for pervasive environments. In Pervasive Computing. Springer, 2004, 351--356.

[5]

Cuvo, A. J., Davis, P. K., O'Reilly, M. F., Mooney, B. M., and Crowley, R. Promoting stimulus control with textual prompts and performance feedback for persons with mild disabilities. Journal of applied behavior analysis 25, 2 (1992), 477--489.

[6]

Goeke, S., and Bundesvereinigung Lebenshilfe für Menschen mit Geistiger Behinderung. Frauen stärken sich: Empowermentprozesse von Frauen mit Behinderungserfahrung; eine Studie im Stil der grounded theory methodology. Lebenshilfe-Verlag, 2010.

[7]

Hardy, J., and Alexander, J. Toolkit support for interactive projected displays. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, ACM (2012), 42.

Digital Library

[8]

Hart, S. G., and Staveland, L. E. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.

[9]

Heiser, J., Phan, D., Agrawala, M., Tversky, B., and Hanrahan, P. Identification and validation of cognitive design principles for automated generation of assembly instructions. In Proceedings of the working conference on Advanced Visual Interfaces, ACM (2004), 311--319.

Digital Library

[10]

Hendricks, A. Un convention on the rights of persons with disabilities. Eur. J. Health L. 14 (2007), 273.

[11]

Johnson, B. F., and Cuvo, A. J. Teaching mentally retarded adults to cook. Behavior Modification 5, 2 (1981), 187--202.

[12]

Korn, O., Funk, M., and Schmidt, A. Design approaches for the gamification of production environments. a study focusing on acceptance. In Proceedings of the 8th International Conference on PErvasive Technologies Related to Assistive Environments, ACM (2015).

Digital Library

[13]

Korn, O., Schmidt, A., and Hörz, T. Augmented manufacturing: a study with impaired persons on assistive systems using in-situ projection. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, ACM (2013), 21.

Digital Library

[14]

Lancioni, G. E., O'Reilly, M. F., Seedhouse, P., Furniss, F., and Cunha, B. Promoting independent task performance by persons with severe developmental disabilities through a new computer-aided system. Behavior Modification 24, 5 (2000), 700--718.

[15]

Linder, N., and Maes, P. Luminar: portable robotic augmented reality interface design and prototype. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology, ACM (2010), 395--396.

Digital Library

[16]

Pierce, K. L., and Schreibman, L. Teaching daily living skills to children with autism in unsupervised settings through pictorial self-management. Journal of applied behavior analysis 27, 3 (1994), 471--481.

[17]

Pinhanez, C. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In Ubicomp 2001: Ubiquitous Computing, Springer (2001), 315--331.

Digital Library

[18]

Rüther, S., Hermann, T., Mracek, M., Kopp, S., and Steil, J. An assistance system for guiding workers in central sterilization supply departments. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, ACM (2013), 3.

Digital Library

[19]

Sauer, A. L., Parks, A., and Heyn, P. C. Assistive technology effects on the employment outcomes for people with cognitive disabilities: a systematic review. Disability & Rehabilitation: Assistive Technology 5, 6 (2010), 377--391.

[20]

Schuntermann, M. Einführung in die icf: Grundkurs, übungen, offene fragen. 2. Aufl. Landsberg/Lech: Ecomed Medizin (2007).

[21]

Steed, S. E., and Lutzker, J. R. Using picture prompts to teach an adult with developmental disabilities to independently complete vocational tasks. Journal of Developmental and Physical Disabilities 9, 2 (1997), 117--133.

[22]

Wilson, A. D. Using a depth camera as a touch sensor. In ACM international conference on interactive tabletops and surfaces, ACM (2010), 69--72.

Digital Library

[23]

Zhou, J., Lee, I., Thomas, B., Menassa, R., Farrant, A., and Sansome, A. Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, ACM (2011), 195--200.

Digital Library

Cited By

Wächter CDeppe SRöcker C(2024)Spatial Augmented Reality in Industrial Environments - An Approach for Improved Hand-Tracking Using Combined Computer Vision Technologies2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00045(226-231)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00045
Rojas MBalderas DMaldonado JPonce PLopez-Bernal DMolina A(2024)Lack of verified Inclusive Technology for Workers with disabilities in industry 4.0: a systematic reviewInternational Journal of Sustainable Engineering10.1080/19397038.2024.232871117:1(190-210)Online publication date: 14-Mar-2024
https://doi.org/10.1080/19397038.2024.2328711
Marino EBarbieri LBruno FMuzzupappa M(2024)Assessing user performance in augmented reality assembly guidance for industry 4.0 operatorsComputers in Industry10.1016/j.compind.2024.104085157:COnline publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.compind.2024.104085
Show More Cited By

Index Terms

Comparing projected in-situ feedback at the manual assembly workplace with impaired workers
1. Human-centered computing

Recommendations

Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

Today's working society tries to integrate more and more impaired workers into everyday working processes. One major scenario for integrating impaired workers is in the assembly of products. However, the tasks that are being assigned to cognitively ...
Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

More and more industrial manufacturing companies are outsourcing assembly tasks to sheltered work organizations where cognitively impaired workers are employed. To facilitate these assembly tasks assistive systems have been introduced to provide ...
About the development of an interactive assistance system for impaired employees in manual order picking
PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

For the user-centered development of an assistance system for manual order picking with impaired people, the interaction partners "human and machine" are interviewed and examined in a first analysis. A survey of user-tasks and --requirements was carried ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

July 2015

526 pages

ISBN:9781450334525

DOI:10.1145/2769493

Conference Chair:
Fillia Makedon
University of Texas Arlington
,
Program Chairs:
Gian-Luca Mariottini,
Oliver Korn,
Illias Maglogiannis,
Vangelis Metsis

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

NSF: National Science Foundation
University of Texas at Austin: University of Texas at Austin
Univ. of Piraeus: University of Piraeus
NCRS: Demokritos National Center for Scientific Research
Ionian: Ionian University, GREECE

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Bundesministerium fur Wirtschaft und Energie

Conference

PETRA '15

Sponsor:

NSF
University of Texas at Austin
Univ. of Piraeus
NCRS
Ionian

PETRA '15: 8th PErvasive Technologies Related to Assistive Environments

July 1 - 3, 2015

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
632
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)3

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wächter CDeppe SRöcker C(2024)Spatial Augmented Reality in Industrial Environments - An Approach for Improved Hand-Tracking Using Combined Computer Vision Technologies2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00045(226-231)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00045
Rojas MBalderas DMaldonado JPonce PLopez-Bernal DMolina A(2024)Lack of verified Inclusive Technology for Workers with disabilities in industry 4.0: a systematic reviewInternational Journal of Sustainable Engineering10.1080/19397038.2024.232871117:1(190-210)Online publication date: 14-Mar-2024
https://doi.org/10.1080/19397038.2024.2328711
Marino EBarbieri LBruno FMuzzupappa M(2024)Assessing user performance in augmented reality assembly guidance for industry 4.0 operatorsComputers in Industry10.1016/j.compind.2024.104085157:COnline publication date: 1-May-2024
https://dl.acm.org/doi/10.1016/j.compind.2024.104085
Fang WZhang TWang ZDing J(2024)A multi-modal context-aware sequence stage validation for human-centric AR assemblyComputers & Industrial Engineering10.1016/j.cie.2024.110355194(110355)Online publication date: Aug-2024
https://doi.org/10.1016/j.cie.2024.110355
Bendzioch SHinrichsen S(2024)Potentials of an informational assembly assistance system for persons with cognitive disabilities—Results of a laboratory studyPotenziale eines informatorischen Montageassistenzsystems für Personen mit kognitiven Unterstützungsbedarfen – Ergebnisse einer LaborstudieZeitschrift für Arbeitswissenschaft10.1007/s41449-024-00414-978:2(240-253)Online publication date: 11-Apr-2024
https://doi.org/10.1007/s41449-024-00414-9
Bock LBohné TTadeja S(2024)Decision support for augmented reality-based assistance systems deployment in industrial settingsMultimedia Tools and Applications10.1007/s11042-024-19861-xOnline publication date: 13-Aug-2024
https://doi.org/10.1007/s11042-024-19861-x
Li JWang SWang GZhang JFeng SXiao YWu S(2024)The effects of complex assembly task type and assembly experience on users’ demands for augmented reality instructionsThe International Journal of Advanced Manufacturing Technology10.1007/s00170-024-13091-z131:3-4(1479-1496)Online publication date: 9-Feb-2024
https://doi.org/10.1007/s00170-024-13091-z
Bonello AFrancalanza ERefalo P(2023)Smart and Sustainable Human-Centred Workstations for Operators with Disability in the Age of Industry 5.0: A Systematic ReviewSustainability10.3390/su1601028116:1(281)Online publication date: 28-Dec-2023
https://doi.org/10.3390/su16010281
Drolshagen SPfingsthorn MHein A(2023)Context-Aware Robotic Assistive System: Robotic Pointing Gesture-Based Assistance for People with Disabilities in Sheltered WorkshopsRobotics10.3390/robotics1205013212:5(132)Online publication date: 27-Sep-2023
https://doi.org/10.3390/robotics12050132
Koushik VKane S(2023)Ability + Motivation: Understanding Factors that Influence People with Cognitive Disabilities in Regularly Practicing Daily ActivitiesProceedings of the 20th International Web for All Conference10.1145/3587281.3587295(122-133)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3587281.3587295
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten