research-article

Designing Wearable Haptic Information Displays for People with Vision Impairments

Authors:

Joe Mullenbach,

J. Edward Colgate,

Anne Marie PiperAuthors Info & Claims

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 341 - 344

https://doi.org/10.1145/2677199.2680578

Published: 15 January 2015 Publication History

Abstract

With the ubiquity of wearable computing, an important and emerging challenge is to understand how to design wearable information displays for non-visual, non-auditory interaction. This is particularly relevant to the design of accessible technologies for people with vision impairments. Working towards this aim, we developed a smartwatch prototype that uses variable friction surface haptics to test initial design concepts. Through interviews and iterative prototyping with seven blind users, we identified three key use cases for a haptic smartwatch as well as embodied conceptual models for presenting haptic information. We found that a physical clock face, compass, and numerical keypad are productive representations for presenting information haptically, and these models build on existing tactile and spatial understandings of our target user group.

References

[1]

Azenkot, S., Ladner, R. E., & Wobbrock, J. O. Smartphone haptic feedback for nonvisual wayfinding. In Proc. ASSETS '11, 281--282. ACM.

Digital Library

[2]

Dourish, P. (2001). Where The Action Is: The Foundations of Embodied Interaction. MIT Press.

[3]

Galdón, P.M., et al. (2013). Enhancing mobile phones for people with visual impairments through haptic icons: the effect of learning processes. Assist Tech. 25(2):80--7.

[4]

Iverson, J.M., and Goldin-Meadow, S. (1998). Why people gesture as they speak. Nature 396, 228.

[5]

James, W. (1890). The principles of psychology. Holt.

[6]

Jayant, C., Acuario, C., Johnson, W., Hollier., J, and Ladner, R. V-braille: haptic braille perception using a touch-screen and vibration on mobile phones. In Proc of ASSETS '10, 295--29

Digital Library

[7]

Kane, S. K., Jayant, C., Wobbrock, J. O., & Ladner, R. E. Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In Proc. ASSETS '09, 115--122.

Digital Library

[8]

Kane, S. K., Morris, M. R., & Wobbrock, J. O. Touchplates: low-cost tactile overlays for visually impaired touch screen users. In Proc. ASSETS '13, 22--29.

Digital Library

[9]

Klemmer, S. R., Hartmann, B., and Takayama, L. How bodies matter: five themes for interaction design. In Proc. DIS '06, 140--14

Digital Library

[10]

Levesque, V., Oram, L., MacLean, K., Cockburn, A., Marchuk, N. D., Johnson, D., Colgate, J.E. and Peshkin, M. A. Enhancing physicality in touch interaction with programmable friction. In Proc. CHI '11, 2481--2490.

Digital Library

[11]

1Mullenbach, J., Shultz, C., Colgate, J. E., & Piper, A. M. Exploring affective communication through variable-friction surface haptics. In Proc. CHI '14, 3963--3972.

Digital Library

[12]

Noë, A. (2010). Out of Our Heads: Why you are not your brain, and other lessons from the biology of consciousness. Hill and Wang.

[13]

Pasquero, J., Stobbe, S. J., & Stonehouse, N. A haptic wristwatch for eyes-free interactions. In Proc. CHI '11, 3257--3266.

Digital Library

[14]

Perrault, S. T., Lecolinet, E., Eagan, J., & Guiard, Y. WatchIt: simple gestures and eyes-free interaction for wristwatches and bracelets. In Proc. CHI '13, 1451--1460.

Digital Library

[15]

Quek, F., and McNeill, D. Embodiment Awareness, Mathematics Discourse, and the Blind. Ann N Y Acad Sci, 1093: 266--279.

[16]

Tam, D., MacLean, K. E., McGrenere, J., & Kuchenbecker, K. J. The design and field observation of a haptic notification system for timing awareness during oral presentations. In Proc. CHI '13, 1689--1698.

Digital Library

[17]

Xiao, R., Gierad, L., and Harrison, C. Expanding the Input Expressivity of Smartwatches with Mechanical Pan, Twist, Tilt and Click. In Proc. CHI '14, 193--196.

Digital Library

[18]

Xu, C., Israr, A., Poupyrev, I., Bau, O., and Harrison, C. Tactile display for the visually impaired using TeslaTouch. Extended Abstract. In CHI'11, 317--322.

Digital Library

[19]

Yatani, K., Banovic, N., & Truong, K. SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback. In Proc. CHI '12, 415--424.

Digital Library

[20]

Ye, H., Malu, M., Oh, U., & Findlater, L. Current and future mobile and wearable device use by people with visual impairments. In Proc. CHI '14, 3123--3132.

Digital Library

Cited By

Kim SCherian JRay SLacy ATaele PKoh JHammond T(2023)A Wearable Haptic Interface for Assisting Blind and Visually Impaired Students in Learning Algebraic EquationsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585815(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585815
Bolesnikov AKang JGirouard A(2022)Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low VisionProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501327(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501327
Jabbar MLee CCho J(2021)ColorWatch: Color Perceptual Spatial Tactile Interface for People with Visual ImpairmentsElectronics10.3390/electronics1005059610:5(596)Online publication date: 4-Mar-2021
https://doi.org/10.3390/electronics10050596
Show More Cited By

Index Terms

Designing Wearable Haptic Information Displays for People with Vision Impairments
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Surface haptic interactions with a TPad tablet
UIST '13 Adjunct: Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

A TPad Tablet is a tablet computer with a variable friction touchscreen. It can create the perception of force, shape, and texture on a fingertip, enabling unique and novel haptic interactions on a flat touchscreen surface. We have created an affordable ...
Investigating touchscreen accessibility for people with visual impairments
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

Touchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with ...
Assisting people with visual impairments in aiming at a target on a large wall-mounted display

Large interactive displays have become ubiquitous in our everyday lives, but these displays are designed for the needs of sighted people. In this paper, we specifically address assisting people with visual impairments to aim at a target on a large wall-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 2015

766 pages

ISBN:9781450333054

DOI:10.1145/2677199

Conference Chairs:
Bill Verplank
Stanford University, USA
,
Wendy Ju
Stanford University, USA
,
Program Chairs:
Alissa Antle
Simon Fraser University, Canada
,
Ali Mazalek
Georgia Institute of Technology, USA
,
Florian "Floyd" Mueller
RMIT, Australia

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 January 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

TEI '15

Sponsor:

SIGCHI

TEI '15: Ninth International Conference on Tangible, Embedded, and Embodied Interaction

January 15 - 19, 2015

California, Stanford, USA

Acceptance Rates

TEI '15 Paper Acceptance Rate 63 of 222 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
837
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)4

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim SCherian JRay SLacy ATaele PKoh JHammond T(2023)A Wearable Haptic Interface for Assisting Blind and Visually Impaired Students in Learning Algebraic EquationsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585815(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585815
Bolesnikov AKang JGirouard A(2022)Understanding Tabletop Games Accessibility: Exploring Board and Card Gaming Experiences of People who are Blind and Low VisionProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501327(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501327
Jabbar MLee CCho J(2021)ColorWatch: Color Perceptual Spatial Tactile Interface for People with Visual ImpairmentsElectronics10.3390/electronics1005059610:5(596)Online publication date: 4-Mar-2021
https://doi.org/10.3390/electronics10050596
Theil ABuchweitz LGay JLindell EGuo LPersson NKorn O(2020)Tactile Board: A Multimodal Augmentative and Alternative Communication Device for Individuals with DeafblindnessProceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia10.1145/3428361.3428465(223-228)Online publication date: 22-Nov-2020
https://dl.acm.org/doi/10.1145/3428361.3428465
Hayes SHogan Tvan den Hoven ELoke LShaer Ovan Dijk JKun A(2020)Towards a Material Landscape of TUIs, Through the Lens of the TEI Proceedings 2008-2019Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3374920.3374944(95-110)Online publication date: 9-Feb-2020
https://dl.acm.org/doi/10.1145/3374920.3374944
Beheshti EBorgos-Rodriguez KPiper AFails J(2019)Supporting Parent-Child Collaborative Learning through Haptic Feedback DisplaysProceedings of the 18th ACM International Conference on Interaction Design and Children10.1145/3311927.3323137(58-70)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3311927.3323137
Reusser DKnoop ESiegwart RBeardsley PBrewster SFitzpatrick GCox AKostakos V(2019)Feeling FireworksProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300659(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300659
Withana AGroeger DSteimle JBaudisch PSchmidt AWilson A(2018)TacttooProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242645(365-378)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242645
Gong JZhang YZhou XYang XGajos KMankoff JHarrison C(2017)PyroProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126615(553-563)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126615
Lefeuvre KTotzauer SBischof AKurze AStorz MUllmann LBerger ABjörk SEriksson EFjeld MBødker SBarendregt WObaid M(2016)Loaded DiceProceedings of the 9th Nordic Conference on Human-Computer Interaction10.1145/2971485.2971524(1-10)Online publication date: 23-Oct-2016
https://dl.acm.org/doi/10.1145/2971485.2971524
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten