Article

A new approach to haptic augmentation of the GUI

Authors:

Thomas N. Smyth,

Arthur E. KirkpatrickAuthors Info & Claims

ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Pages 372 - 379

https://doi.org/10.1145/1180995.1181064

Published: 02 November 2006 Publication History

Get Access

Abstract

Most users do not experience the same level of fluency in their interactions with computers that they do with physical objects in their daily life. We believe that much of this results from the limitations of unimodal interaction. Previous efforts in the haptics literature to remedy those limitations have been creative and numerous, but have failed to produce substantial improvements in human performance. This paper presents a new approach, whereby haptic interaction techniques are designed from scratch, in explicit consideration of the strengths and weaknesses of the haptic and motor systems. We introduce a haptic alternative to the tool palette, called Pokespace, which follows this approach. Two studies (6 and 12 participants) conducted with Pokespace found no performance improvement over a traditional interface, but showed that participants learned to use the interface proficiently after about 10 minutes, and could do so without visual attention. The studies also suggested several improvements to our design.

References

[1]

M. Akamatsu, I. S. MacKenzie, and T. Hasbrouq. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38:816--827, 1995.

Crossref

Google Scholar

[2]

N. L. Bernstein, D. A. Lawrence, and L. Y. Pao. Design of a uniactuated bimanual haptic interface. In Proceedings of IEEE HAPTICS 2003, pages 310--317, 2003.

Digital Library

Google Scholar

[3]

J. T. Dennerlein, D. B. Martin, and C. Hasser. Force-feedback improves performance for steering and combined steering-targeting tasks. In Proceedings of ACM CHI 2000, pages 423--429, 2000.

Digital Library

Google Scholar

[4]

F. L. Engel, P. Goossens, and R. Haakma. Improved efficiency through I- and E-feedback: A trackball with contextual force feedback. International Journal of Human-Computer Studies, 41(6):949--974, 1994.

Digital Library

Google Scholar

[5]

J. Grosjean, J. M. Burkhardt, S. Coquillart, and P. Richard. Evaluation of the Command and Control Cube. In Proceedings of ICMI 2002, pages 473--478, 2002.

Digital Library

Google Scholar

[6]

R. Komerska and C. Ware. Haptic task constraints for 3D interaction. In Proceedings of IEEE HAPTICS 2003, pages 270--277, 2003.

Digital Library

Google Scholar

[7]

R. Komerska and C. Ware. A study of haptic linear and pie menus in a 3D fish tank VR environment. In Proceedings of IEEE HAPTICS 2004, pages 224--231, 2004.

Digital Library

Google Scholar

[8]

G. Kurtenbach, T. P. Moran, and W. Buxton. Contextual animation of gestural commands. Computer Graphics Forum, 13(5):305--314, 1994.

Crossref

Google Scholar

[9]

K. MacLean and M. Enriquez. Perceptual design of haptic icons. In Proceedings of Eurohaptics 2003, Dublin, Ireland, 2003. 13 pages.

Google Scholar

[10]

T. Miller and R. Zeleznik. An insidious haptic invasion: Adding force feedback to the X desktop. In Proceedings of ACM UIST 1998, pages 59--64, 1998.

Digital Library

Google Scholar

[11]

T. Miller and R. Zeleznik. An insidious haptic invasion: Adding force feedback to the X desktop. In Proceedings of ACM UIST 1998, pages 59--64, 1998.

Digital Library

Google Scholar

[12]

I. Oakley, S. A. Brewster, and P. D. Gray. Solving multi-target haptic problems in menu interaction. In Extended Abstracts of ACM CHI 2001, pages 357--358, 2001.

Digital Library

Google Scholar

[13]

I. Oakley, M. McGee, S. Brewster, and P. Gray. Putting the feel in 'look and feel'. In Proceedings of ACM CHI 2000, pages 415--422, 2000.

Digital Library

Google Scholar

[14]

T. N. Smyth and A. E. Kirkpatrick. Haptic constraints for a bimanual command and location selection task. In Proceedings of Eurohaptics 2006, 2006. 6 pages.

Google Scholar

Cited By

View all

Shim YPark KLee SSon JWoo TLee GIqbal SMacLean KChevalier FMueller S(2020)FS-PadProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415850(938-950)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415850
Eren ABurnett GLarge DHarvey C(2018)Understanding the effects of peripheral vision and muscle memory on in‐vehicle touchscreen interactionsIET Intelligent Transport Systems10.1049/iet-its.2017.022912:6(434-439)Online publication date: May-2018
https://doi.org/10.1049/iet-its.2017.0229
MacLean KSchneider OSeifi H(2017)Multisensory haptic interactionsThe Handbook of Multimodal-Multisensor Interfaces10.1145/3015783.3015788(97-142)Online publication date: 24-Apr-2017
https://dl.acm.org/doi/10.1145/3015783.3015788
Show More Cited By

Index Terms

A new approach to haptic augmentation of the GUI
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

A Survey on Haptic Technologies for Mobile Augmented Reality
Augmented reality (AR) applications have gained much research and industry attention. Moreover, the mobile counterpart—mobile augmented reality (MAR) is one of the most explosive growth areas for AR applications in the mobile environment (e.g., ...
Envisioning Haptic Design for Immersive Virtual Environments
DIS' 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems Conference

Current techniques for haptics in immersive virtual environments (IVEs) allow users to perceive materials while exploring virtual surfaces. However, these experiences are usually restricted to the properties defined during the design phase of the IVE. ...
Stiffness modulation for Haptic Augmented Reality: Extension to 3D interaction
HAPTIC '10: Proceedings of the 2010 IEEE Haptics Symposium

Haptic Augmented Reality (AR) allows a user to touch a real environment augmented with synthetic haptic stimuli. For example, medical students can palpate a virtual tumor inside a real mannequin using a haptic AR system to practice cancer detection. To ...

Comments

Information & Contributors

Information

Published In

ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

November 2006

404 pages

ISBN:159593541X

DOI:10.1145/1180995

General Chairs:
Francis Quek
Virginia Tech, USA
,
Jie Yang
Carnegie Mellon University, USA
,
Program Chairs:
Dominic Massaro
University of California, Santa Cruz, USA
,
Abeer Alwan
University of California, Los Angeles, USA
,
Timothy J. Hazen
Massachusetts Institute of Technology, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI06

Sponsor:

ICMI06: 8th International Conference on Multimodal Interfaces 2006

November 2 - 4, 2006

Alberta, Banff, Canada

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
583
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shim YPark KLee SSon JWoo TLee GIqbal SMacLean KChevalier FMueller S(2020)FS-PadProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415850(938-950)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415850
Eren ABurnett GLarge DHarvey C(2018)Understanding the effects of peripheral vision and muscle memory on in‐vehicle touchscreen interactionsIET Intelligent Transport Systems10.1049/iet-its.2017.022912:6(434-439)Online publication date: May-2018
https://doi.org/10.1049/iet-its.2017.0229
MacLean KSchneider OSeifi H(2017)Multisensory haptic interactionsThe Handbook of Multimodal-Multisensor Interfaces10.1145/3015783.3015788(97-142)Online publication date: 24-Apr-2017
https://dl.acm.org/doi/10.1145/3015783.3015788
Arda Aydin MCagiltay NOzcelik ETuner ESahin HTokdemir G(2015)GUIs with Haptic InterfacesHuman-Computer Interaction: Interaction Technologies10.1007/978-3-319-20916-6_15(153-164)Online publication date: 21-Jul-2015
https://doi.org/10.1007/978-3-319-20916-6_15
Strachan SWiertlewski MZophoniasson HAnastassova M(2013)ViPong: Probabilistic haptic feedback for eyes-free interaction2013 World Haptics Conference (WHC)10.1109/WHC.2013.6548407(193-198)Online publication date: Apr-2013
https://doi.org/10.1109/WHC.2013.6548407
Levesque VOram LMacLean KCockburn AMarchuk NJohnson DColgate JPeshkin MTan DFitzpatrick GGutwin CBegole BKellogg W(2011)Enhancing physicality in touch interaction with programmable frictionProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1978942.1979306(2481-2490)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1978942.1979306
Schenck KZadeh M(2010)Haptic enhanced tutorials: Using haptic cues to increase visual attention2010 IEEE International Symposium on Haptic Audio Visual Environments and Games10.1109/HAVE.2010.5623961(1-4)Online publication date: Oct-2010
https://doi.org/10.1109/HAVE.2010.5623961
Chu GMoscovich TBalakrishnan RGooch ATory M(2009)Haptic conviction widgetsProceedings of Graphics Interface 200910.5555/1555880.1555926(207-210)Online publication date: 25-May-2009
https://dl.acm.org/doi/10.5555/1555880.1555926
MacLean K(2009)Putting Haptics into the AmbienceIEEE Transactions on Haptics10.1109/TOH.2009.332:3(123-135)Online publication date: 1-Jul-2009
https://dl.acm.org/doi/10.1109/TOH.2009.33
Vanacken LGrossman TConinx K(2009)Multimodal selection techniques for dense and occluded 3D virtual environmentsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2008.09.00167:3(237-255)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1016/j.ijhcs.2008.09.001
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A Survey on Haptic Technologies for Mobile Augmented Reality

Envisioning Haptic Design for Immersive Virtual Environments

Stiffness modulation for Haptic Augmented Reality: Extension to 3D interaction

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations