skip to main content
10.1145/1168987.1169000acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
Article

Dynamically adapting GUIs to diverse input devices

Published: 23 October 2006 Publication History

Abstract

Many of today's desktop applications are designed for use with a pointing device and keyboard. Someone with a disability, or in a unique environment, may not be able to use one or both of these devices. We have developed an approach for automatically modifying desktop applications to accommodate a variety of input alternatives as well as a demonstration implementation, the Input Adapter Tool (IAT). Our work is differentiated from past work by our focus on input adaptation (such as adapting a paint program to work without a pointing device) rather than output adaptation (such as adapting web pages to work on a cellphone). We present an analysis showing how different common interactive elements and navigation techniques can be adapted to specific input modalities. We also describe IAT, which supports a subset of these adaptations, and illustrate how it adapts different inputs to two applications, a paint program and a form entry program.

References

[1]
Apple Computer Inc. Macintosh Human Interface Guidelines. Addison-Wesley Professional, 1982.
[2]
L. Berry, L. Bartram, and K. S. Booth. Role-based control of shared application views. Proceedings of UIST, pages 23--32, 2005.
[3]
W. A. S. Buxton. A three-state model of graphical input. Proceedings of INTERACT, pages 449--456, 1990.
[4]
O. Buyukkokten, H. Garcia-Molina, A. Paepcke, and T. Winograd. Power browser: Efficient web browsing for PDAs. Proceedings of CHI, pages 430--437, 2000.
[5]
S. K. Card, J. D. Mackinlay, and G. G. Robertson. A morphological analysis of the design space of input devices. ACM Transactions on Information Systems, 9(2), pages 99--122, 1991.
[6]
B. W. Chang, J. D. Mackinlay, P. T. Zellweger, and T. Igarashi. A negotiation architecture for fluid documents. Proceedings of UIST, pages 123--132, 1998.
[7]
L. Dai, R. Goldman, A. Sears, and J. Lozier. Speech-based cursor control: a study of grid-based solutions. Proceedings of ASSETS, pages 94--101, 2004.
[8]
J. Dan R. Olsen, S. E. Hudson, T. Verratti, J. M. Heiner, and M. Phelps. Implementing interface attachments based on surface representations. Proceedings of CHI, pages 191--198, 1999.
[9]
W. K. Edwards and E. D. Mynatt. An architecture for transforming graphical interfaces. Proceedings of UIST, pages 39--47, 1994.
[10]
P. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47(6), pages 381--391, 1954.
[11]
J. D. Foley, V. L. Wallace, and P. Chan. The human factors of computer graphics interaction techniques. IEEE Computer Graphics Applications, 4(11), pages 13--48, 1984.
[12]
S. Jul. From Brains to Branch Points: Cognitive Constraints in Navigational Design. PhD thesis, University of Michigan, 2004.
[13]
H. M. Kamel and J. A. Landay. Sketching images eyes-free: A grid-based dynamic drawing tool for the blind. Proceedings of ASSETS 2002, pages 33--40, 2002.
[14]
D. Knuth. The Art of Computer Programming, Volume 1: Fundamental Algorithms. Addison-Wesley Professional, 1982.
[15]
J. Mankoff, A. K. Dey, U. Batra, and M. Moore. Web accessibility for low bandwidth input. Proceedings of ASSETS, pages 17--24, 2002.
[16]
Y. Mihara, E. Shibayama, and S. Takahashi. The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations. Proceedings of ASSETS, pages 76--83, 2005.
[17]
M. Moore, P. Kennedy, E. Mynatt, and J. Mankoff. Nudge and shove: frequency thresholding for navigation in direct brain-computer interfaces. Proceedings of CHI, pages 361--362, 2001.
[18]
B. A. Myers. Using hand-held devices and PCs together. Communications of the ACM, 44(11), pages 34--41, 2001.
[19]
A. Newell and P. Gregor. Human computer interaction for people with disabilities. Handbook of Human-Computer Interaction, pages 813--824. Elsevier Science Publishers, 1988.
[20]
J. Nichols, B. A. Myers, M. Higgins, J. Hughes, T. K. Harris, R. Rosenfeld, and M. Pignol. Generating remote control interfaces for complex appliances. Proceedings of UIST, pages 161--170, 2002.
[21]
D. R. Olsen and T. Nielsen. Laser pointer interaction. Proceedings of CHI 2001, pages 17--22, 2001.
[22]
D. R. Olsen, Jr., S. Jefferies, T. Nielsen, W. Moyes,and P. Fredrickson. Cross-modal interaction using XWeb. Proceedings of UIST 2000, pages 191--200, 2000.
[23]
N. G. Scott and I. Gingras. The Total Access system. Proceedings of CHI, pages 13--14, 2001.
[24]
J. Wang and J. Mankoff. Theoretical and architectural support for input device adaptation. Proceedings of CUU, pages 85--92, 2003.

Cited By

View all
  • (2024)AccessTeleopKit: A Toolkit for Creating Accessible Web-Based Interfaces for Tele-Operating an Assistive RobotProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676355(1-12)Online publication date: 13-Oct-2024
  • (2024)Customizing Tele-Operation Interfaces of Assistive Robots at Home with Occupational TherapistsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638359(142-144)Online publication date: 11-Mar-2024
  • (2023)Evaluating Customization of Remote Tele-operation Interfaces for Assistive Robots2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309395(1633-1640)Online publication date: 28-Aug-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
October 2006
316 pages
ISBN:1595932909
DOI:10.1145/1168987
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. interaction techniques
  3. toolkits

Qualifiers

  • Article

Conference

ASSETS06
Sponsor:

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Upcoming Conference

ASSETS '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)AccessTeleopKit: A Toolkit for Creating Accessible Web-Based Interfaces for Tele-Operating an Assistive RobotProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676355(1-12)Online publication date: 13-Oct-2024
  • (2024)Customizing Tele-Operation Interfaces of Assistive Robots at Home with Occupational TherapistsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638359(142-144)Online publication date: 11-Mar-2024
  • (2023)Evaluating Customization of Remote Tele-operation Interfaces for Assistive Robots2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309395(1633-1640)Online publication date: 28-Aug-2023
  • (2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
  • (2022)Engineering the Transition of Interactive Collaborative Software from Cloud Computing to Edge ComputingProceedings of the ACM on Human-Computer Interaction10.1145/35322106:EICS(1-31)Online publication date: 17-Jun-2022
  • (2022)CandyFly: Bringing fun to drone pilots with disabilities through adapted and adaptable interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517568(1-13)Online publication date: 29-Apr-2022
  • (2022)Maptimizer: Using Optimization to Tailor Tactile Maps to Users NeedsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517436(1-15)Online publication date: 29-Apr-2022
  • (2021)Cursor-based Robot Tele-manipulation through 2D-to-SE2 Interfaces2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS51168.2021.9636008(4230-4237)Online publication date: 27-Sep-2021
  • (2019)Improving Pointing in Graphical User Interfaces for People With Motor Impairments Through Ability-Based DesignHuman Performance Technology10.4018/978-1-5225-8356-1.ch059(1193-1243)Online publication date: 2019
  • (2019)Improving User Experience of Eye Tracking-Based InteractionACM Transactions on Computer-Human Interaction10.1145/333884426:6(1-46)Online publication date: 2-Nov-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media