ABSTRACT
Images on the Web present a major accessibility issue for the visually impaired, mainly because the majority of them do not have proper captions. This paper addresses the problem of attaching proper explanatory text descriptions to arbitrary images on the Web. To this end, we introduce Phetch, an enjoyable computer game that collects explanatory descriptions of images. People play the game because it is fun, and as a side effect of game play we collect valuable information. Given any image from the World Wide Web, Phetch can output a correct annotation for it. The collected data can be applied towards significantly improving Web accessibility. In addition to improving accessibility, Phetch is an example of a new class of games that provide entertainment in exchange for human processing power. In essence, we solve a typical computer vision problem with HCI tools alone.
- von Ahn, L., and Dabbish, L. Labeling Images with a Computer Game. In ACM Conference on Human Factors in Computing Systems (CHI), 2004, pp 319--326. Google ScholarDigital Library
- Brill, E., Dumais, S., and Banko, M. An Analysis of the AskMSR Question-Answering System. Proceedings of the Conference on Empirical Methods in Natural Language Processing, 2002. Google ScholarDigital Library
- National Organization on Disability Website. http://www.nod.org/Google Scholar
- Stork, D. G. The Open Mind Initiative. IEEE Intelligent Systems & Their Applications, 14-3, 1999, pages 19--20.Google Scholar
- Watchfire Corporation Website. http://watchfire.com.Google Scholar
Index Terms
- Improving accessibility of the web with a computer game
Recommendations
Labeling images with a computer game
CHI '04: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe introduce a new interactive system: a game that is fun and can be used to create valuable output. When people play the game they help determine the contents of images by providing meaningful labels for them. If the game is played as much as popular ...
Interdependent components of web accessibility
W4A '05: Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A)Increasingly, the Web is providing unprecedented access to information and interaction for people with disabilities. However, the Web will not be equally accessible, allowing people with disabilities to access and contribute to the Web, until:• ...
Game Accessibility: Enabling Everyone to Play
There is a growing push to make computer games accessible to the disabled.
Comments