Evaluating the accessibility of line graphs through textual summaries for visually impaired users

ABSTRACT

This paper presents the methodology for generating textual summaries of line graphs in the SIGHT (Summarizing Information GrapHics Textually) system and the evaluation of line graph summaries produced by SIGHT. The system is designed to deliver the high-level knowledge conveyed by informational graphics present in online popular media articles (newspaper and magazines) to individuals who do not have visual access to the image. It works by producing and delivering a concise summary of the graph's content including the most important visual features present in the graphic. The system is briefly described; the evaluation compares the utility of the generated textual summaries to visually viewing the graphic in order to answer important questions about the line graph.

References

1. S. Carberry, S. Elzer, and S. Demir, "Information graphics: an untapped resource for digital libraries," in Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, New York, NY, USA, 2006, pp. 581--588.
2. S. Demir, S. Carberry, and K. F. McCoy, "Generating textual summaries of bar charts," in Proceedings of the Fifth International Natural Language Generation Conference, Stroudsburg, PA, USA, 2008, pp. 7--15.
3. P. Moraes, K. McCoy, and S. Carberry, "Adapting Graph Summaries to the Users' Reading Levels," in Proceedings of the 8th International Natural Language Generation Conference, 2014, p. Accepted for publication.
4. L. Rello and R. Baeza-Yates, "Evaluation of DysWebxia: A Reading App Designed for People with Dyslexia," in Proceedings of the 11th Web for All Conference, New York, NY, USA, 2014, pp. 10:1--10:10.
5. V. Ashok, Y. Borodin, S. Stoyanchev, Y. Puzis, and I. V. Ramakrishnan, "Wizard-of-Oz Evaluation of Speech-driven Web Browsing Interface for People with Vision Impairments," in Proceedings of the 11th Web for All Conference, New York, NY, USA, 2014, pp. 12:1--12:9.
6. J. L. Alty and D. Rigas, "Exploring the use of structured musical stimuli to communicate simple diagrams: the role of context," Int. J. Hum.-Comput. Stud., vol. 62, pp. 21--40, January 2005.
7. L. M. Brown and S. A. Brewster, "Drawing by ear: interpreting sonified line graphs," in In Proceedings of ICAD 2003, 2003, pp. 152--156.
8. R. F. Cohen and R. Yu, "PLUMB: Displaying Graphs to the Blind Using an Active Auditory Interface," in Proceedings of the 7th international ACM SIGACCESS Conference on Computers and Accessibility (ASSETS'05, 2005, pp. 182--183.
9. J. H. Flowers and T. A. Hauer, "Musical versus visual graphs: Cross-modal equivalence in perception of time series data," Human Factors, pp. 553--569, 1995.
10. D. K. McGookin and S. A. Brewster, "SoundBar: exploiting multiple views in multimodal graph browsing," in Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles, New York, NY, USA, 2006, pp. 145--154.
11. S. Wall and S. Brewster, "Feeling What You Hear: Tactile Feedback for Navigation of Audio Graphs," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA, 2006, pp. 1123--1132.
12. R. Ramloll, W. Yu, S. A. Brewster, B. Riedel, A. M. Burton, and G. Dimigen, "Constructive sonified haptic line graphs for the blind student: First steps," in Fourth International Conference on Assistive Technologies, 2000, pp. 31--41.
13. W. Yu and S. Brewster, "Comparing two haptic interfaces for multimodal graph rendering," in Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2002. HAPTICS 2002. Proceedings. 10th Symposium on, 2002, pp. 3--9.
14. W. Yu, R. Ramloll, and S. A. Brewster, "Haptic Graphs for Blind Computer Users," in Proceedings of the First International Workshop on Haptic Human-Computer Interaction, London, UK, UK, 2001, pp. 41--51.
15. A. R. Kennel, "Audiograf: a diagram-reader for the blind," in Proceedings of the second annual ACM conference on Assistive technologies, New York, NY, USA, 1996, pp. 51--56.
16. S. E. Krufka and K. E. Barner, "A user study on tactile graphic generation methods," Behaviour & Information Technology, vol. 25, pp. 297--311, 2006.
17. I. A. Doush, E. Pontelli, D. Simon, and O. Ma, "Making Microsoft Excel Accessible: Multimodal Presentation of Charts," in Proceedings of the Eleventh International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS 2009, Pittsburgh, PA, 2009.
18. C. Goncu and K. Marriott, "Tactile chart generation tool," in Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility, New York, NY, USA, 2008, pp. 255--256.
19. W. Yu, K. Kangas, and S. Brewster, "Web-based haptic applications for blind people to create virtual graphs," in Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings. 11th Symposium on, 2003, pp. 318--325.
20. Z. B. Fredj and D. A. Duce, "GraSSML: accessible smart schematic diagrams for all," Universal Access in the Information Society, vol. 6, pp. 233--247, 2007.
21. M. Kurze, "TDraw: a computer-based tactile drawing tool for blind people," in Proceedings of the second annual ACM conference on Assistive technologies, 1996, pp. 131--138.
22. L. Ferres, P. Verkhogliad, G. Lindgaard, L. Boucher, A. Chretien, and M. Lachance, "Improving Accessibility to Statistical Graphs: the inspectGraph System," in Proceedings of the Ninth International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), 2007.
23. L. Ferres, G. Lindgaard, L. Sumegi, and B. Tsuji, "Evaluating a Tool for Improving Accessibility to Charts and Graphs," ACM Trans. Comput.-Hum. Interact., vol. 20, pp. 28:1--28:32, November 2013.
24. S. Elzer, N. Green, S. Carberry, and J. Hoffman, "A Model of Perceptual Task Effort for Bar Charts and its Role in Recognizing Intention," International Journal on User Modeling and User-Adapted Interaction, vol. 16, pp. 1--30, 2006.
25. P. Wu, S. Carberry, S. Elzer, and D. Chester, "Recognizing the intended message of line graphs," in Proceedings of the 6th international conference on Diagrammatic representation and inference, Berlin, Heidelberg, 2010, pp. 220--234.
26. R. Burns, S. Carberry, and S. Elzer, "Visual and spatial factors in a bayesian reasoning framework for the recognition of intended messages in grouped bar charts," in Proceedings of the AAAI Workshop on Visual Representations and Reasoning, 2010, pp. 6--13.
27. P. Wu, S. Carberry, and S. Elzer, "Segmenting Line Graphs into Trends," in Proceedings of the Twelth International Conference on Artificial Intelligence, 2010, pp. 697--703.
28. C. Greenbacker, S. Carberry, and K. McCoy, "A Corpus of Human-written Summaries of Line Graphs," in Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop, Edinburgh, Scotland, 2011, pp. 23--27.
29. P. S. Moraes, S. Carberry, and K. McCoy, "Providing access to the high-level content of line graphs from online popular media," in Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, Rio de Janeiro, Brazil, 2013, pp. 11:1--11:10.
30. S. Demir, S. Carberry, and K. F. McCoy, "A discourse-aware graph-based content-selection framework," in Proceedings of the 6th International Natural Language Generation Conference, Stroudsburg, PA, USA, 2010, pp. 17--25.
31. L. Page, S. Brin, R. Motwani, and T. Winograd, "The PageRank Citation Ranking: Bringing Order to the Web," Stanford InfoLab, Technical Report 1999--66, November 1999.
32. M. Elhadad and J. Robin, "SURGE: a comprehensive plug-in syntactic realization component for text generation," Computational Linguistics, 1999.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

• Social and professional topics

  • Professional topics

    • Computing profession

      • Assistive technologies

  • User characteristics

    • People with disabilities