Thematic organization of web content for distraction-free text-to-speech narration

ABSTRACT

People with visual disabilities, especially those who are blind, have digital content narrated to them by text-to-speech (TTS) engines (e.g., with the help of screen readers). Naively narrating web pages, particularly the ones consisting of several diverse pieces (e.g., news summaries, opinion pieces, taxonomy, ads), with TTS engines without organizing them into thematic segments will make it very difficult for the blind user to mentally separate out and comprehend the essential elements in a segment, and the effort to do so can cause significant cognitive stress. One can alleviate this difficulty by segmenting web pages into thematic pieces and then narrating each of them separately. Extant segmentation methods typically segment web pages using visual and structural cues. The use of such cues without taking into account the semantics of the content, tends to produce "impure" segments containing extraneous material interspersed with the essential elements. In this paper, we describe a new technique for identifying thematic segments by tightly coupling visual, structural, and linguistic features present in the content. A notable aspect of the technique is that it produces segments with very little irrelevant content. Another interesting aspect is that the clutter-free main content of a web page, that is produced by the Readability tool and the "Reader" feature of the Safari browser, emerges as a special case of the thematic segments created by our technique. We provide experimental evidence of the effectiveness of our technique in reducing clutter. We also describe a user study with 23 blind subjects of its impact on web accessibility.

References

1. Document object model (DOM) technical reports (http://www.w3.org/DOM/DOMTR). 2010.
2. x-path (http://www.w3.org/tr/xpath/). 2010.
3. Apple. Voiceover, screen reader from apple (http://www.apple.com/accessibility/voiceover). 2010.
4. Y. Borodin, F. Ahmed, M. A. Islam, Y. Puzis, V. Melnyk, S. Feng, I. V. Ramakrishnan, and G. Dausch. Hearsay: a new generation context-driven multi-modal assistive web browser. In WWW, 2010.
5. D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma. VIPS: a vision-based page segmentation algorithm. Microsoft Technical Report, (MSR-TR-2003-79), 2003.
6. D. Chakrabarti, R. Kumar, and K. Punera. A graph-theoretic approach to webpage segmentation. In WWW, pages 377--386, 2008.
7. D. Egnor. Document segmentation based on visual gaps. L.L.P. HARRITY and SNYDER, 2006.
8. G. H. Golub and W. Kahan. Calculating the singular values and pseudo-inverse of a matrix. Journal of the Society for Industrial and Applied Mathematics, pages 205--224, 1965.
9. H.-F. Guo, J. Mahmud, Y. Borodin, A. Stent, and I. V. Ramakrishnan. A general approach for partitioning web page content based on geometric and style information. In ICDAR, pages 929--933, 2007..
10. G. Hattori, K. Hoashi, K. Matsumoto, and F. Sugaya. Robust web page segmentation for mobile terminal using content-distances and page layout information. In WWW, pages 361--370, 2007.
11. M. A. Islam, F. Ahmed, Y. Borodin, and I. V. Ramakrishnan. Tightly coupling visual and linguistic features for enriching audio-based web browsing experience. In CIKM, 2011.
12. JAWS. (http://www.freedomscientific.com). 2010.
13. T. K. Landauer and S. T. Dumais. Latent semantic analysis. Scholarpedia, 3(11):43--56, 2008.
14. J. Mahmud, Y. Borodin, and I. V. Ramakrishnan. Csurf: a context driven non-visual web-browser. In WWW, pages 31--40, 2007.
15. C. D. Manning, P. Raghavan, and H. Schutze. Introduction to information retrieval. Cambridge University Press, 2008.
16. A. Pnueli, R. Bergman, S. Schein, and O. Barko. Web page layout via visual segmentation. (HPL-2009-160).
17. Readability. (https://www.readability.com). 2010.
18. G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Commun. ACM, 18(11):613--620, 1975.
19. A. Strehl. Relationship-based clustering and cluster ensembles for high-dimensional data mining. PhD thesis, The University of Texas at Austin, May 2002.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information retrieval