Information retrieval on the web

Abstract

In this paper we review studies of the growth of the Internet and technologies that are useful for information search and retrieval on the Web. We present data on the Internet from several different sources, e.g., current as well as projected number of users, hosts, and Web sites. Although numerical figures vary, overall trends cited by the sources are consistent and point to exponential growth in the past and in the coming decade. Hence it is not surprising that about 85% of Internet users surveyed claim using search engines and search services to find specific information. The same surveys show, however, that users are not satisfied with the performance of the current generation of search engines; the slow retrieval speed, communication delays, and poor quality of retrieved results (e.g., noise and broken links) are commonly cited problems. We discuss the development of new techniques targeted to resolve some of the problems associated with Web-based information retrieval and speculate on future trends.

References

1. ASSOCIATION FOR COMPUTING MACHINERY. 2000. SIGCHI: Special Interest Group on Computer- Human Interaction. Home page: www.acm. org/sigchi/]]
2. ASSOCIATION FOR COMPUTING MACHINERY. 2000. SI- GIR: Special Interest Group on Information Retrieval. Home page: www.acm.org/sigir/]]
3. AGOSTI,M.AND SMEATON, A. 1996. Information Retrieval and Hypertext. Kluwer Academic Publishers, Hingham, MA.]]
4. AGRAWAL, R., GEHRKE, J., GUNOPULOS, D., AND RAGHAVAN, P. 1998. Automatic subspace clustering of high dimensional data for data mining applications. In Proceedings of the ACM SIGMOD Conference on Management of Data (SIGMOD, Seattle, WA, June). ACM Press, New York, NY, 94-105.]]
5. AHLBERG,C.AND SHNEIDERMAN, B. 1994. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In Proceedings of the ACM Conference on Human Factors in Computing Systems: Celebrating Interdependence (CHI '94, Boston, MA, Apr. 24-28). ACM Press, New York, NY, 313-317.]]
6. AHLBERG,C.AND SHNEIDERMAN, B. 1997. The alphaslider: A compact and rapid and selector. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27), S. Pemberton, Ed. ACM Press, New York, NY.]]
7. AI MAG. 1997. Special issue on intelligent systems on the internet. AI Mag. 18,4.]]
8. ANDERBERG, M. R. 1973. Cluster Analysis for Applications. Academic Press, Inc., New York, NY.]]
9. ANICK,P.G.AND VAITHYANATHAN, S. 1997. Exploiting clustering and phrases for context-based information retrieval. SIGIR Forum 31,1, 314-323.]]
10. ASAKAWA, C. 1996. Enabling the visually disabled to use the www in a gui environment. IEICE Tech. Rep. HC96-29.]]
11. BACH, J., PAUL, S., AND JAIN, R. 1993. A visual information management system for the interactive retrieval of faces. IEEE Trans. Knowl. Data Eng. 5, 4, 619-628.]]
12. BAEZA-YATES, R. A. 1992. Introduction to data structures and algorithms related to information retrieval. In Information Retrieval: Data Structures and Algorithms, W. B. Frakes and R. Baeza-Yates, Eds. Prentice-Hall, Inc., Upper Saddle River, NJ, 13-27.]]
13. BAEZA-YATES,R.AND RIBEIRO-NETO, B. 1999. Modern Information Retrieval. Addison-Wesley, Reading, MA.]]
14. BALABANOVIC, M. 1997. An adaptive Web page recommendation service. In Proceedings of the First International Conference on Autonomous Agents (AGENTS '97, Marina del Rey, CA, Feb. 5-8), W. L. Johnson, Chair. ACM Press, New York, NY, 378-385.]]
15. BALABANOVIC,M.AND SHOHAM, Y. 1995. Learning information retrieval agents: Experiments with automated web browsing. In Proceedings of the 1995 AAAI Spring Symposium on Information Gathering from Heterogenous Distributed Environments (Stanford, CA, Mar.). AAAI Press, Menlo Park, CA.]]
16. BALABANOVIC, M., SHOHAM, Y., AND YUN, T. 1995. An adaptive agent for automated web browsing. Stanford Univ. Digital Libraries Project, working paper 1995-0023. Stanford University, Stanford, CA.]]
17. BALDONADO, M. 1997. An interactive, structuremediated approach to exploring information in a heterogeneous, distributed environment. Ph.D. Dissertation. Computer Systems Laboratory, Stanford Univ., Stanford, CA.]]
18. BALDONADO,M.Q.W.AND WINOGRAD, T. 1997. SenseMarker: an information-exploration interface supporting the contextual evolution of a user's interests. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27), S. Pemberton, Ed. ACM Press, New York, NY, 11-18.]]
19. BALLESTEROS,L.AND CROFT, W. B. 1998. Resolving ambiguity for cross-language retrieval. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Chairs. ACM Press, New York, NY, 64-71.]]
20. BARZILAI AND DAVIDSON. 1997. Computer-based electronic bid, auction and sale system, and a system to teach new/non-registered customers how bidding, auction purchasing works: U.S. Patent no. 60112045.]]
21. BEAUDOIN, L., PARENT, M.-A., AND VROOMEN,L.C. 1996. Cheops: A compact explorer for complex hierarchies. In Proceedings of the IEEE Conference on Visualization (San Francisco, CA, Oct. 27-Nov. 1), R. Yagel and G. M. Nielson, Eds. IEEE Computer Society Press, Los Alamitos, CA, 87ff.]]
22. BEDERSON,B.B.AND HOLLAN, J. D. 1994. Pad++: A zooming graphical interface for exploring alternate interface physics. In Proceedings of the 7th Annual ACM Symposium on User Interface Software and Technology (UIST '94, Marina del Rey, CA, Nov. 2-4), P. Szekely, Chair. ACM Press, New York, NY, 17-26.]]
23. BERENT, T., HURST, D., PATTON, T., TABERNIK, T., REIG,J.W.D.,AND WHITTLE, W. 1998. Electronic on-line motor vehicle auction and information system: U.S. Patent no. 5774873.]]
24. BERNERS-LEE, T., CAILLIAU, R., LUOTONEN, A., NIELSEN,H.F.,AND SECRET, A. 1994. The World-Wide Web. Commun. ACM 37, 8 (Aug.), 76-82.]]
25. BERRY,M.AND BROWN, M. 1999. Understanding Search Engines. SIAM, Philadelphia, PA.]]
26. BERRY,M.W.,DUMAIS,S.T.,AND O'BRIEN,G.W. 1995. Using linear algebra for intelligent information retrieval. SIAM Rev. 37, 4 (Dec.), 573-595.]]
27. BHARAT,K.AND BRODER, A. 1998. A technique for measuring the relative size and overlap of public web search engines. In Proceedings of the Seventh International Conference on World Wide Web 7 (WWW7, Brisbane, Australia, Apr. 14-18), P. H. Enslow and A. Ellis, Eds. Elsevier Sci. Pub. B. V., Amsterdam, The Netherlands, 379-388.]]
28. BOLLE, R., YEO, B.-L., AND YEUNG, M. 1998. Video query: Research directions. IBM J. Res. Dev. 42, 2 (Mar.), 233-251.]]
29. BORKO, H. 1979. Inter-indexer consistency. In Proceedings of the Cranfield Conference.]]
30. BOTAFOGO,R.A.,RIVLIN, E., AND SHNEIDERMAN,B. 1992. Structural analysis of hypertexts: Identifying hierarchies and useful metrics. ACM Trans. Inf. Syst. 10, 2 (Apr.), 142-180.]]
31. BRAKE, D. 1997. Lost in cyberspace. New Sci. Mag. www.newscientist.com/keysites/networld/ lost.html]]
32. BRIN,S.AND PAGE, L. 1998. The anatomy of a large-scale hypertextual Web search engine. Comput. Netw. ISDN Syst. 30, 1-7, 107-117.]]
33. BRODER,A.Z.,GLASSMAN,S.C.,MANASSE,M.S., AND ZWEIG, G. 1997. Syntactic clustering of the Web. Comput. Netw. ISDN Syst. 29, 8-13, 1157-1166.]]
34. BUSINESS WEEK. 1997. Special report on speech technologies. Business Week.]]
35. COMMUNICATIONS OF THE ACM. 1993. Special issue on the next generation GUIs. Commun. ACM.]]
36. COMMUNICATIONS OF THE ACM. 1994. Special issue on internet technology. Commun. ACM.]]
37. COMMUNICATIONS OF THE ACM. 1995. Special issues on digital libraries. Commun. ACM.]]
38. COMMUNICATIONS OF THE ACM. 1999. Special issues on knowledge discovery. Commun. ACM.]]
39. CARD, S., MACKINLAY, J., AND SHNEIDERMAN,B. 1999. Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers Inc., San Francisco, CA.]]
40. CARD,S.K.,ROBERTSON,G.G.,AND YORK, W. 1996. The WebBook and the Web Forager: an information workspace for the World-Wide Web. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '96, Vancouver, B.C., Apr. 13-18), M. J. Tauber, Ed. ACM Press, New York, NY, 111ff.]]
41. CARL, J. 1995. Protocol gives sites way to keep out the 'bots'. Web Week 1, 7 (Nov.).]]
42. CARRI~RE,J.AND KAZMAN, R. 1997. WebQuery: Searching and visualizing the Web through connectivity. In Proceedings of the Sixth International Conference on the World Wide Web (Santa Clara CA, Apr.).]]
43. CASTELLI, V., BERGMAN, L., KONTOYIANNINS, I., LI, C.-S., ROBINSON, J., AND TUREK, J. 1998. Progressive search and retrieval in large image archives. IBM J. Res. Dev. 42, 2 (Mar.), 253-268.]]
44. CATHRO, W. 1997. Matching discovery and recovery. In Proceedings of the Seminar on Standards Australia. www.nla.gov.au/staffpaper/cathro3.html]]
45. CHAKRABARTI, S., DOM, B., GIBSON, D., KUMAR, S., RAGHAVAN, P., RAJAGOPALAN,, S., AND TOMKINS, A. 1988. Experiments in topic distillation. In Proceedings of the ACM SIGIR Workshop on Hypertext Information Retrieval for the Web (Apr.). ACM Press, New York, NY.]]
46. CHAKRABARTI, S., DOM, B., RAGHAVAN, P., RAJAGO- PALAN, S., GIBSON, D., AND KLEINBERG, J. 1998. Automatic resource compilation by analyzing hyperlink structure and associated text. In Proceedings of the Seventh International Conference on World Wide Web 7 (WWW7, Brisbane, Australia, Apr. 14-18), P. H. Enslow and A. Ellis, Eds. Elsevier Sci. Pub. B. V., Amsterdam, The Netherlands, 65-74.]]
47. CHAKRABARTI,S.AND RAJAGOPALAN, S. 1997. Survey of information retrieval research and products. Home page: w3.almaden.ibm.com/ soumen/ir.html]]
48. CHALMERS,M.AND CHITSON, P. 1992. Bead: explorations in information visualization. In Proceedings of the 15th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '92, Copenhagen, Denmark, June 21-24), N. Belkin, P. Ingwersen, and A. M. Pejtersen, Eds. ACM Press, New York, NY, 330-337.]]
49. CHANDRASEKARAN, R. 1998. "Portals" offer one-stop surfing on the net. Int. Herald Tribune 19/21.]]
50. CHANG, S.-F. 1995. Compressed domain techniques for image/video indexing and manipulation. In Proceedings of the Conference on Information Processing.]]
51. CHO, J., GARCIA-MOLINA, H., AND PAGE, L. 1998. Efficient crawling through URL ordering. Comput. Netw. ISDN Syst. 30, 1-7, 161-172.]]
52. CLARK, D. 2000. Shopbots become agents for business change. IEEE Computer.]]
53. CLEVERDON, C. 1970. Progress in documentation. J. Doc. 26, 55-67.]]
54. CLIR. 1999. Cross-language information retrieval project, resource page. Tech. Rep. University of Maryland at College Park, College Park, MD.]]
55. COHEN, A. 1999. The attic of e. Time Mag.]]
56. COMPUT.NETW. ISDN SYST. 2000. World Wide Web conferences. 1995-2000. Comput. Netw. ISDN Syst. www.w3.org/Conferences/Overview- WWW.html]]
57. COOPER, W. 1969. Is interindexer consistency a hobgoblin? Am. Doc. 20, 3, 268-278.]]
58. CRANOR,L.F.AND LA MACCHIA, B. A. 1998. Spam! Commun. ACM 41,8,74-83.]]
59. CRESTANI, F., LALMAS, M., VAN RIJSBERGEN,C.J., AND CAMPBELL, I. 1998. Is this document relevant? Probably: A survey of probabilistic models in information retrieval. ACM Comput. Surv. 30, 4, 528-552.]]
60. CUNNINGHAM, M. 1997. Brewster's millions. Irish Times.www.irish-times.com/irish-times/paper/ 1997/0127/cmp1.html]]
61. CUTTING,D.R.,KARGER,D.R.,AND PEDERSEN,J. O. 1993. Constant interaction-time scatter/ gather browsing of very large document collections. In Proceedings of the 16th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '93, Pittsburgh, PA, June 27-July), R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM Press, New York, NY, 126-134.]]
62. DEERWESTER, S., DUMAI,S.T.,FURNAS,G.W., LANDAUER,T.K.,AND HARSHMAN, R. 1990. Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci. 41, 6, 391-407.]]
63. DEMMEL, J. W. 1997. Applied Numerical Linear Algebra. SIAM, Philadelphia, PA.]]
64. DHILLON,I.AND MOHDA, D. 1999. A data-clustering algorithm on distributed memory multiprocessors. In Proceedings of the Workshop on Large-Scale Parallel KDD Systems (ACM SIGKDD., Aug. 15-18). ACM Press, New York, NY.]]
65. DHILLON,I.AND MODHA, D. 2000. Concept decompositions for large sparse text data using clustering. Mach. Learn.]]
66. ECHIGO, T., KUROKAWA, M., TOMITA, A., TOMITA, A., MIYAMORI, AND IISAKU, S. 2000. Video enrichment: Retrieval and enhanced visualization based on behaviors of objects. In Proceedings of the Fourth Asian Conference on Computer Vision (ACCV2000, Jan. 8-11). 364-369.]]
67. EICHMANN, D., RUIZ,M.E.,AND SRINIVASAN,P. 1998. Cross-language information retrieval with the UMLS metathesaurus. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Chairs. ACM Press, New York, NY, 72-80.]]
68. ESTER, M., KRIEGEL, H.-S., SANDER, J., AND XU,X. 1995a. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the First International Conference on Knowledge Discovery and Data Mining (Montreal, Canada, Aug. 20-21).]]
69. ESTER, M., KRIEGEL, H.-S., AND XU, X. 1995b. A database interface for clustering in large spatial databases. In Proceedings of the First International Conference on Knowledge Discovery and Data Mining (Montreal, Canada, Aug. 20-21).]]
70. ESTER, M., KRIEGEL, H.-S., AND XU, X. 1995c. Focusing techniques for efficient class identification. In Proceedings of the Fourth International Symposium on Large Spatial Databases.]]
71. ETZIONI,O.AND WELD, D. 1995. Intelligent agents on the Internet: Fact, fiction and forecast. Tech. Rep. University of Washington, Seattle, WA.]]
72. FALOUTSOS, C. 1996. Searching Multimedia Databases by Content. Kluwer Academic Publishers, Hingham, MA.]]
73. FALOUTSOS,C.AND LIN, K. 1995. FastMap: A fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets. In Proceedings of the ACM SIGMOD Conference on Management of Data (ACM- SIGMOD, San Jose, CA, May). SIGMOD. ACM Press, New York, NY, 163-174.]]
74. FALOUTSOS,C.AND OARD, D. W. 1995. A survey of information retrieval and filtering methods. Univ. of Maryland Institute for Advanced Computer Studies Report. University of Maryland at College Park, College Park, MD.]]
75. FELDMAN, S. 1998. Web search services in 1998: Trends and challenges. Inf. Today 9.]]
76. FERGUSON, A. 1999. Auction nation. Time Mag.]]
77. FININ, T., NICHOLAS, C., AND MAYFIELD, J. 1998. Software agents for information retrieval (short course notes). In Proceedings of the Third ACM Conference on Digital Libraries (DL '98, Pittsburgh, PA, June 23-26), I. Witten, R. Akscyn, and F. M. Shipman, Eds. ACM Press, New York, NY.]]
78. FINKELSTEIN,A.AND SALESIN, D. 1995. Fast multiresolution image querying. In Proceedings of the ACM SIGGRAPH Conference on Visualization: Art and Interdisciplinary Programs (SIGGRAPH '95, Los Angeles, CA, Aug. 6-11), K. O'Connell, Ed. ACM Press, New York, NY, 277-286.]]
79. FISHER, D. 1995. Iterative optimization and simplification of hierarchical clusterings. Tech. Rep. Vanderbilt University, Nashville, TN.]]
80. FLICKNER, M., SAWHNEY, H., NIBLACK, W., ASHLEY, J., HUANG, Q., DOM, B., GORKANI, M., HAFNER, J., LEE, D., PETKOVIC, D., STEELE, D., AND YANKER, P. 1997. Query by image and video content: the QBIC system. In Intelligent Multimedia Information Retrieval, M. T. Maybury, Ed. MIT Press, Cambridge, MA, 7-22.]]
81. FLYNN, L. 1996. Desperately seeking surfers: Web programmers try to alter search engines' results. New York Times.]]
82. FRAKES,W.B.AND BAEZA-YATES, R., EDS. 1992. Information Retrieval: Data Structures and Algorithms. Prentice-Hall, Inc., Upper Saddle River, NJ.]]
83. FRISSE, M. E. 1988. Searching for information in a hypertext medical handbook. Commun. ACM 31, 7 (July), 880-886.]]
84. GILBERT, D. 1997. Intelligent agents: The right information at the right time. Tech. Rep. IBM Corp., Research Triangle Park, NC.]]
85. GLOOR,P.AND DYNES, S. 1998. Cybermap: Visually navigating the web. J. Visual Lang. Comput. 9, 3 (June), 319-336.]]
86. GOLUB,G.H.AND VAN LOAN, C. F. 1996. Matrix Computations. 3rd. Johns Hopkins studies in the mathematical sciences. Johns Hopkins University Press, Baltimore, MD.]]
87. GRAVANO, L. 1998. Querying multiple document collections across the Internet. Ph.D. Dissertation. Stanford University, Stanford, CA.]]
88. GUDIVADA, V., RAGHAVAN, V., GROSKY, W., AND KASAANAGOTTU, R. 1997. Information retrieval on the world wide web. IEEE Internet Comput. 1, 1 (May/June), 58-68.]]
89. GUGLIELMO, C. 1997. Upside today (on-line). home page: inc.com/cgi-bin/tech link.cgi?url=http:// www.upside.com.]]
90. GUHA, S., RASTOGI, R., AND SHIM, K. 1998. Cure: An efficient clustering algorithm for large databases. In Proceedings of the ACM SIG- MOD Conference on Management of Data (SIGMOD, Seattle, WA, June). ACM Press, New York, NY.]]
91. HAWKING, D., CRASWELL, N., THISTLEWAITE, P., AND HARMAN, D. 1999. Results and Challenges in Web Search Evaluation.]]
92. HEARST, M. A. 1995. TileBars: Visualization of term distribution information in full text information access. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '95, Denver, CO, May 7-11), I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. ACM Press/Addison-Wesley Publ. Co., New York, NY, 59-66.]]
93. HEARST, M. 1997. Interfaces for searching the web. Sci. Am., 68-72.]]
94. HEARST, M. 1999. User interfaces and visualization. In Modern Information Retrieval, R. Baeza-Yates and B. Ribeiro-Neto. Addison-Wesley, Reading, MA, 2257-3232.]]
95. HEARST,M.A.AND PEDERSEN, J. O. 1996. Visualizing information retrieval results: a demonstration of the TileBar interface. In Proceedings of the CHI '96 Conference Companion on Human Factors in Computing Systems: Common Ground (CHI '96, Vancouver, British Columbia, Canada, Apr. 13-18), M. J. Tauber, Ed. ACM Press, New York, NY, 394-395.]]
96. HENZINGER, M., HEYDON, A., MITZENMACHER, M., AND NAJORK, M. 1999. Measuring index quality using random walks on the web.]]
97. HERNANDEZ, M. 1996. A generalization of band joins and the merge/purge problem. Ph.D. Dissertation. Columbia Univ., New York, NY.]]
98. HOWE,A.AND DREILINGER, D. 1997. Savvysearch: A metasearch engine that learns which search engine to query. AI Mag. 18, 2, 19-25.]]
99. HUBERMAN,B.AND LUKOSE, R. 1997. A metasearch engine that learns which search engine to query. Science 277, 535-537.]]
100. HUBERMAN, B., PIROLLI, P., PITKOW, J., AND LU- KOSE, R. 1998. Strong regularities in world wide web surfing. Science 280, 95-97.]]
101. HYLTON, J. 1996. Identifying and merging related bibliographic records. Master's Thesis.]]
102. IEEE. 1999. Special issue on intelligent information retrieval. IEEE Expert.]]
103. IEEE. 1998a. News and trends section. IEEE Internet Comput.]]
104. IEEE. 1998b. Special issue on knowledge management. IEEE Expert.]]
105. IEEE. 1996a. Special issue on intelligent agents. IEEE Expert/Intelligent Systems and Their Applications.]]
106. IEEE. 1996b. Special issue on digital libraries: representation and retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 771-859.]]
107. IFIP. 1989. Visual Data Base Systems I and II. Elsevier North-Holland, Inc., Amsterdam, The Netherlands.]]
108. IWAI, Y., MARUO, J., YACHIDA, M., ECHIGO, T., AND IISAKU, S. 2000. A framework for visual event extraction from soccer games. In Proceedings of the Fourth Asian Conference on Computer Vision (ACCV2000, Jan. 8-11). 222-227.]]
109. JACOBY,J.AND SLAMECKA, V. 1962. Indexer consistency under minimal conditions. RADC TR 62--426. Documentation, Inc., Bethesda, MD, US.]]
110. KAGEYAMA,T.AND TAKASHIMA, Y. 1994. A melody retrieval method with hummed melody. IEICE Trans. Inf. Syst. J77, 8 (Aug.), 1543-1551.]]
111. KAHLE, B. 1999. Archiving the Internet. home page: www.alexa.com/ brewster/essays/sciam article.html]]
112. KEPHART, J., HANSON, J., LEVINE, D., GROSOF, B., SAIRAMESH, J., AND WHITE, R. S. 1998a. Emergent behavior in information economies.]]
113. KEPHART,J.O.,HANSON,J.E.,AND SAIRAMESH,J. 1998b. Price-war dynamics in a free-market economy of software agents. In Proceedings of the Sixth International Conference on Artificial Life (ALIFE, Madison, WI, July 26-30), C. Adami, R. K. Belew, H. Kitano, and C. E. Taylor, Eds. MIT Press, Cambridge, MA, 53- 62.]]
114. KLEINBERG, J. M. 1998. Authoritative sources in a hyperlinked environment. In Proceedings of the 1998 ACM-SIAM Symposium on Discrete Algorithms (San Francisco CA, Jan.). ACM Press, New York, NY.]]
115. KOBAYASHI, M., DUPRET, G., KING, O., SAMUKAWA, H., AND TAKEDA, K. 1999. Multi-perspective retrieval, ranking and visualization of web data. In Proceedings of the International Symposium on Digital Libraries ((ISDL99), Tsukuba, Japan). 159-162.]]
116. KORFHAGE, R. R. 1997. Information Storage and Retrieval. John Wiley and Sons, Inc., New York, NY.]]
117. KOSTER, M. 1995. Robots in the web: trick or treat? ConneXions 9, 4 (Apr.).]]
118. KOSTER, M. 1996. Examination of the standard for robots exclusion. home page: info.webcrawler- .com/mak/projects/robots/eval.html]]
119. KUROKAWA, M., ECHIGO, T., TOMITA, T., MAEDA, J., MIYAMORI, H., AND ISISAKU, S. 1999. Representation and retrieval of video scene by using object actions and their spatio-temporal relationships. In Proceedings of the International Conference on ICIP-Image Processing. IEEE Press, Piscataway, NJ.]]
120. LAGOZE, C. 1996. The Warwick framework: A container architecture for diverse sets of metadata. D-Lib Mag. www.dlib.org]]
121. LAMPING, J., RAO, R., AND PIROLLI, P. 1995. A focus1context technique based on hyperbolic geometry for visualizing large hierarchies. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '95, Denver, CO, May 7-11), I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. ACM Press/Addison-Wesley Publ. Co., New York, NY, 401-408.]]
122. LAWRENCE,S.AND GILES, C. 1998a. Context and page analysis for improved web search. IEEE Internet Comput. 2,4,38-46.]]
123. LAWRENCE,S.AND GILES, C. 1998b. Searching the world wide web. Science 280, 98-100.]]
124. LAWRENCE,S.AND GILES, C. 1999a. Accessibility of information on the web. Nature 400, 107-109.]]
125. LAWRENCE,S.AND GILES, C. 1999b. Searching the web: General and scientific information access. IEEE Commun. Mag. 37, 1, 116-122.]]
126. LAWRENCE,S.AND GILES, C. 1999c. Text and image metasearch on the web. In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA99). 829-835.]]
127. LEIGHTON,H.AND SRIVASTAVA, J. 1997. Precision among world wide web search engines: Altavista, excite, hotbot, infoseek, and lycos. home page: www.winona.msus.edu/library/webind2/ webind2.htm.]]
128. LETSCHE,T.AND BERRY, M. 1997. Large-scale information retrieval with latent semantic indexing: (submitted). Inf. Sci. Appl.]]
129. LIAO, H., OSADA, M., AND SHNEIDERMAN, B. 1992. A formative evaluation of three interfaces for browsing directories using dynamic queries. Tech. Rep. CS-TR-2841. Department of Computer Science, University of Maryland, College Park, MD.]]
130. LIBERATORE, K. 1997. Getting to the source: Is it real or spam, ma'am ? MacWorld.]]
131. LIDSKY,D.AND KWON, R. 1997. Searching the net. PC Mag., 227-258.]]
132. LIECHTI, O., SIFER,M.J.,AND ICHIKAWA, T. 1998. Structured graph format: XML metadata for describing Web site structure. Comput. Netw. ISDN Syst. 30, 1-7, 11-21.]]
133. LOSEE, R. M. 1998. Text Retrieval and Filtering: Analytic Models of Performance. Kluwer international series on information retrieval. Kluwer Academic Publishers, Hingham, MA.]]
134. LYNCH, C. 1997. Searching the Internet. Sci. Am., 52-56.]]
135. MAAREK,Y.S.,JACOVI, M., SHTALHAIM, M., UR, S., ZERNIK, D., AND BEN-SHAUL, I. Z. 1997. Web- Cutter: A system for dynamic and tailorable site mapping. Comput. Netw. ISDN Syst. 29, 8-13, 1269-1279.]]
136. MACSKASSY, S., BANERJEE, A., DAVISON, B., AND HIRSH, H. 1998. Human performance on clustering web pages: A preliminary study. In Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (Seattle, WA, June '98). 264-268.]]
137. MANBER, U. 1999. Foreword. In Modern Information Retrieval, R. Baeza-Yates and B. Ribeiro-Neto. Addison-Wesley, Reading, MA, 5-8.]]
138. MANBER, U., SMITH, M., AND GOPAL, B. 1997. Webglimpse: Combining borwsing and searching. In Proceedings on USENIX 1997 Annual Technical Conference (Jan.). 195-206.]]
139. MANJUNATH,B.S.AND MA, W. Y. 1996. Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 837-842.]]
140. MANNING,C.AND SCHUTZE, H. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA.]]
141. MARCHIONINI, G. 1995. Information Seeking in Electronic Environments. Cambridge Series on Human-Computer Interaction. Cambridge University Press, New York, NY.]]
142. MAYBURY, M. 1997. Intelligent Multmedia Information Retrieval. MIT Press, Cambridge, MA.]]
143. MAYBURY,M.T.AND WAHLSTER, W., EDS. 1998. Readings in Intelligent User Interfaces. Morgan Kaufmann Publishers Inc., San Francisco, CA.]]
144. MCKNIGHT, L. 2000. Pricing internet services: Approaches and challenges. IEEE Computer, 128-129.]]
145. MEREU,S.W.AND KAZMAN, R. 1996. Audio enhanced 3D interfaces for visually impaired users. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '96, Vancouver, B.C., Apr. 13-18), M. J. Tauber, Ed. ACM Press, New York, NY, 72-78.]]
146. MITCHELL, S. 1998. General internet resource finding tools. home pages: library.ucr.edu/pubs/ navigato.html]]
147. MIYAHARA,T,WATANABE, H., TAZOE, E., KAMIYAMA, Y., AND TAKEDA, K. 2000. Internet Machine Translation. Mainichi Communications, Japan.]]
148. MODHA,S.AND SPANGLER, W. 2000. Clustering hypertext with applications to web searching. In Proceedings of the Conference on Hypertext (May 30-June 3).]]
149. MONGE,A.AND ELKAN, C. 1998. An efficient domain-independent algorithm for detecting approximately duplicate database records. Tech. Rep. University of California at San Diego, La Jolla, CA.]]
150. MONIER, L. 1998. Altavista cto responds. www4.zdnet.com/anchordesk/talkback/talkback 13066.html.]]
151. MOROHASHI, M., TAKEDA, K., NOMIYAMA, H., AND MARUYAMA, H. 1995. Information outlining. In Proceedings of International Symposium on Digital Libraries (Tsukuba, Japan).]]
152. MUNZNER,T.AND BURCHARD, P. 1995. Visualizing the structure of the World Wide Web in 3D hyperbolic space. In Procedings of the Symposium on Virtual Reality Modeling Language (VRML '95, San Diego, CA, Dec. 14-15), D. R. Nadeau and J. L. Moreland, Chairs. ACM Press, New York, NY, 33-38.]]
153. NAGAO,K.AND HASIDA, K. 1998. Automatic text summarization based on the global document annotation. In Proceedings of the Conference on COLING-ACL.]]
154. NAGAO, K., HOSOYA, S., KAWAKITA, Y., ARIGA, S., SHIRAI, Y., AND YURA, J. 1999. Semantic transcoding: Making the world wide web more understandable and reusable by external annotations.]]
155. NAVARRO, G. 1998. Approximate text searching. Ph.D. Dissertation. Univ. of Chile, Santiago, Chile.]]
156. NG,R.AND HAN, J. 1994. Efficient and effective methods for spatial data mining. In Proceedings of the 20th International Conference on Very Large Data Bases (VLDB'94, Santiago, Chile, Sept.). VLDB Endowment, Berkeley, CA.]]
157. NIBLACK, W. 1993. The qbic project: Query by image by content using color, texture, and shape. In Proceedings of the Conference on Storage and Retrieval for Image and Video Databases. SPIE Press, Bellingham, WA, 173-187.]]
158. NIELSEN, J. 1993. Usability Engineering. Academic Press Prof., Inc., San Diego, CA.]]
159. NIELSEN, J. 1999. User interface directions for the Web. Commun. ACM 42, 1, 65-72.]]
160. NOMIYAMA, H., KUSHIDA, T., URAMOTO, N., IOKA, M., KUSABA, M., KUSABA, J.-K., CHIGONO, A., ITOH, T., AND TSUJI, M. 1997. Information navigation system for multimedia data. Res. Rep. RT-0227. Research Laboratory, IBM Tokyo, Tokyo, Japan.]]
161. OARD, D. 1997a. Cross-language text retrieval research in the USA. In Proceedings of the Third Delos Workshop on ERCIM (Mar.).]]
162. OARD, D. 1997b. Serving users in many languages. D-Lib Mag. 3, 1 (Jan.).]]
163. OARD, D. 1997c. Speech-based information retrieval for digital libraries. Tech. Rep. CS-TR-3778. University of Maryland at College Park, College Park, MD.]]
164. OARD,D.W.AND DORR, B. J. 1996. A survey of multilingual text retrieval. Tech. Rep UMIACS-TR-96-19. University of Maryland at College Park, College Park, MD.]]
165. OMIECINSKI,E.AND SCHEUERMANN, P. 1990. A parallel algorithm for record clustering. ACM Trans. Database Syst. 15, 4 (Dec.), 599-624.]]
166. OOGANE,T.AND ASAKAWA, C. 1998. An interactive method for accessing tables in HTML. In Proceedings of the Third International ACM Conference on Assistive Technologies (Assets '98, Marina del Rey, CA, Apr. 15-17), M. M. Blattner and A. I. Karshmer, Chairs. ACM Press, New York, NY, 126-128.]]
167. PARLETT, B. N. 1998. The Symmetric Eigenvalue Problem. Prientice-Hall SIAM Classics in Applied Mathematics Series. Prentice-Hall, Inc., Upper Saddle River, NJ.]]
168. PERKOWITZ,M.AND ETZIONI, O. 1999. Adaptive web sites: An ai challenge. Tech. Rep. University of Washington, Seattle, WA.]]
169. PIRKOLA, A. 1998. The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Chairs. ACM Press, New York, NY, 55-63.]]
170. PIROLLI, P., PITKOW, J., AND RAO, R. 1996. Silk from a sow's ear: extracting usable structures from the Web. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '96, Vancouver, B.C., Apr. 13- 18), M. J. Tauber, Ed. ACM Press, New York, NY, 118-125.]]
171. PLAISANT, C. 1994. Dynamic queries on a health statistics atlas. Tech. Rep. University of Maryland at College Park, College Park, MD.]]
172. PRESCHEL, B. 1972. Indexer consistency in perception of concepts and choice of terminology. Final Rep. Columbia Univ., New York, NY.]]
173. RAGHAVAN, P. 1997. Information retrieval algorithms: A survey. In Proceedings of the Symposium on Discrete Algorithms. ACM Press, New York, NY.]]
174. RAMAN, T. V. 1996. Emacspeak-a speech interface. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '96, Vancouver, B.C., Apr. 13-18), M. J. Tauber, Ed. ACM Press, New York, NY, 66- 71.]]
175. RAO, R., PEDERSEN,J.O.,HEARST,M.A.,MACKIN- LAY, J.D.,CARD,S.K.,MASINTER, L., HAL- VORSEN, P.-K., AND ROBERTSON, G. C. 1995. Rich interaction in the digital library. Commun. ACM 38, 4 (Apr.), 29-39.]]
176. RASMUSSEN, E. 1992. Clustering algorithms. In Information Retrieval: Data Structures and Algorithms, W. B. Frakes and R. Baeza-Yates, Eds. Prentice-Hall, Inc., Upper Saddle River, NJ, 419-442.]]
177. RATHA,N.K.,KARU, K., CHEN, S., AND JAIN,A.K. 1996. A real-time matching system for large fingerprint databases. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 799-813.]]
178. RENNISON, E. 1994. Galaxy of news: an approach to visualizing and understanding expansive news landscapes. In Proceedings of the 7th Annual ACM Symposium on User Interface Software and Technology (UIST '94, Marina del Rey, CA, Nov. 2-4), P. Szekely, Chair. ACM Press, New York, NY, 3-12.]]
179. RIVLIN, E., BOTAFOGO, R., AND SHNEIDERMAN,B. 1994. Navigating in hyperspace: designing a structure-based toolbox. Commun. ACM 37,2 (Feb.), 87-96.]]
180. ROBERTSON,G.G.,MACKINLAY,J.D.,AND CARD,S. K. 1991. Cone trees: Animated 3D visualizations of hierarchical information. In Proceedings of the Conference on Human Factors in Computing Systems: Reaching through Technology (CHI '91, New Orleans, LA, Apr. 27-May 2), S. P. Robertson, G. M. Olson, and J. S. Olson, Eds. ACM Press, New York, NY, 189-194.]]
181. SAKAIRI, T. 1999. A site map for visualizing both a web site's structure and keywords. In Proceedings of the IEEE Conference on System, Man, and Cybernetics (SMC '99). IEEE Computer Society Press, Los Alamitos, CA, 200- 205.]]
182. SALTON, G. 1969. A comparison between manual and automatic indexing methods. Am. Doc. 20, 1, 61-71.]]
183. SALTON, G. 1970. Automatic text analysis. Science 168, 335-343.]]
184. SALTON, G., ED. 1971. The Smart Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, Englewood Cliffs, NJ.]]
185. SALTON, G., ED. 1988. Automatic Text Processing. Addison-Wesley Series in Computer Science. Addison-Wesley Longman Publ. Co., Inc., Reading, MA.]]
186. SALTON,G.AND MCGILL, M. J. 1983. Introduction to Modern Information Retrieval. McGraw- Hill, Inc., Hightstown, NJ.]]
187. SAMET,H.AND SOFFER, A. 1996. MARCO: MAp Retrieval by COntent. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 783-798.]]
188. SCHATZ, B. 1997. Information retrieval in digital libraries: Bringing search to the net. Science 275, 327-334.]]
189. SCHAUBLE, P. 1997. Multimedia Information Retrieval: Content-Based Information Retrieval from Large Text and Audio Databases. Kluwer Academic Publishers, Hingham, MA.]]
190. SCIENTIFIC AMERICAN. 1997. The Internet: Fulfillling the promise: special report. Scientific American, Inc., New York, NY.]]
191. SELBERG,E.AND ETZIONI, O. 1995a. The metacrawler architecture for resource aggregation on the web. IEEE Expert.]]
192. SELBERG,E.AND ETZIONI, O. 1995b. Multiple service search and comparison using the metacrawler. In Proceedings of the Fourth International Conference on The World Wide Web (Boston, MA).]]
193. SHAKES, J., LANGHEINRICH, M., AND ETZIONI,O. 1997. Dynamic reference sifting: A case study in the homepage domain. In Proceedings of the Conference on The World Wide Web. 189- 200.]]
194. SHIVAKUMAR,N.AND GARCIA-MOLINA, H. 1998. Finding near-replicas of documents on the web. In Proceedings of the Workshop on Web Databases (Valencia, Spain, Mar.).]]
195. SHNEIDERMAN, B. 1994. Dynamic queries for visual information seeking. Tech. Rep. CS-TR-3022. University of Maryland at College Park, College Park, MD.]]
196. SHNEIER,M.AND ABDEL-MOTTALEB, M. 1996. Exploiting the JPEG compression scheme for image retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 18, 8, 849-853.]]
197. SILBERSCHATZ, A., STONEBRAKER, M., AND ULLMAN, J. 1995. Database research: Achievements and opportunities into the 21st century. In Proceedings of the NSF Workshop on The Future of Database Research (May).]]
198. SMALL, H. 1973. Co-citation in the scientific literature: a new measure of the relationship between two documents. J. Am. Soc. Inf. Sci. 24, 265-269.]]
199. SMITH,J.R.AND CHANG, S.-F. 1996. VisualSEEk: A fully automated content-based image query system. In Proceedings of the Fourth ACM International Conference on Multimedia (Multimedia '96, Boston, MA, Nov. 18-22), P. Aigrain, W. Hall, T. D. C. Little, and V. M. Bove, Chairs. ACM Press, New York, NY, 87-98.]]
200. SMITH,J.R.AND CHANG, S.-F. 1997a. Querying by color regions using VisualSEEk content-based visual query system. In Intelligent Multimedia Information Retrieval, M. T. Maybury, Ed. MIT Press, Cambridge, MA, 23-41.]]
201. SMITH,J.AND CHANG, S.-F. 1997b. Searching for images and videos on the world-wide web. IEEE MultiMedia.]]
202. SMITH, Z. 1973. The truth about the web: Crawling towards eternity. Web Tech. Mag. www.webtechniques. com/features/1997/05/burner/burner. html]]
203. SMOLIAR,S.W.AND ZHANG, H. 1994. Contentbased video indexing and retrieval. IEEE MultiMedia 1, 2 (Summer), 62-72.]]
204. SNEATH,P.H.A.AND SOKAL, R. R. 1973. Numerical Taxonomy. Freeman, London, UK.]]
205. SOERGEL, D. 1985. Organizing Information: Principles of Data Base and Retrieval Systems. Academic Press library and information science series. Academic Press Prof., Inc., San Diego, CA.]]
206. SOFFER,A.AND SAMET, H. 2000. Pictorial query specification for browsing through spatiallyreferenced image databases. J. Visual Lang. Comput.]]
207. SPARCK JONES,K.AND WILLETT, P., EDS. 1997. Readings In Information Retrieval. Morgan Kaufmann multimedia information and systems series. Morgan Kaufmann Publishers Inc., San Francisco, CA.]]
208. STOLFO,S.AND HERNANDEZ, M. 1995. The merge/ purge problem for large databases. In Proceedings of the ACM SIGMOD Conference on Management of Data (San Jose, CA, May). 127-138.]]
209. STRATEGYALLEY. 1998. White paper on the viability of the internet for business. home page: www.strategyalley.com/articles/inet1.htm.]]
210. STRZALKOWSKI, T. 1999. Natural Language Information Retreival. Kluwer Academic Publishers, Hingham, MA.]]
211. TAKEDA,K.AND NOMIYAMA, H. 1997. Information outlining and site outlining. In Proceedings of the International Symposium on Digital Libraries (ISDL97, Tsukuba, Japan).]]
212. TETRANET SOFTWARE INC. 1998. Wisebot. Home page for Wisebots: www.tetranetsoftware.com/ products/wisebot.htm]]
213. TUFTE, E. R. 1986. The Visual Display of Quantitative Information. Graphics Press, Cheshire, CT.]]
214. VAN RIJSBERGEN, C. 1977. A theoretical basis for the use of cooccurrence data in information retrieval. J. Doc. 33,2.]]
215. VAN RIJSBERGEN, C. 1979. Information Retrieval. 2nd ed. Butterworths, London, UK.]]
216. WALKER, J., CASE, T., JORASCH, J., AND SPARICO,T. 1996. Method, apparatus, and program for pricing, selling, and exercising options to purchase airline tickets: U.S. Patent no. 5797127.]]
217. WALKER, J., SPARICO, T., AND CASE, T. 1997. Method and apparatus for the sale of airline-specified flight tickets: U.S. Patent no. 5897620.]]
218. WATANABE,H.AND TAKEDA, K. 1998. A patternbased machine translation system extended by example-based processing. In Proceedings of the Conference on COLING-ACL. 1369- 1373.]]
219. WEBSTER,K.AND PAUL, K. 1996. Beyond surfing: Tools and techniques for searching the web. home page: magi.com/mmelick/it96jan.htm.]]
220. WESTERA, G. 1996. Robot-driven search engine evaluation overview. www.curtin.edu.au/curtin/ library/staffpages/gwpersonal/senginestudy/.]]
221. WHITE,H.AND MCCAIN, K. 1989. Bibliometrics. Annual Review Information Science and Technology.]]
222. WILLETT, P. 1988. Recent trends in hierarchic document clustering: a critical review. Inf. Process. Manage. 24, 5 (), 577-597.]]
223. WILLIAMS, M. 1984. What makes rabbit run? Int. J. Man-Mach. Stud. 2a, 1, 333-352.]]
224. WILLIAMSON,C.AND SHNEIDERMAN, B. 1992. The dynamic HomeFinder: Evaluating dynamic queries in a real-estate information exploration system. In Proceedings of the 15th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '92, Copenhagen, Denmark, June 21-24), N. Belkin, P. Ingwersen, and A. M. Pejtersen, Eds. ACM Press, New York, NY, 339-346.]]
225. WISE, J., THOMAS, J., PENNOCK, K., LANTRIP, D., POTTIER, M., AND SCHUR, A. 1995. Visualizing the non-visual: spatial analysis and interaction with information from text documents. In Proceedings of the IEEE Conference on Information Visualization. IEEE Computer Society Press, Los Alamitos, CA, 51-58.]]
226. WITTEN,I.H.,MOFFAT, A., AND BELL, T. C. 1994. Managing Gigabytes: Compressing and Indexing Documents and Images. Van Nostrand Reinhold Co., New York, NY.]]
227. WU,J.K.AND NARASIMHALU, A. D. 1994. Identifying faces using multiple retrievals. IEEEMulti- Media 1, 2 (Summer), 27-38.]]
228. ZAMIR,O.AND ETZIONI, O. 1998. Web document clustering: A feasibility demonstration. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Chairs. ACM Press, New York, NY, 46-54.]]
229. ZAMIR, O., ETZIONI, O., MADANI, O., AND KARP,R. 1997. Fast and intuitive clustering of web documents. In Proceedings of the ACM SIG- MOD International Workshop on Data Mining and Knowledge Discovery (SIGMOD-96, Aug.), R. Ng, Ed. ACM Press, New York, NY, 287- 290.]]
230. ZHANG, T., RAMAKRISHNAN, R., AND LIVNY, M. 1996. Birch: An efficient data clustering method for large databases. In Proceedings of the ACM- SIGMOD Conference on Management of Data (Montreal, Canada, June). ACM, New York, NY.]]
231. ZHONG,D.AND CHANG, S.-F. 1997. Video object model and segmentation for content-based video indexing. In Proceedings of the International Conference on Circuits and Systems. IEEE Computer Society Press, Los Alamitos, CA.]]

Index Terms

• Computing methodologies

  • Symbolic and algebraic manipulation

    • Symbolic and algebraic algorithms

      • Linear algebra algorithms

• Information systems

  • Information retrieval

    • Document representation

    • Information retrieval query processing

    • Retrieval models and ranking

    • Retrieval tasks and goals

      • Clustering and classification

  • Information systems applications

    • Data mining

      • Clustering

• Mathematics of computing

  • Mathematical analysis

    • Numerical analysis

      • Computations on matrices

      • Interpolation