Information retrieval in a peer-to-peer environment

ABSTRACT

Due to rapid information growth, peer-to-peer (P2P) systems have become a promising alternative to centralized, client/server-based approaches for large-scale data sharing. By allowing peers to join and leave the system freely, they offer the peers autonomy to control their own resources, high scalability and high robustness against single-peer failures. P2P systems have many applications. This paper focuses on peer-to-peer information retrieval (P2PIR), which aims to retrieve textual documents based on their contents and ranks them based on some relevance measures against the query. The "open nature" of P2P systems and their lack of centralized control pose difficult challenges to the search capability and performance of P2PIR systems.In this paper, we study the recent works on P2P information retrieval, introduce our current research, discuss a few open problems that have not been studied in great depth and propose some future directions for information retrieval research in a P2P environment.

REFERENCES

• 1: E. Adar, B. A. Huberman, Free Riding on Gnutella. Technical report. Xerox PARC, 10 Aug. 2000.
• 2: M. Bawa, H. Garcia-Molina, A. Gionis, R. Motwani, Estimating Aggregates on a Peer-to-Peer Network, Technical Report, Computer Science Department, Stanford University, 2003.
• 3: Ashwin R. Bharambe , Mukesh Agrawal , Srinivasan Seshan, Mercury: supporting scalable multi-attribute range queries, Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications, August 30-September 03, 2004, Portland, Oregon, USA
• 4: Hailong Cai , Jun Wang, Foreseer: a novel, locality-aware peer-to-peer system architecture for keyword searches, Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware, October 18-22, 2004, Toronto, Canada
• 5: Min Cai , Martin Frank, RDFPeers: a scalable distributed RDF repository based on a structured peer-to-peer network, Proceedings of the 13th international conference on World Wide Web, May 17-20, 2004, New York, NY, USA [doi>10.1145/988672.988760]
• 6: Arturo Crespo , Hector Garcia-Molina, Routing Indices For Peer-to-Peer Systems, Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), p.23, July 02-05, 2002
• 7: A. Gupta, D. Agrawal, A. E. Abbadi, Approximate range selection queries in peer-to-peer systems, Proceedings of the First Biennial Conference on Innovative Data Systems Research, Asilomar, CA, Jan 2003.
• 8: N. J. Harvey, M. B. Jones, S. Saroiu, M. Theimer, A. Wolman, SkipNet: A scalable overlay network with practical locality properties, in USENIX Symposium on Internet Technologies and Systems (USITS), Mar 2003.
• 9: R., Konrad, Napster Among Fastest-growing Net Technologies, CNET news.com, October 2000.
• 10: M. Li, W. C. Lee, A. Sivasubramaniam, D. L. Lee, A Small World Overlay Network for Semantic Based Search in P2P, 2nd Workshop on Semantics in Peer-to-Peer and Grid Computing.
• 11: Dahlia Malkhi , Moni Naor , David Ratajczak, Viceroy: a scalable and dynamic emulation of the butterfly, Proceedings of the twenty-first annual symposium on Principles of distributed computing, July 21-24, 2002, Monterey, California [doi>10.1145/571825.571857]
• 12: Napster, at http://www.napster.com.
• 13: Sriram Ramabhadran , Sylvia Ratnasamy , Joseph M. Hellerstein , Scott Shenker, Brief announcement: prefix hash tree, Proceedings of the twenty-third annual ACM symposium on Principles of distributed computing, July 25-28, 2004, St. John's, Newfoundland, Canada [doi>10.1145/1011767.1011823]
• 14: Sylvia Ratnasamy , Paul Francis , Mark Handley , Richard Karp , Scott Schenker, A scalable content-addressable network, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.161-172, August 2001, San Diego, California, United States
• 15: P. Reynolds, A. Vahdat, Efficient peer-to-peer keyword searching, Proc. ACM/IFIP/USENIX Middleware Conference, volume 2672, pages 21--40, Rio de Janeiro, Brazil, June 2003.
• 16: Antony I. T. Rowstron , Peter Druschel, Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems, Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg, p.329-350, November 12-16, 2001
• 17: Cristina Schmidt , Manish Parashar, Enabling Flexible Queries with Guarantees in P2P Systems, IEEE Internet Computing, v.8 n.3, p.19-26, May 2004 [doi>10.1109/MIC.2004.1297269]
• 18: Y. Shao, R. Y. Wang, BuddyNet: History-Based P2P Search, 23--37, ECIR, 2005.
• 19: Yipeng Shen , Dik Lun Lee, A Meta-Search Method Reinforced by Cluster Descriptors, Proceedings of the Second International Conference on Web Information Systems Engineering (WISE'01) Volume 1, p.125, December 03-06, 2001
• 20: Yipeng Shen , Dik Lun Lee, An MDP-based Peer-to-Peer Search Server Network, Proceedings of the 3rd International Conference on Web Information Systems Engineering, p.269-278, December 12-14, 2002
• 21: Ion Stoica , Robert Morris , David Karger , M. Frans Kaashoek , Hari Balakrishnan, Chord: A scalable peer-to-peer lookup service for internet applications, Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, p.149-160, August 2001, San Diego, California, United States
• 22: Chunqiang Tang , Zhichen Xu , Sandhya Dwarkadas, Peer-to-peer information retrieval using self-organizing semantic overlay networks, Proceedings of the 2003 conference on Applications, technologies, architectures, and protocols for computer communications, August 25-29, 2003, Karlsruhe, Germany [doi>10.1145/863955.863976]
• 23: Chunqiang Tang , Sandhya Dwarkadas , Zhichen Xu, On scaling latent semantic indexing for large peer-to-peer systems, Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval, July 25-29, 2004, Sheffield, United Kingdom [doi>10.1145/1008992.1009014]
• 24: Egemen Tanin , Aaron Harwood , Hanan Samet, Indexing distributed complex data for complex queries, Proceedings of the 2004 annual national conference on Digital government research, p.1-10, May 24-26, 2004, Seattle, WA
• 25: P. Triantafillou, T. Pitoura, Towards a Unifying Framework for Complex Query Processing over Structured Peer-to-Peer Data Networks, VLDB '03 Workshop on Databases, Information Systems, and Peer-to-Peer Computing, September 2003.
• 26: Beverly Yang , Hector Garcia-Molina, Improving Search in Peer-to-Peer Networks, Proceedings of the 22 nd International Conference on Distributed Computing Systems (ICDCS'02), p.5, July 02-05, 2002
• 27: B. Zhao, L. Huang, J. Stribling, S. Rhea, A. Joseph, J. Kubiatowicz, Tapestry: A resilient global-scale overlay for service deployment, IEEE Journal on Selected Areas in Communications, 2003. 15.
• 28: D. J. Zhao, D. L. Lee, Q. Luo, DPTree: A Distributed Pattern Tree Index for Partial-Match Queries in Peer-to-Peer Networks, in Proc. of the 10th International Conference on Extending Database Technology (EDBT), 2006.
• 29: D. J. Zhao, D. L. Lee, Q. Luo, A Meta-Search Method with Clustering and Term Correlation, in Proc. 9th International Conference on Database Systems for Advanced Applications (DASFAA), 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.4 Systems
          Subjects: Query processing
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Data sharing

  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.4 System Management
          Subjects: Centralization/decentralization

General Terms:
Algorithms, Design, Management