skip to main content
10.1145/2076623.2076643acmotherconferencesArticle/Chapter ViewAbstractPublication PagesideasConference Proceedingsconference-collections
research-article

ParallelGDB: a parallel graph database based on cache specialization

Published:21 September 2011Publication History

ABSTRACT

The need for managing massive attributed graphs is becoming common in many areas such as recommendation systems, proteomics analysis, social network analysis or bibliographic analysis. This is making it necessary to move towards parallel systems that allow managing graph databases containing millions of vertices and edges. Previous work on distributed graph databases has focused on finding ways to partition the graph to reduce network traffic and improve execution time. However, partitioning a graph and keeping the information regarding the location of vertices might be unrealistic for massive graphs. In this paper, we propose Parallel-GDB, a new system based on specializing the local caches of any node in this system, providing a better cache hit ratio. ParallelGDB uses a random graph partitioning, avoiding complex partition methods based on the graph topology, that usually require managing extra data structures. This proposed system provides an efficient environment for distributed graph databases.

References

  1. N. Martínez-Bazan, V. Muntés-Mulero, S. Gómez-Villamor, J. Nin, M. A. Sánchez-Martínez, and J. L. Larriba-Pey. DEX: high-performance exploration on large graph for information retrieval. CIKM 2007:573--582. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. V. Muntés-Mulero, N. Martínez-Bazan, J-Ll. Larriba-Pey, E. Pacitti, P. Valduriez. Graph Partitioning Strategies for Efficient BFS in Shared-Nothing Parallel Systems. WAIM Workshops 2010:13--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. L. G. Valiant. A Bridging Model for Parallel Computation. Commun. ACM (CACM) 33(8):103--111 (1990). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. G. Malewicz, M. H. Austern, A. J. C. Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski. Pregel: A System for Large-Scale Graph Processing. SIGMOD 2010:135--146. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. D. Chakrabarti and C. Faloutsos. Graph mining: Laws, generators, and algorithms. ACM Comput. Surv. (CSUR) 38(1) (2006). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Josep M. Pujol, Vijay Erramilli, Georgos Siganos, Xiaoyuan Yang Nikos Laoutaris, Parminder Chhabra, Pablo Rodriguez. The Little Engine(s) That Could: Scaling Online Social Networks SIGCOMM 2010:375--386. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Trissl and U. Leser. Fast and practical indexing and querying of very large graphs. SIGMOD 2007:845--856. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Sameh Elnikety, Steven Dropsho, and Willy Zwaenepoel. Tashkent+: Memory-Aware Load Balancing and Update Filtering in Replicated Databases. EuroSys 2007:399--412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. D. Dominguez-Sal, N. Martínez-Bazan, V. Muntés-Mulero, Pere Baleta, and J. L. Larriba-Pey. A Discussion on the Design of Graph Database Benchmarks. TPCTC 2010:25--40 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Yoo, E. Chow, K. Henderson, W. McLendon, B. Hendrickson, and U. Catalyurek. A Scalable Distributed Parallel Breadth-First Search Algorithm on BlueGene/L. SC 2005:25. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. J. Cohen. Graph Twiddling in a MapReduce World. Computing in Science and Engineering (CSE) 11(4):29--41 (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. U. Kang, C. E. Tsourakakis, and C. Faloutsos. PEGASUS: A peta-scale graph mining system-implementation and observations. ICDM 2009:229--238. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ParallelGDB: a parallel graph database based on cache specialization

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      IDEAS '11: Proceedings of the 15th Symposium on International Database Engineering & Applications
      September 2011
      274 pages
      ISBN:9781450306270
      DOI:10.1145/2076623

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 21 September 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate74of210submissions,35%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader