research-article

Scalable dht-based information service for large-scale grids

Authors:

Xuanhua ShiAuthors Info & Claims

CF '08: Proceedings of the 5th conference on Computing frontiers

Pages 305 - 312

https://doi.org/10.1145/1366230.1366281

Published: 05 May 2008 Publication History

Abstract

Current grid information service is centralized or hierarchical and proves inefficient as grid scale rapidly increases. The introduction of P2P techniques into grids breaks an encouraging path. However, frequent join and departure of resource nodes require strong self-organization capacity of system to maintain their rigid structure. Moreover, arranging identifier space for P2P nodes is knotty and has great impact on system performance. If the identifier space is too large, some nodes will be overloaded. On the contrary, small identifier space will bring the same problem as millennium bug. To address the issues, this paper proposes a scalable DHT-based (Distributed Hash Table) Information Service (DIS) for grid system, which organizes grid resources into a DHT ring based on VO (Virtual Organization). To save the identifier space while retaining the scalability and system performance, only stable VOs can join DIS via a new DHT node, whereas volatile VOs join DIS through being the sub-domain of other VO. Experimental results show that DIS provides rapid resource query, strong scalability and high throughput, meanwhile avoiding the key node failure as well as the bottleneck problem.

References

[1]

Foster, I. and Kesselman, C. The Grid: Blueprint for a new computing infrastructure. 2nd edition, Morgan Kaufmann Nov. 2003.

Digital Library

[2]

Czajkowski, K., Fitzgerald, S., Foster, I. and Kesselman, C. Grid information services for distributed resource sharing. In Proceedings of HPDC'01, 2001, pp.181--194.

Digital Library

[3]

Foster, I. and Iamnitchi, A. On death, taxes, and the convergence of peer-to-peer and grid computing. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS'03), 2003, pp.118--128.

[4]

Talia, D. and Trunfio, P. Toward a synergy between P2P and grids. IEEE Internet Computing, vol.7, no.4, July/Aug. 2003, pp.94--96.

Digital Library

[5]

Iamnitchi, A., Foster, I. and Nurmi, D. A peer-to-peer approach to resource discovery in grid environments. Technical Report TR-2002--06, University of Chicago, 2002.

[6]

Cai, M., Frank, M., Chen, J. and Szekely, P. MAAN: A multi-attribute addressable network for grid information services. Journal of Grid Computing, 2(1):3--14, 2004.

[7]

Oppenheimer, D., Albrecht, J., Patterson, D. and Vahdat, A. Scalable wide-area resource discovery. UC Berkeley Technical Report, UCB/CSD-04--1334, July 2004.

[8]

Basu, S., Banerjee, S., Sharma, P. and Lee, S. NodeWiz: Peer-to-peer resource discovery for grids. In Proceedings of IEEE/ACM GP2PC'05, Cardiff, UK, May 2005, pp.213--220.

Digital Library

[9]

Stoica, I., Morris, R., Liben-Nowell, D., Karger, D., Kaashoek, M. F., Dabek, F. and Balakrishnan, H. Chord: A scalable peer-to-peer lookup protocol for Internet applications. IEEE/ACM Transactions on Networking, 11(1):17--32, Feb. 2003.

Digital Library

[10]

UDDI V3.0.2 specification. http://uddi.org/pubs/uddi_v3.htm

[11]

Globus MDS. http://www.globus.org/toolkit/docs/4.0/info/

[12]

Gnutella Protocol Development. http://rfc-gnutella.sourceforge.net/src/rfc-0_6-draft.html

[13]

Ratnasany, S., Francis, P., Handley, M., Karp, R. M. and Shenker, S. A scalable content-addressable network. In Proceedings of ACM SIGCOMM'01, San Diego, USA, 2001, pp.161--172.

Digital Library

[14]

Rowstron, A. and Druschel, P. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proceedings of IFIP/ACM International Conference on Distributed Systems Platforms (Middleware), Heidelberg, Germany, Nov. 2001, pp. 329--350.

Digital Library

[15]

Rhea, S., Geels, D., Roscoe, T. and Kubiatowicz. J. Handling churn in a DHT. In Proceedings of the USENIX Annual Technical Conference, June 2004, pp.127--140.

Digital Library

[16]

Andrzejak, A. and Xu, Z. Scalable, efficient range queries for grid information services. In Proceedings of 2nd IEEE Int. Conf. on Peer-to-peer Computing (P2P'02), Sweden, Sep. 2002, pp.30--40.

Digital Library

[17]

Spence, D. and Harris, T. XenoSearch: distributed resource discovery in the XenoServer open platform. In Proceedings of HPDC'03, Washington, USA, June 2003, pp.33--40.

Digital Library

[18]

FIPS 180--1. Secure Hash Standard. U.S. Departure of Commerce/NIST, National Technical Information Service, Springfield, VA, Apr.1995.

[19]

El-Ansary, S., Alima, L. O., Brand, P. and Haridi, S. Efficient broadcast in structured P2P networks. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems (IPTPS'03), 2003, pp.304--314.

[20]

Jin, H. ChinaGrid: making grid computing a reality. Digital Libraries: International Collaboration and Cross-Fertilization - Lecture Notes in Computer Science, Vol.3334, Springer-Verlag, Dec. 2004, pp.13--24.

Digital Library

Cited By

Vaquero LCáceres JMorán D(2013)The Challenge of Service Level Scalability for the CloudCloud Computing Advancements in Design, Implementation, and Technologies10.4018/978-1-4666-1879-4.ch003(37-48)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-1879-4.ch003
Vaquero LCáceres JMorán D(2011)The Challenge of Service Level Scalability for the CloudInternational Journal of Cloud Applications and Computing10.4018/ijcac.20110101031:1(34-44)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.4018/ijcac.2011010103
Qing Yao Xingyuan Chen Lei Guo Xi Wang Yuxian Jian (2010)An effective resources organizational structure in the grid environment2010 IEEE International Conference on Information Theory and Information Security10.1109/ICITIS.2010.5689763(1151-1154)Online publication date: Dec-2010
https://doi.org/10.1109/ICITIS.2010.5689763
Show More Cited By

Index Terms

Scalable dht-based information service for large-scale grids
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Scalable DHT- and ontology-based information service for large-scale grids

Current grid information services are centralized or hierarchical and prove inefficient as the scale of the grid rapidly increases. The introduction of the P2P DHT technique into grids brings an encouraging path. However, current applications of the P2P ...
Scalable Grid Service Discovery based on UDDI
MGC '05: Proceedings of the 3rd international workshop on Middleware for grid computing

Efficient discovery of grid services is essential for the success of grid computing. The standardization of grids based on web services has resulted in the need for scalable web service discovery mechanisms to be deployed in grids Even though UDDI has ...
Proximity-Aware DHT for Efficient Lookup Service in Peer-to-Peer Applications
CSE '11: Proceedings of the 2011 14th IEEE International Conference on Computational Science and Engineering

Distributed Hash Tables (DHTs) attract considerable attention as a way of realizing an efficient lookup service in Peer-to-Peer (P2P) applications. However, many of conventional DHTs such as Chord and Kademlia do not take into account the proximity of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CF '08: Proceedings of the 5th conference on Computing frontiers

May 2008

334 pages

ISBN:9781605580777

DOI:10.1145/1366230

General Chair:
Alex Ramirez
UPC, Spain
,
Program Chairs:
Gianfranco Biliardi
University of Padova, Italy
,
Michael Gschwind
IBM TJ Watson Research Center, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CF '08

Sponsor:

CF '08: Computing Frontiers Conference

May 5 - 7, 2008

Ischia, Italy

Acceptance Rates

Overall Acceptance Rate 273 of 785 submissions, 35%

Upcoming Conference

CF '25

Sponsor:
sigmicro

22nd ACM International Conference on Computing Frontiers

May 28 - 30, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
213
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vaquero LCáceres JMorán D(2013)The Challenge of Service Level Scalability for the CloudCloud Computing Advancements in Design, Implementation, and Technologies10.4018/978-1-4666-1879-4.ch003(37-48)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-1879-4.ch003
Vaquero LCáceres JMorán D(2011)The Challenge of Service Level Scalability for the CloudInternational Journal of Cloud Applications and Computing10.4018/ijcac.20110101031:1(34-44)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.4018/ijcac.2011010103
Qing Yao Xingyuan Chen Lei Guo Xi Wang Yuxian Jian (2010)An effective resources organizational structure in the grid environment2010 IEEE International Conference on Information Theory and Information Security10.1109/ICITIS.2010.5689763(1151-1154)Online publication date: Dec-2010
https://doi.org/10.1109/ICITIS.2010.5689763
Carlini ECoppola MDazzi PLaforenza DMartinelli SRicci L(2009)Service and Resource Discovery supports over P2P overlays2009 International Conference on Ultra Modern Telecommunications & Workshops10.1109/ICUMT.2009.5345354(1-8)Online publication date: Oct-2009
https://doi.org/10.1109/ICUMT.2009.5345354

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten