skip to main content
10.1145/1996014.1996019acmconferencesArticle/Chapter ViewAbstractPublication PageshpdcConference Proceedingsconference-collections
research-article

Early experience with the distributed nebula cloud

Published:08 June 2011Publication History

ABSTRACT

Current cloud infrastructures are important for their ease of use and performance. However, they suffer from several shortcomings. The main problem is inefficient data mobility due to the centralization of cloud resources. We believe such clouds are highly unsuited for dispersed-data-intensive applications, where the data may be spread at multiple geographical locations (e.g., distributed user blogs). Instead, we propose a new cloud model called Nebula: a dispersed, context-aware, and cost-effective cloud. We provide experimental evidence for the need for Nebulas using a distributed blog analysis application followed by the system architecture and components of our system.

References

  1. Akamai. http://www.akamai.com.Google ScholarGoogle Scholar
  2. D. P. Anderson. BOINC: A System for Public-Resource Compting and Storage. In Proceedings of the 5th ACM/IEEE International Workshop on Grid Computing, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the clouds: A berkeley view of cloud computing, Feb 2009.Google ScholarGoogle Scholar
  4. Azure services platform. http://www.microsoft.com/azure/default.mspx.Google ScholarGoogle Scholar
  5. A. Chandra and J. Weissman. Nebulas: Using distributed voluntary resources to build clouds. In HotCloud'09: Workshop on Hot topics in cloud computing, Berkeley, CA, USA, June 2009. USENIX Association. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. D. Choffnes and F. Bustamante. On the effectiveness of measurement reuse for performance-based detouring. In INFOCOM 2009, IEEE, pages 693--701, april 2009.Google ScholarGoogle ScholarCross RefCross Ref
  7. B. Chun, D. Culler, T. Roscoe, A. Bavier, L. Peterson, M. Wawrzoniak, and M. Bowman. PlanetLab: an overlay testbed for broad-coverage services. ACM SIGCOMM Computer Communication Review, 33(3):3--12, July 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. B. Cohen. Incentives build robustness in BitTorrent. In Proceedings of the First Workshop on the Economics of Peer-to-Peer Systems, June 2003.Google ScholarGoogle Scholar
  9. Collaborative map reduce. http://code.google.com/p/nativeclient.Google ScholarGoogle Scholar
  10. Collatz Conjecture. http://en.wikipedia.org/wiki/Collatz_conjecture.Google ScholarGoogle Scholar
  11. A. Downey. Using pathchar to estimate internet link characteristics. In In Proceedings of ACM SIGCOMM, pages 241--250, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Ec2. http://aws.amazon.com/ec2.Google ScholarGoogle Scholar
  13. I. Foster, C. Kesselman, J. Nick, and S. Tuecke. The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. In Proceedings of the Global Grid Forum, June 2002.Google ScholarGoogle Scholar
  14. Google blogger service. https://www.blogger.com/start.Google ScholarGoogle Scholar
  15. Google native client. http://code.google.com/p/nativeclient.Google ScholarGoogle Scholar
  16. Google app engine. http://www.google.com/appengine.Google ScholarGoogle Scholar
  17. Google maps. http://maps.google.com.Google ScholarGoogle Scholar
  18. D. Gottfrid. Self-service, Prorated Super Computing Fun! http://open.blogs.nytimes.com/2007/11/01/self-service-prorated-super-co%mputing-fun.Google ScholarGoogle Scholar
  19. Ibm cloud computing. http://www.ibm.com/ibm/cloud.Google ScholarGoogle Scholar
  20. A. jan Su, D. R. Choffnes, A. Kuzmanovic, and F. E. Bustamante. Drafting behind akamai (travelocity-based detouring. In In Proceedings of ACM SIGCOMM, pages 435--446, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. J. Kim, A. Chandra, and J. Weissman. OPEN: Passive Network Performance Estimation for Data-intensive Applications. Technical Report 08-041, Dept. of CSE, Univ. of Minnesota, 2008.Google ScholarGoogle Scholar
  22. K. Lai and M. Baker. Measuring link bandwidths using a deterministic model of packet delay. In in Proceedings of ACM SIGCOMM, pages 283--294, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. D. Molnar. The SETI@Home problem. ACM Crossroads, Sept. 2000.Google ScholarGoogle Scholar
  24. A. Pasztor and D. Veitch. Active probing using packet quartets. In In ACM SIGCOMM Internet Measurement Workshop, pages 293--305, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. S. Ramakrishnan, R. Reutiman, A. Chandra, and J. Weissman. Standing on the shoulders of others: Using proxies to opportunistically boost distributed applications. Technical Report 10-012, Dept. of CSE, Univ. of Minnesota, 2010.Google ScholarGoogle Scholar
  26. G. Reese. Cloud Application Architectures: Building Applications and Infrastructure in the Cloud . O'Reilly Media, Apr. 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Public Data Sets on AWS. http://aws.amazon.com/publicdatasets.Google ScholarGoogle Scholar
  28. S. Saroiu, K. P. Gummadi, R. J. Dunn, S. D. Gribble, and H. M. Levy. An Analysis of Internet Content Delivery Systems. In Proceedings of Symposium on Operating Systems Design and Implementation, Dec. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. P. B. Teregowda, B. Urgaonkar, and C. L. Giles. CiteSeerx: A Cloud Perspective. In HotCloud'10: Workshop on Hot topics in cloud computing, June 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Web-harvest web crawler. http://web-harvest.sourceforge.net.Google ScholarGoogle Scholar
  31. R. Wolski, N. T. Spring, and J. Hayes. The network weather service: A distributed resource performance forecasting service for metacomputing. Journal of Future Generation Computing Systems, 15:757--768, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Early experience with the distributed nebula cloud

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      DIDC '11: Proceedings of the fourth international workshop on Data-intensive distributed computing
      June 2011
      60 pages
      ISBN:9781450307048
      DOI:10.1145/1996014

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 8 June 2011

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate7of12submissions,58%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader