Chuanxiong Guo
Guohan Lu
Abstract
This paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports connect to multiple layers of COTS (commodity off-the-shelf) mini-switches. Servers act as not only end hosts, but also relay nodes for each other. BCube supports various bandwidth-intensive applications by speeding-up one-to-one, one-to-several, and one-to-all traffic patterns, and by providing high network capacity for all-to-all traffic.
BCube exhibits graceful performance degradation as the server and/or switch failure rate increases. This property is of special importance for shipping-container data centers, since once the container is sealed and operational, it becomes very difficult to repair or replace its components.
Our implementation experiences show that BCube can be seamlessly integrated with the TCP/IP protocol stack and BCube packet forwarding can be efficiently implemented in both hardware and software. Experiments in our testbed demonstrate that BCube is fault tolerant and load balancing and it significantly accelerates representative bandwidth-intensive applications.
- M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In SIGCOMM, 2008. Google Scholar
Digital Library
- L. Barroso, J. Dean, and U. Holzle. Web Search for a Planet: The Google Cluster Architecture. IEEE Micro, March-April 2003. Google ScholarDigital Library
- L. Bhuyan and D. Agrawal. Generalized Hypercube and Hyperbus Structures for a Computer Network. IEEE trans. Computers, April 1984. Google ScholarDigital Library
- D. Borthakur. The Hadoop Distributed File System: Architecture and Design. http://hadoop.apache.org/core/docs/current/hdfs_design.pdf.Google Scholar
- CloudStore. Higher Performance Scalable Storage. http://kosmosfs.sourceforge.net/.Google Scholar
- J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI, 2004. Google ScholarDigital Library
- A. Greenberg et al. Towards a Next Generation Data Center Architecture: Scalability and Commoditization. In SIGCOMM PRESTO Workshop, 2008. Google ScholarDigital Library
- A. Greenberg et al. VL2: A Scalable and Flexible Data Center Network. In SIGCOMM, Aug 2009. Google ScholarDigital Library
- C. Guo et al. DCell: A Scalable and Fault Tolerant Network Structure for Data Centers. In SIGCOMM, 2008. Google ScholarDigital Library
- G. Lu et al. CAFE: A Configurable pAcket Forwarding Engine for Data Center Networks. In SIGCOMM PRESTO Workshop, Aug 2009. Google ScholarDigital Library
- J. Duato et al. Interconnection Networks: An Engineering Approach. Morgan Kaufmann, 2003. Google ScholarDigital Library
- S. Ghemawat, H. Gobioff, and S. Leung. The Google File System. In SOSP, 2003. Google ScholarDigital Library
- J. Hamilton. An Architecture for Modular Data Centers. In 3rd CIDR, Jan 2007.Google Scholar
- J. Hamilton. Cooperative Expandable Micro-Slice Servers (CEMS). In 4th CIDR, Jan 2009.Google Scholar
- J. Hamilton. Private communication, 2009.Google Scholar
- IBM. Scalable Modular Data Center. http://www-935.ibm.com/services/us/its/pdf/smdc-eb-sfe03001-usen-00-022708.p%df.Google Scholar
- M. Isard, M. Budiu, and Y. Yu. Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. In EuroSys, 2007. Google ScholarDigital Library
- F. Leighton. Introduction to Parallel Algorithms and Architectures: Arrays. Trees. Hypercubes. Morgan Kaufmann, 1992. Google ScholarDigital Library
- C. Leiserson. Fat-trees: Universal networks for hardware-efficient supercomputing. IEEE Trans. Computers, 34(10), 1985. Google ScholarDigital Library
- J. Moy. OSPF: Anatomy of an Internet Routing Protocol. Addison-Wesley, 2000. Google ScholarDigital Library
- J. Naous, G. Gibb, S. Bolouki, and N. McKeown. NetFPGA: Reusable Router Architecture for Experimental Research. In SIGCOMM PRESTO Workshop, 2008. Google ScholarDigital Library
- Silicom. Gigabit Ethnet Server Adapters. http://www.silicom--usa.com/default.asp?contentID=711.Google Scholar
- Rackable Systems. ICE Cube Modular Data Center. http://www.rackable.com/products/icecube.aspx.Google Scholar
- Verari Systems. The Verari FOREST Container Solution: The Answer to Consolidation. http://www.verari.com/forest_spec.asp.Google Scholar
- M. Waldrop. Data Center in a Box. Scientific American, July 2007.Google ScholarCross Ref
Index Terms
- BCube: a high performance, server-centric network architecture for modular data centers
Recommendations
BCube: a high performance, server-centric network architecture for modular data centers
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communicationThis paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports ...
MDCube: a high performance network structure for modular data center interconnection
CoNEXT '09: Proceedings of the 5th international conference on Emerging networking experiments and technologiesShipping-container-based data centers have been introduced as building blocks for constructing mega-data centers. However, it is a challenge on how to interconnect those containers together with reasonable cost and cabling complexity, due to the fact ...
Light-BCube:A Scalable and High Performance Network Structure for Modular Data Center
ICBDC '22: Proceedings of the 7th International Conference on Big Data and ComputingWith the rapid development of cloud computing services, thousands of data centers are built to meet the demands. A fundamental challenge in data center network is how to interconnect an exponentially increasing number of servers efficiently and provide ...
Comments