Integrating microsecond circuit switching into the data center

Abstract

Recent proposals have employed optical circuit switching (OCS) to reduce the cost of data center networks. However, the relatively slow switching times (10--100 ms) assumed by these approaches, and the accompanying latencies of their control planes, has limited its use to only the largest data center networks with highly aggregated and constrained workloads. As faster switch technologies become available, designing a control plane capable of supporting them becomes a key challenge.

In this paper, we design and implement an OCS prototype capable of switching in 11.5 us, and we use this prototype to expose a set of challenges that arise when supporting switching at microsecond time scales. In response, we propose a microsecond-latency control plane based on a circuit scheduling approach we call Traffic Matrix Scheduling (TMS) that proactively communicates circuit assignments to communicating entities so that circuit bandwidth can be used efficiently.

References

1. M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity, Data Center Network Architecture. In Proceedings of ACM SIGCOMM, Aug. 2008.
2. M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic Flow Scheduling for Data Center Networks. In Proceedings of 7th USENIX NSDI, Apr. 2010.
3. W. Anderson, J. Jackel, G.-K. Chang, H. Dai, W. Xin, M. Goodman, C. Allyn, M. Alvarez, O. Clarke, A. Gottlieb, F. Kleytman, J. Morreale, V. Nichols, A. Tzathas, R. Vora, L. Mercer, H. Dardy, E. Renaud, L. Williard, J. Perreault, R. McFarland, and T. Gibbons. The MONET Project--A Final Report. IEEE Journal of Lightwave Technology, 18(12):1988--2009, Dec. 2000.
4. D. Beaver, S. Kumar, H. C. Li, J. Sobel, and P. Vajgel. Finding a needle in Haystack: Facebook's photo storage. In Proceedings of 9th USENIX OSDI, Oct. 2010.
5. G. Birkhoff. Tres Observaciones Sobre el Algebra Lineal. Univ. Nac. Tucumán Rev. Ser. A, 5:147--151, 1946.
6. K. Chen, A. Singla, A. Singh, K. Ramachandran, L. Xu, Y. Zhang, and X. Wen. OSA: An Optical Switching Architecture for Data Center Networks and Unprecedented Flexibility. In Proceedings of 9th USENIX NSDI, Apr. 2012.
7. N. Farrington, G. Porter, Y. Fainman, G. Papen, and A. Vahdat. Hunting Mice with Microsecond Circuit Switches. In Proceedings of 11th ACM HotNets, 2012.
8. N. Farrington, G. Porter, S. Radhakrishnan, H. H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat. Helios: A Hybrid Electrical/Optical Switch Architecture for Modular Data Centers. In Proceedings of ACM SIGCOMM, Aug. 2010.
9. J. E. Ford, V. A. Aksyuk, D. J. Bishop, and J. A. Walker. Wavelength Add-Drop Switching Using Tilting Micromirrors. IEEE Journal of Lightwave Technology, 17:904--911, 1999.
10. Glimmerglass 80x80 MEMS Switch. http://www.glimmerglass.com/products/technology/.
11. A. Goel, M. Kapralov, and S. Khanna. Perfect Matchings in $O(ntextlog n)$ Time in Regular Bipartite Graphs. In Proceedings of 42nd ACM STOC, June 2010.
12. Hadoop: Open source implementation of Map Reduce. http://hadoop.apache.org/.
13. D. Halperin, S. Kandula, J. Padhye, P. Bahl, and D. Wetherall. Augmenting Data Center Networks with Multi-Gigabit Wireless Links. In Proceedings of ACM SIGCOMM, Aug. 2011.
14. U. Hoelzle and L. A. Barroso. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan and Claypool Publishers, 2009.
15. N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. OpenFlow: Enabling Innovation in Campus Networks. ACM Computer Communication Review, 38(2), Apr. 2008.
16. R. N. Mysore, A. Pamporis, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat. PortLand: A Scalable, Fault-Tolerant Layer 2 Data Center Network Fabric. In Proceedings of ACM SIGCOMM, Aug. 2009.
17. C. Qiao and M. Yoo. Optical Burst Switching (OBS) -- A New Paradigm for an Optical Internet. Journal of High Speed Networks, 8(1):69--84, 1999.
18. R. Sinkhorn. A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices. The Annals of Mathematical Statistics, 35(2):876--879, 1964.
19. T. A. Strasser and J. L. Wagener. Wavelength-Selective Switches for ROADM Applications. IEEE Journal of Selected Topics in Quantum Electronics, 16:1150--1157, 2010.
20. Y. Tamir and G. L. Frazier. High-Performance Multi-Queue Buffers for VLSI Communication Switches. In Proceedings of 15th ACM ISCA, May 1988.
21. J. S. Turner. Terabit Burst Switching. Journal of High Speed Networks, 8(1):3--16, 1999.
22. B. C. Vattikonda, G. Porter, A. Vahdat, and A. C. Snoeren. Practical TDMA for Datacenter Ethernet. In Proceedings of ACM EuroSys, Apr. 2012.
23. J. von Neumann. A certain zero-sum two-person game equivalent to the optimal assignment problem. Contributions to the Theory of Games, 2:5--12, 1953.
24. M. Walraed-Sullivan, K. Marzullo, and A. Vahdat. Scalability vs. Fault Tolerance in Aspen Trees. Technical Report MSR-TR-2013--21, Microsoft Research, Feb 2013.
25. G. Wang, D. G. Andersen, M. Kaminsky, K. Papagiannaki, T. S. E. Ng, M. Kozuch, and M. Ryan. c-Through: Part-time Optics in Data Centers. In Proceedings of ACM SIGCOMM, Aug. 2010.

Index Terms

• Networks

  • Network properties

    • Network structure

  • Network types

    • Packet-switching networks

    • Wired access networks