skip to main content
10.1109/SC.2005.78acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
Article

Viable opto-electronic HPC interconnect fabrics

Published: 12 November 2005 Publication History

Abstract

We address the problem of how to exploit optics for ultrascale High Performance Computing interconnect fabrics. We show that for high port counts these fabrics require multistage topologies regardless of whether electronic or optical switch components are used. Also, per stage electronic buffers remain indispensable for maintaining throughput, lossless-ness and packet sequence. Although the notion of true all-optical packet switching is not yet viable, we show that appropriate use of optical switching technology offers power and scaling advantages that can be leveraged economically, and propose a hybrid opto-electronic HPC interconnect fabric architecture that combines the strength of electronics in processing and storing information with the strength of optics in switching and transporting high bandwidths. Using Semiconductor Optical Amplifier technology, we are building a prototype demonstrator switch that we believe solves all the technical challenges. Having reached this threshold now enables commercialization of this technology, which we are currently pursuing.

References

[1]
{1} David A. B. Miller, "Rationale and challenges for optical interconnects to electronic chips," Proc. IEEE 88 (6), 728-749 (2000).
[2]
{2} A. Neukermans and R. Ramaswami, "MEMS technology for optical networking applications," IEEE Commun. Mag. 39 (1), 2001.
[3]
{3} T. Goh, M. Yasu, K. Hattori, A. Himeno, M. Okuno and Y. Ohmori, "Low loss and high extension ratio strictly nonblocking 16×16 thermooptic matrix switch on 6-in wafer using silica based planer lightwave circuit technology," J. Lightwave Technol., Vol. 19, no. 3, Mar. 2001.
[4]
{4} E. Shekel, A. Feingold, Z. Fradkin, A. Geron, J. Levy, G. Matmon, D. Majer, E. Rafaely, M. Rudman, G. Tidhar, J. Vecht and S. Ruschin, "64 × 64 fast optical switching module," Proc. Optical Fiber Communication Conference and Exhibit, 2002. OFC 2002, pp. 27-29.
[5]
{5} F. Masetti, D. Chiaroni, R. Dragnea, R. Robotham and D. Zriny, "High-speed high-capacity packet-switching fabric: a key system for required flexibility and capcity," J. Opt. Networking 2 (7), July 2003.
[6]
{6} S. Araki, Y. Suemura, N. Henmi, Y. Maeno, A. Tajima and S. Takahashi, "Highly scalable optoelectronic packet-switching fabric based on wavelength-division and space-division optical switch architecture fof use in the photonic core node," J. Opt. Networking 2 (7), July 2003.
[7]
{7} J. Gripp, M. Duelk, J.E. Simsarian, A. Bhardwaj, P. Bernasconi, O. Laznicka and M. Zirngibl, "Optical switch fabrics for ultra-high-capacity IP routers," J. Lightwave Techn. 21 (11), 2839-2850, Nov. 2003.
[8]
{8} A. Von Lehmen, G. Clapp, J.W. Gannett, H. Kobrinski and R.A. Skoog, "Data in the optical domain technology: A network-level perspective," Proc. 17th Annual Meeting of the IEEE Lasers and Electro-Optics Society, LEOS 2004., Vol. 1, Nov. 2004.
[9]
{9} A. Willner, "Physical impairements and network limitations when interconnecting multiple DOD-N routers," Proc. 17th Annual Meeting of the IEEE Lasers and Electro-Optics Society, LEOS 2004. Vol. 1, Nov. 2004.
[10]
{10} Q. Yang and K. Bergman, "Performances of the Data Vortex switch architecture under non-uniform and bursty traffic," IEEE/OSA J. Lightwave Technol. 20 (8), 1242-1247, Aug. 2002.
[11]
{11} C. Minkenberg, "Work-conservingness of CIOQ packet switches with limited output buffers," IEEE Commun. Lett. 6 (10), 452-454, Oct. 2002.
[12]
{12} The 24th TOP500 List, released November 8, 2004, during SC2004 in Pittsburgh, PA, http://www.top500.org
[13]
{13} F. Abel, C. Minkenberg, R. Luijten, M. Gusat, I. Iliadis, "A Four terabit packet switch supporting long round trip times", IEEE Micro 23 (1), 10-24, Jan.-Feb. 2003.
[14]
{14} S. Noda, "Photonic nanostructures and devices based on photonic crystals," Proc. 7th Annual Meeting of the IEEE Lasers and Electro-Optics Society, LEOS 2004, Vol. 1, Nov. 2004.
[15]
{15} M.T. Hill, H.J.S. Dorren, T. de Vries, X.J.M. Leijtens, J.H. den Besten, B. Smalbrugge, Y.-S. Oei, H. Binsma, G.-D. Khoe and M.K. Smit, "A fast low-power optical memory based on coupled micro-ring lasers," Nature 432, 2004.
[16]
{16} C.B. Stunkel and P.H. Hochschild, "SP2 high-performance switch architecture," Proc. Hot Interconnects II, pp. 190-195, Aug. 1994.
[17]
{17} N. McKeown, V.T. Anantharam and J. Walrand, "Achieving 100% throughput in an input-queued switch," in Proc. IEEE Infocom '96, vol. 1, pp. 296-302, San Francisco, Mar. 1996.
[18]
{18} C. Minkenberg, "Performance of i-SLIP scheduling with large round-trip latency," Proc. Workshop on High Performance Switching and Routing HPSR 2003, pp. 49-54, Turin, Italy, June 2003.
[19]
{19} C. Minkenberg, F. Abel, M. Gusat, "Reliable control protocol for crossbar arbitration," IEEE Commun. Lett. 9 (2), 178-180, Feb. 2005.
[20]
{20} P. Mueller, R. Luijten and U. Bapst, "Hierarchical system synchronization and signaling for high-performance - low-latency interconnects," IEEE Electro/Information Technology Conf. "EIT 2005," Lincoln, NE, May 22-25, 2005.
[21]
{21} R. Hemenway, R. Grzybowski, C. Minkenberg, and R. Luijten, "Optical-packet-switched interconnect for supercomputer applications," OSA J. Opt. Network. 3 (12), 900-913, Dec. 2004.
[22]
{22} C. Minkenberg, I. Iliadis, F. Abel, "Low-Latency Pipelined Crossbar Arbitration," Proc. IEEE Globecom 2004, paper GE15-2, Dallas, TX, Nov. 2004.
[23]
{23} C. Minkenberg, F. Abel, P. Mueller, R, Krishnamurthy, M. Gusat and R. Hemenway, "Control Path Implementation for a Low-Latency Optical HPC Switch", HOTi 2005, Stanford, CA, Aug 2005.
[24]
{24} C. Chang; D. Lee; C. Yue, "Providing guaranteed rate services in the load balanced Birkhoff-von Neumann switches", INFOCOM 2003, Volume 3, 30 March-3 April 2003.
[25]
{25} C.K. Yow, Y.J. Chai, C.W. Tee, R. McDougall, R.V. Penty and I.H. White, "All-optical multiwavelength bypass-exchange switching using a hybrid-integrated Mach-Zehnder switch," Proc. ECOC 2004, Paper WE4P118, Stockholm, Sweden, Sept. 2004.

Cited By

View all
  • (2019)Experimental demonstration of an ultra-low latency control plane for optical packet switching in data center networksOptical Switching and Networking10.1016/j.osn.2018.11.00532:C(51-60)Online publication date: 1-Apr-2019
  • (2011)Efficient photonic codingProceedings of the 2nd ACM SIGCOMM workshop on Green networking10.1145/2018536.2018540(13-18)Online publication date: 19-Aug-2011
  • (2007)Building Ultralow-Latency Interconnection Networks Using Photonic IntegrationIEEE Micro10.1109/MM.2007.6427:4(6-20)Online publication date: 1-Jul-2007
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing
November 2005
829 pages
ISBN:1595930612

Sponsors

Publisher

IEEE Computer Society

United States

Publication History

Published: 12 November 2005

Check for updates

Author Tags

  1. HPC
  2. Interconnect
  3. Optical Switching
  4. Switching

Qualifiers

  • Article

Conference

SC '05
Sponsor:

Acceptance Rates

SC '05 Paper Acceptance Rate 62 of 260 submissions, 24%;
Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)1
Reflects downloads up to 26 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2019)Experimental demonstration of an ultra-low latency control plane for optical packet switching in data center networksOptical Switching and Networking10.1016/j.osn.2018.11.00532:C(51-60)Online publication date: 1-Apr-2019
  • (2011)Efficient photonic codingProceedings of the 2nd ACM SIGCOMM workshop on Green networking10.1145/2018536.2018540(13-18)Online publication date: 19-Aug-2011
  • (2007)Building Ultralow-Latency Interconnection Networks Using Photonic IntegrationIEEE Micro10.1109/MM.2007.6427:4(6-20)Online publication date: 1-Jul-2007
  • (2006)Designing a Crossbar Scheduler for HPC ApplicationsIEEE Micro10.1109/MM.2006.5126:3(58-71)Online publication date: 1-May-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media