Achieving high throughput for large scale event streaming across geographically distributed data-centers with JetStream
Authors: 
Radu Tudoran, Olivier Nano, Ivo Santos, 
Alexandru Costan, Hakan Soncu, Luc Bougé, Gabriel AntoniuAuthors Info & Claims
Radu Tudoran, Olivier Nano, Ivo Santos, Alexandru Costan, Hakan Soncu, Luc Bougé, Gabriel AntoniuAuthors Info & ClaimsPages 354 - 356
Abstract
The increasing scale at which data processing is being performed nowadays calls for data management systems that enable high-performance data exchanges among geographically remote instances of large web services. In this demonstration we show how JetStream can increase the transfer rate of events which are streamed between geographically remote cloud data centers. The demonstration setup focuses on presenting how the binding can be done between JetStream and the event source on one hand and with the StreamInsight processing engine on the other hand. By considering a data source with an event generation rate that is variable in time, we demonstrate the importance of adapting the transfer scheme to the streaming context.
References
[1]
StreamInsight. http://technet.microsoft.com/en-us/library/ee362541.aspx.
[2]
C. Balkesen, N. Dindar, M. Wetter, and N. Tatbul. Rip: Run-based intra-query parallelism for scalable complex event processing. In Proceedings of the 7th ACM International Conference on Distributed Event-based Systems, DEBS '13, pages 3--14, New York, NY, USA, 2013. ACM.
[3]
L. Golab and M. T. Özsu. Issues in data stream management. SIGMOD Rec., 32(2):5--14, June 2003.
[4]
B. He, M. Yang, Z. Guo, R. Chen, B. Su, W. Lin, and L. Zhou. Comet: Batched stream processing for data intensive distributed computing. In Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10, pages 63--74, New York, NY, USA, 2010. ACM.
[5]
R. Tudoran, A. Costan, G. Antoniu, and L. Bougé. A performance evaluation of azure and nimbus clouds for scientific applications. In Proceedings of the 2Nd International Workshop on Cloud Computing Platforms, CloudCP '12, pages 4:1--4:6, New York, NY, USA, 2012. ACM.
[6]
R. Tudoran, A. Costan, R. Wang, L. Bougé, and G. Antoniu. Bridging data in the clouds: An environment-aware system for geographically distributed data transfers. In Proceedings of the 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (Ccgrid 2014), CCGRID '14. IEEE Computer Society, 2014.
[7]
R. Tudoran, O. Nano, I. Santos, A. Costan, H. Soncu, L. Bougé, and G. Antoniu. Jetstream: Enabling high performance event streaming across cloud data-centers. In Proceedings of the 8th ACM International Conference on Distributed Event-based Systems, DEBS '14, New York, NY, USA, 2014. ACM.
Index Terms
- Achieving high throughput for large scale event streaming across geographically distributed data-centers with JetStream
Recommendations
JetStream: enabling high performance event streaming across cloud data-centers
DEBS '14: Proceedings of the 8th ACM International Conference on Distributed Event-Based SystemsThe easily-accessible computation power offered by cloud infrastructures coupled with the revolution of Big Data are expanding the scale and speed at which data analysis is performed. In their quest for finding the Value in the 3 Vs of Big Data, ...
JetStream
Scientific and commercial applications operate nowadays on tens of cloud datacenters around the globe, following similar patterns: they aggregate monitoring or sensor data, assess the QoS or run global data mining queries based on inter-site event ...
Cost-Aware Streaming Workflow Allocation on Geo-Distributed Data Centers
The virtual machine (VM) allocation problem in cloud computing has been widely studied in recent years, and many algorithms have been proposed in the literature. Most of them have been successfully applied to batch processing models such as MapReduce; ...
Comments
Information & Contributors
Information
Published In
Copyright © 2014 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 May 2014
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- INRIA - Microsoft Research Center
Conference
DEBS '14: The 8th ACM International Conference on Distributed Event-Based Systems
May 26 - 29, 2014
Mumbai, India
Acceptance Rates
DEBS '14 Paper Acceptance Rate 16 of 174 submissions, 9%;
Overall Acceptance Rate 145 of 583 submissions, 25%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 122Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in