skip to main content
10.1145/1772690.1772739acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Autonomous resource provisioning for multi-service web applications

Published: 26 April 2010 Publication History

Abstract

Dynamic resource provisioning aims at maintaining the end-to-end response time of a web application within a pre-defined SLA. Although the topic has been well studied for monolithic applications, provisioning resources for applications composed of multiple services remains a challenge. When the SLA is violated, one must decide which service(s) should be reprovisioned for optimal effect. We propose to assign an SLA only to the front-end service. Other services are not given any particular response time objectives. Services are autonomously responsible for their own provisioning operations and collaboratively negotiate performance objectives with each other to decide the provisioning service(s). We demonstrate through extensive experiments that our system can add/remove/shift both servers and caches within an entire multi-service application under varying workloads to meet the SLA target and improve resource utilization.

References

[1]
T. F. Abdelzaher, K. G. Shin, and N. Bhatti. Performance guarantees for Web server end-systems: a control-theoretical application. IEEE Transactions on Parallel and Distributed Systems, 13(1), 2002.
[2]
J. Almeida, V. Almeida, D. Ardagna, C. Francalanci, and M. Trubian. Resource management in the autonomic service-oriented architecture. In Proc. ICAC, 2006.
[3]
DAS3: The Distributed ASCI Supercomputer 3. http://www.cs.vu.nl/das3/.
[4]
R. P. Doyle, J. S. Chase, O. M. Asad, W. Jin, and A. M. Vahdat. Model-based resource provisioning in a Web service utility. In Proc. USITS, 2003.
[5]
J. Gray and W. Vogels. A conversation with Werner Vogels. ACM Queue, 4(4), 2006.
[6]
N. J. Gunther. Analyzing Computer System Performance with Perl::PDQ. Springer, 2005.
[7]
A. Kamra, V. Misra, and E. M. Nahum. Yaksha: a self-tuning controller for managing the performance of 3-tiered Web sites. In Proc. Intl. Workshop on Quality of Service, 2004.
[8]
D. Karger, E. Lehman, T. Leighton, M. Levine, D. Lewin, and R. Panigrahy. Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web. In Proc. ACM Symposium on Theory of Computing, 1997.
[9]
H. A. Lagar-Cavilla, J. A. Whitney, A. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: rapid virtual machine cloning for cloud computing. In Proc. EuroSys, 2009.
[10]
S. Ranjan, J. Rolia, H. Fu, and E. Knightly. QoS-driven server migration for Internet data centers. In Proc. Intl. Workshop on Quality of Service, 2002.
[11]
R. Shoup. eBay's architectural principles. http://jaoo.dk/london-2008/file?path=/qcon-london-2008/slides/RandyShoup_eBaysArchitecturalPrinciples.pdf.
[12]
S. Sivasubramanian. Scalable hosting of web applications. PhD thesis, VU University Amsterdam, Netherlands, 2007.
[13]
K. S. Trivedi. Probability and Statistics with Reliability, Queuing and Computer Science Applications. John Wiley and Sons, 2001.
[14]
B. Urgaonkar, G. Pacifici, P. Shenoy, M. Spreitzer, and A. Tantawi. An analytical model for multi-tier Internet services and its applications. In Proc. SIGMETRICS, 2005.
[15]
B. Urgaonkar, P. Shenoy, A. Chandra, P. Goyal, and T. Wood. Agile dynamic provisioning of multi-tier Internet applications. ACM Transactions on Autonomous Adaptive Systems, 3(1), 2008.
[16]
T. Vercauteren, P. Aggarwal, X. Wang, and T.-H. Li. Hierarchical forecasting of Web server workload using sequential Monte Carlo training. In Proc. Conf. on Information Sciences and Systems, 2006.
[17]
D. Villela, P. Pradhan, and D. Rubenstein. Provisioning servers in the application tier for e-commerce systems. ACM Transactions on Internet Technology, 7(1), 2007.
[18]
B. Y. Wu, C. H. Chi, and Z. Chen. Resource allocation based on workflow for enhancing the performance of composite service. In Proc. SCC, 2007.

Cited By

View all
  • (2024)FuncScaler: Cold-Start-Aware Holistic Autoscaling for Serverless Resource Management2024 IEEE International Conference on Web Services (ICWS)10.1109/ICWS62655.2024.00122(1036-1047)Online publication date: 7-Jul-2024
  • (2023)DeepScaler: Holistic Autoscaling for Microservices Based on Spatiotemporal GNN with Adaptive Graph LearningProceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE56229.2023.00038(53-65)Online publication date: 11-Nov-2023
  • (2022)An Automatic Performance Profiling Method Based on Microservice Monitoring System in Cloud ComputingComputer Science and Application10.12677/CSA.2022.12616912:06(1685-1699)Online publication date: 2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '10: Proceedings of the 19th international conference on World wide web
April 2010
1407 pages
ISBN:9781605587998
DOI:10.1145/1772690

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. multi-service application
  2. resource provisioning

Qualifiers

  • Research-article

Conference

WWW '10
WWW '10: The 19th International World Wide Web Conference
April 26 - 30, 2010
North Carolina, Raleigh, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)27
  • Downloads (Last 6 weeks)4
Reflects downloads up to 22 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)FuncScaler: Cold-Start-Aware Holistic Autoscaling for Serverless Resource Management2024 IEEE International Conference on Web Services (ICWS)10.1109/ICWS62655.2024.00122(1036-1047)Online publication date: 7-Jul-2024
  • (2023)DeepScaler: Holistic Autoscaling for Microservices Based on Spatiotemporal GNN with Adaptive Graph LearningProceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE56229.2023.00038(53-65)Online publication date: 11-Nov-2023
  • (2022)An Automatic Performance Profiling Method Based on Microservice Monitoring System in Cloud ComputingComputer Science and Application10.12677/CSA.2022.12616912:06(1685-1699)Online publication date: 2022
  • (2022)State Space Model and Queuing Network Based Cloud Resource Provisioning for Meshed Web SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.317083433:12(3787-3799)Online publication date: 1-Dec-2022
  • (2022)An Automatic Scaling System for Online Application with Microservices Architecture2022 IEEE International Conference on Joint Cloud Computing (JCC)10.1109/JCC56315.2022.00018(73-78)Online publication date: Aug-2022
  • (2022)HRA: An Intelligent Holistic Resource Autoscaling Framework for Multi-service Applications2022 IEEE International Conference on Web Services (ICWS)10.1109/ICWS55610.2022.00033(129-139)Online publication date: Jul-2022
  • (2021)Elastic Scheduling for Microservice Applications in CloudsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.301197932:1(98-115)Online publication date: 1-Jan-2021
  • (2021)A Holistic Auto-Scaling Algorithm for Multi-Service Applications Based on Balanced Queuing Network2021 IEEE International Conference on Web Services (ICWS)10.1109/ICWS53863.2021.00074(531-540)Online publication date: Sep-2021
  • (2021)WITHDRAWN: A review on modeling techniques of quality-of-serviceMaterials Today: Proceedings10.1016/j.matpr.2020.12.536Online publication date: Feb-2021
  • (2020)Self-managed services using MirageOS unikernelsProceedings of the 21st International Middleware Conference Doctoral Symposium10.1145/3429351.3431748(35-37)Online publication date: 7-Dec-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

EPUB

View this article in ePub.

ePub

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media