Stefan Walraven
ABSTRACT
Multi-tenancy has shown promising results in achieving high operational cost efficiency by sharing hardware and software resources among multiple customer organisations, called tenants. In the context of cloud computing, this paradigm enables cloud providers to reduce operational costs by dividing resources and to simplify application management and maintenance. Maximum cost efficiency is achieved with application-level multi-tenancy. However, this high level of resource sharing complicates performance isolation between the different tenants, i.e. ensuring compliance with the SLAs of the different tenants and ensuring that the behaviour of one tenant cannot adversely affect the performance of the other tenants.
This paper explores the challenges of performance isolation in the context of multi-tenant SaaS applications. In addition, we propose a middleware architecture to enforce performance isolation based on the tenant-specific SLAs, using a tenant-aware profiler and a scheduler. Our prototype reveals promising initial results.
- Amazon Web Services LLC. Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2/.Google Scholar
- C. P. Bezemer, A. Zaidman, B. Platzbeecker, T. Hurkmans, and A. Hart. Enabling Multi-Tenancy: An Industrial Experience Report. In ICSM '10: 26th International Conference on Software Maintenance, 2010. Google ScholarDigital Library
- H. Cai, N. Wang, and M. J. Zhou. A Transparent Approach of Enabling SaaS Multi-tenancy in the Cloud. In SERVICES-1 '10: 6th World Congress on Services, pages 40--47, July 2010. Google ScholarDigital Library
- F. Chong and G. Carraro. Architecture Strategies for Catching the Long Tail. Microsoft Corporation, http://msdn.microsoft.com/en-us/library/aa479069.aspx, April 2006.Google Scholar
- J. Elonen and K. Togias. NanoHTTPD. http://elonen.iki.fi/code/nanohttpd/.Google Scholar
- P. Fortin. Distributor. http://distributor.sourceforge.net/.Google Scholar
- I. Foster, Y. Zhao, I. Raicu, and S. Lu. Cloud Computing and Grid Computing 360-Degree Compared. In GCE '08: Grid Computing Environments Workshop, pages 1--10, 2008.Google ScholarCross Ref
- E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, Boston, MA, 1995. Google ScholarDigital Library
- C. J. Guo, W. Sun, Y. Huang, Z. H. Wang, and B. Gao. A Framework for Native Multi-tenancy Application Development and Management. In CEC/EEE '07: The 9th IEEE International Conference on E-Commerce Technology and the 4th IEEE International Conference on Enterprise Computing, E-Commerce, and E-Services, pages 551--558, July 2007.Google ScholarCross Ref
- D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing Performance Isolation across Virtual Machines in Xen. In Middleware '06: ACM/IFIP/USENIX International Conference on Middleware, pages 342--362. Springer Berlin/Heidelberg, 2006. Google ScholarDigital Library
- M. Jordan, L. Daynès, M. Jarzab, C. Bryce, and G. Czajkowski. Scaling J2EE#8482; Application Servers with the Multi-tasking Virtual Machine. Software: Practice and Experience, 36(6):557--580, 2006. Google ScholarDigital Library
- P. Leitner, B. Wetzstein, F. Rosenberg, A. Michlmayr, S. Dustdar, and F. Leymann. Runtime Prediction of Service Level Agreement Violations for Composite Services. In Service-Oriented Computing. ICSOC/ServiceWave 2009 Workshops, pages 176--186. Springer Berlin/Heidelberg, 2010. Google ScholarDigital Library
- X. Li, T. Liu, Y. Li, and Y. Chen. SPIN: Service Performance Isolation Infrastructure in Multi-tenancy Environment. In ICSOC '08: Service-Oriented Computing, pages 649--663. Springer Berlin/Heidelberg, 2008. Google ScholarDigital Library
- D. Lorenzoli and G. Spanoudakis. EVEREST+: Run-time SLA Violations Prediction. In MW4SOC '10: 5th International Workshop on Middleware for Service Oriented Computing, pages 13--18. ACM, 2010. Google ScholarDigital Library
- M. L. Massie, B. N. Chun, and D. E. Culler. The Ganglia Distributed Monitoring System: Design, Implementation, and Experience. Parallel Computing, 30(7):817--840, 2004.Google ScholarCross Ref
- Nagios Enterprises, LLC. Nagios. http://www.nagios.org/.Google Scholar
- Red Hat, Inc. Red Hat OpenShift. https://openshift.redhat.com/.Google Scholar
- D. Shue, M. J. Freedman, and A. Shaikh. Performance Isolation and Fairness for Multi-tenant Cloud Storage. In OSDI '12: 10th USENIX Symposium on Operating Systems Design and Implementation, 2012. Google ScholarDigital Library
- S. Walraven, E. Truyen, and W. Joosen. A Middleware Layer for Flexible and Cost-efficient Multi-tenant Applications. In Middleware '11: 12th ACM/IFIP/USENIX international conference on Middleware, pages 370--389. Springer Berlin/Heidelberg, 2011. Google ScholarDigital Library
- S. Zanikolas and R. Sakellariou. A Taxonomy of Grid Monitoring Systems. Future Generation Computer Systems, 21(1):163--188, 2005. Google ScholarDigital Library
Index Terms
- Towards performance isolation in multi-tenant SaaS applications
Recommendations
Towards Dynamic Tenant Management for Microservice based Multi-Tenant SaaS Applications
ISEC '18: Proceedings of the 11th Innovations in Software Engineering ConferenceIn a multi-tenant cloud application, more than one heterogeneous tenants share the single instance of the application. It increases the degree of resource sharing among tenants and brings down the operational cost. In this work, we propose a ...
Adaptive performance isolation middleware for multi-tenant SaaS
UCC '15: Proceedings of the 8th International Conference on Utility and Cloud ComputingSaaS providers typically adopt a multi-tenant architecture to leverage economies of scale. By maximizing the sharing of resources among multiple customer organizations, called tenants, operational costs are reduced. However, this high degree of resource ...
Feasibility of container orchestration for adaptive performance isolation in multi-tenant SaaS applications
SAC '20: Proceedings of the 35th Annual ACM Symposium on Applied ComputingSaaS application instances typically serve multiple tenants to improve cost-efficiency. This results in the need for adaptive performance isolation between tenants in order to guarantee custom service level objectives (SLOs) about request latency or ...
Comments