skip to main content
research-article
Free Access

Cluster-level Logging of Containers with Containers: Logging Challenges of Container-Based Cloud Deployments

Published:14 May 2016Publication History
Skip Abstract Section

Abstract

This article shows how cluster-level logging infrastructure can be implemented using open source tools and deployed using the very same abstractions that are used to compose and manage the software systems being logged. Collecting and analyzing log information is an essential aspect of running production systems to ensure their reliability and to provide important auditing information. Many tools have been developed to help with the aggregation and collection of logs for specific software components (e.g., an Apache web server) running on specific servers (e.g., Fluentd and Logstash.) They are accompanied by tools such as Elasticsearch for ingesting log information into persistent storage and tools such as Kibana7 for querying log information.

References

  1. Burns, B., Grant, B., Oppenheimer, D., Brewer, E., Wilkes, J. 2016. Borg, Omega, and Kubernetes. acmqueue 14(1); http://queue.acm.org/detail.cfm?id=2898444. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Docker; www.docker.com.Google ScholarGoogle Scholar
  3. Elasticsearch. Elastic; https://www.elastic.co/products/elasticsearch.Google ScholarGoogle Scholar
  4. Fluentd; http://www.fluentd.org/.Google ScholarGoogle Scholar
  5. Google Compute Engine; https://cloud.google.com/compute/.Google ScholarGoogle Scholar
  6. Google Container Engine; https://cloud.google.com/container-engine/.Google ScholarGoogle Scholar
  7. Kibana. Elastic; https://www.elastic.co/products/kibana.Google ScholarGoogle Scholar
  8. Kubernetes; http://kubernetes.io/.Google ScholarGoogle Scholar
  9. Logstash. Elastic; https://www.elastic.co/products/logstash.Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image Queue
    Queue  Volume 14, Issue 3
    Microservices
    May-June 2016
    102 pages
    ISSN:1542-7730
    EISSN:1542-7749
    DOI:10.1145/2956641
    Issue’s Table of Contents

    Copyright © 2016 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 14 May 2016

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Popular
    • Refereed

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format