How and where can you view logs of any service?

Service logs can be viewed in several places, depending on the type of service and deployment method.

Main log viewing locations:

• Local files:

  • For services running directly on the server, logs are often written to files in directories like /var/log/ (Linux) or in specialized application directories.
  • Commands like cat, tail, less, grep are used.

  # View the last lines of a log file
  tail -f /var/log/myapp/service.log
  
  # Search for errors in a log file
  grep "ERROR" /var/log/myapp/service.log
  

• System journal (syslog/journald):

  • Applications can send logs to the system journal of the operating system.
  • In Linux, the journald system journal is viewed with the command journalctl.

  # View logs of a specific service
  journalctl -u my-service.service
  
  # View logs from a specific date
  journalctl --since "2023-01-01 10:00:00"
  

• Standard output/error streams:

  • Many modern applications, especially in containerized environments, output logs to standard output and error streams.
  • These streams can then be collected by container management or logging systems.

• Container management systems (Docker, Kubernetes):

  • Docker collects logs from container standard streams and provides access via docker logs commands.
  • Kubernetes integrates with various log collection systems (e.g., Fluentd, Logstash) for centralized log collection from pods and their forwarding to storage.

  # View Docker container logs
  docker logs <container_id_or_name>
  
  # View Kubernetes pod logs
  kubectl logs <pod_name> -n <namespace>
  

• Centralized logging systems:

  • Mature infrastructures use specialized platforms for collecting, aggregating, analyzing, and visualizing logs from multiple sources.
  • Examples include: ELK Stack (Elasticsearch, Logstash, Kibana), Splunk, Grafana Loki, Datadog, Sumo Logic.
  • Access to logs is via web interface or APIs of these systems.

• Cloud platforms:

  • Cloud providers offer their own services for log collection and analysis.
  • Examples: AWS CloudWatch Logs, Google Cloud Logging, Azure Monitor Logs.
  • Logs are accessible through cloud management consoles or their APIs.

The choice of viewing method depends on the application's architecture, the infrastructure used, and logging configurations. Centralized logging systems are preferred for complex distributed systems as they provide a single access point and powerful analysis capabilities.