How have you implemented log collection and monitoring in a microservices architecture?

For log collection in a microservices architecture, centralized logging systems such as the ELK stack (Elasticsearch, Logstash, Kibana) or Fluentd + Grafana are typically used.

Each microservice sends logs to a common aggregator, where they are indexed and available for search and analysis. This allows for quick error detection and system behavior tracking.

For monitoring, Prometheus with an exporter for application metrics and Grafana for visualization are used. Alerts are configured for key metrics (latency, errors, load) to respond promptly to issues.

An example configuration for sending logs from a Spring Boot application to Logstash:

logging:
  level:
    root: INFO
  pattern:
    console: "%d{yyyy-MM-dd HH:mm:ss} %-5level %logger{36} - %msg%n"

# In code, you can use the logger as follows:
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;

public class MyService {
    private static final Logger logger = LoggerFactory.getLogger(MyService.class);

    public void process() {
        logger.info("Starting data processing");
        try {
            // business logic
        } catch (Exception e) {
            logger.error("Error during processing", e);
        }
    }
}

Thus, transparency and control over the state of the distributed system are ensured.