Which Kafka topics will be in the reporting system, who produces and who consumes?

The reporting system typically uses the following Kafka topics:

• raw-events — a topic where raw source data from data sources (e.g., event logs, transactions) is produced. Producers are microservices or applications generating events.

• processed-reports — a topic for aggregated and processed data, ready for report generation. The producer is a data processing and aggregation service.

• alerts — a topic for notifications and warnings generated based on data analysis.

Consumers:

• Visualization and dashboard services read from processed-reports.

• Monitoring and alerting systems subscribe to alerts.

• Analytical modules can read from raw-events for additional processing.

Thus, producers and consumers are distributed across the system's functional zones, ensuring a data flow for report building and monitoring.