How to add to the system a storage of all events from the entire project for analytics and aggregation?

To add all project events to the system storage for analytics and aggregation purposes, you can implement a centralized event bus or use ready-made solutions such as Kafka, RabbitMQ, or Google Pub/Sub. In Go, you can create a layer that publishes events to this broker.

Main steps:

1. Define the event format (e.g., JSON with fields: event type, time, data).
2. Publish events to a queue or topic at the event generation points.
3. Create a separate service or component that subscribes to these events and stores them in storage (e.g., ClickHouse, Elasticsearch, TimescaleDB).

Example of publishing an event to Kafka in Go:

import (
    "github.com/segmentio/kafka-go"
    "context"
    "encoding/json"
    "time"
)

type Event struct {
    Type string `json:"type"`
    Timestamp time.Time `json:"timestamp"`
    Payload interface{} `json:"payload"`
}

func publishEvent(writer *kafka.Writer, event Event) error {
    data, err := json.Marshal(event)
    if err != nil {
        return err
    }
    return writer.WriteMessages(context.Background(),
        kafka.Message{
            Key:   []byte(event.Type),
            Value: data,
        },
    )
}

Thus, you centralize event collection, which simplifies subsequent analytics and aggregation.