Can you explain the data replication mechanism in Kafka and its role in ensuring system fault tolerance?

In Kafka, data replication occurs at the partition level of topics. Each partition has one leader and several followers (replicas) that store copies of the leader's data. All records are written to the leader, and replicas asynchronously copy this data.

The role of replication is to ensure fault tolerance: if the partition leader fails, one of the replicas automatically becomes the new leader, allowing the system to continue operating without data loss. Thus, replication protects the system from individual broker failures and increases message delivery reliability.

Example: if a topic has 3 partitions, each with a replication factor of 3, then the data of each partition is stored on 3 brokers. If one broker fails, Kafka switches to the replica on another broker.