Junior
How are topics and partitions related in Kafka?
sobes.tech AI
Answer from AI
In Apache Kafka, a topic is a logical category or stream of messages where producers publish data and consumers read it. A topic is divided into multiple partitions for scalability and parallel processing.
Relationship between topics and partitions:
- Each topic consists of one or more partitions.
- Partitions are ordered, immutable sequences of messages.
- Messages within a partition have a unique offset index.
- Partitions allow load distribution among multiple brokers and consumers.
For example, if a topic has 3 partitions, messages will be distributed across these partitions (e.g., by key or round-robin), enabling parallel data processing and increasing system throughput.