How to implement Dead Letter Queue (DLQ) in Kafka?

Dead Letter Queue (DLQ) in Kafka is implemented as a separate topic where messages that could not be processed after several attempts are sent.

Main steps to implement DLQ:

1. Create a separate Kafka topic, for example, my_topic_dlq.
2. In your consumer, implement retry logic when processing messages.
3. If the message is not processed after a set number of attempts, send it to the DLQ topic.

Example in Go using Sarama:

const maxRetries = 3

func consumeAndProcess(consumer sarama.Consumer, producer sarama.SyncProducer, topic, dlqTopic string) {
    partitionConsumer, _ := consumer.ConsumePartition(topic, 0, sarama.OffsetNewest)
    for msg := range partitionConsumer.Messages() {
        success := false
        for i := 0; i < maxRetries; i++ {
            if processMessage(msg.Value) {
                success = true
                break
            }
        }
        if !success {
            // Send to DLQ
            producer.SendMessage(&sarama.ProducerMessage{
                Topic: dlqTopic,
                Value: sarama.ByteEncoder(msg.Value),
            })
        }
    }
}

This approach allows isolating problematic messages and analyzing them separately without blocking the main processing thread.