What methods can ensure message delivery with at least once guarantee in Kafka?

To ensure at-least-once message delivery in Apache Kafka, the following methods can be used:

1. Enabling acknowledgments (acks): Set the acks parameter to all or -1 in the producer. This guarantees that the message is considered written only after all replicas confirm the write.

2. Using an idempotent producer: Enabling idempotence (enable.idempotence=true) prevents duplicate messages during retries.

3. Offset handling in the consumer: The consumer should commit offsets after successful message processing to avoid loss or reprocessing.

4. Retry sending: The producer can be configured with retry count (retries) and timeouts for resending messages upon errors.

Example of producer configuration in Java:

Properties props = new Properties();
props.put("bootstrap.servers", "localhost:9092");
props.put("acks", "all");
props.put("enable.idempotence", "true");
props.put("retries", Integer.toString(Integer.MAX_VALUE));
props.put("key.serializer", "org.apache.kafka.common.serialization.StringSerializer");
props.put("value.serializer", "org.apache.kafka.common.serialization.StringSerializer");

KafkaProducer<String, String> producer = new KafkaProducer<>(props);

Thus, the combination of acknowledgments, idempotence, and proper offset handling ensures at-least-once message delivery.