How do you work with Kafka and RabbitMQ?

Kafka and RabbitMQ are message exchange systems, but with different architectures and applications.

Kafka is a distributed data streaming platform focused on high throughput and message storage in topics with re-read capability. It is used for processing large volumes of data in real-time, such as logging, analytics, and microservices integration.

RabbitMQ is a message broker implementing the AMQP protocol, aimed at reliable message delivery and complex routing. It is often used for task queues, asynchronous processing, and system integration.

In working with them, I:

• Define system requirements (performance, reliability, message order).
• Choose the appropriate tool: Kafka for streaming and storage, RabbitMQ for queues and routing.
• Configure topics/queues, producers, and consumers.
• Handle errors and ensure re-delivery.

Example of using Kafka in Java:

Properties props = new Properties();
props.put("bootstrap.servers", "localhost:9092");
props.put("key.serializer", "org.apache.kafka.common.serialization.StringSerializer");
props.put("value.serializer", "org.apache.kafka.common.serialization.StringSerializer");
KafkaProducer<String, String> producer = new KafkaProducer<>(props);
producer.send(new ProducerRecord<>("topic", "key", "message"));
producer.close();

Example of using RabbitMQ in Python:

import pika
connection = pika.BlockingConnection(pika.ConnectionParameters('localhost'))
channel = connection.channel()
channel.queue_declare(queue='task_queue')
channel.basic_publish(exchange='', routing_key='task_queue', body='Hello World!')
connection.close()