I am developing a Quarkus app that produce and consume Kafka messages from a topic. I am trying to configure it to create big batches of messages but I am having trouble with it. This is my code: ...

I am trying to publish messages to a Kafka cluster that is SSL protected. I have correct certificates on the application side. I checked I can consume from this kafka cluster using those. Also, the ...

I would like to implement a circuit breaker pattern for the Kafka producer, not the consumer. There is documentation that can be found online regarding implementing the circuit breaker pattern for ...

A Kafka broker compares the PID (producer ID) and a message sequence number (generated by the producer) to deduplicate messages for idempotent producers. Once a transactional producer retains the PID ...

I have Kafka Producer and Consumer configured in Spring Boot application (Spring Boot version 3.4.2). application.properties: spring.kafka.bootstrap-servers=localhost:9092 spring.kafka.consumer.group-...

KAFKA: Error while sending message for exception: org.apache.kafka.common.errors.TimeoutException: Failed to allocate memory within the configured max blocking time 60000 ms Configuration I am using: ...

I am receiving tick data from a websocket connection. As soon as I receive the data, I need to publish it to Kafka. What I have tried so far is, as soon as I receive the data from the websocket, I ...

I want to use Helidon SE 4.1.6 and producer the data to a specific partition of Apache Kafka using producer. Detail : I have gone through the https://helidon.io/docs/latest/se/reactive-messaging#...

KafkaError{code=_MSG_TIMED_OUT,val=-192,str="Local: Message timed out"} Receuvung the errir when producing a message to a kafka topic from airflow task (python operator). When producing the ...

I'm verifying the Protobuf schema using the Kafka schema registry. The problem is that even though I put in the correct schema, I still get the error Broker: Broker failed to verify record. The schema ...

I have the following setup: Kafka broker (3.9.0) Kafka producer (for now, using the producer-console in kafka itself) This setup works fine for basic TCP, TLS and even tried SASL authentication using ...

Im new in kafka and kubernates. Im using bitnami chart to deploy kafka in my kind cluster kubernetes (on my own server). Im trying to connect to kafka from my spring boot application, that started on ...

I have a json payload that I am using to produce a kafka message via Kouncil, json is as below: { "version": "1.0", "id": "product-1730976584", &...

I am working on a Spring Boot application where I am using Kafka to send messages to a topic. I am setting a specific key for each message, but after successfully sending the message, when I check the ...

i'm working with PySpark and trying to send a partitioned DataFrame to Kafka using the confluent-kafka library's Producer. However, I'm encountering a serialization problem with the Kafka producer on ...