4,602 questions
4 votes
0 answers
37 views
Spring Kafka ordering breaking even with same partition key
I am facing a condition in a Spring Boot application where Update events are sometimes processed before Create events, even though both messages are produced with the same partitioning key. The Setup: ...
0 votes
0 answers
64 views
Spring Kafka @KafkaListener stops consuming messages after some time (manual_immediate ack, FixedBackOff, multiple clusters) for AWS MSK topics
We are facing an intermittent issue with Spring Kafka where a consumer stops processing messages after some time. Restarting the application fixes the issue temporarily for some topics. Environment ...
0 votes
0 answers
28 views
SeekToCurrentErrorHandler does not apply retry count and does not redirect to DLT recoverer
im using an old version of spring kafka, so i cannot use the DefaultErrorHandler, im stuck with the SeekToCurrentErrorHandler but it is not processing the retry count and redirecting to DLT after the ...
1 vote
0 answers
202 views
Spring-Boot Kafka Property-File Configuration
We use Kafka in Spring-Boot 3.4 and we want to upgrade to 4.0 We have some consumers with a Kafka-Listerner annotation. The whole config is in the application yaml-file. We just have the annotation ...
0 votes
0 answers
162 views
Spring Kafka consumer stops consuming after 1–2 days with ExpiringCredentialRefreshingLogin logs
I have a Spring Kafka application with a single consumer. The Kafka client authentication is configured using SASL/OAUTHBEARER over SSL, as shown below: authProps.put(SaslConfigs.SASL_MECHANISM,...
Advice
1 vote
1 replies
67 views
Spring boot Kafka batching for all partitions
I have Spring Boot with Kafka batching and a topic with 3 partitions. For example, I want to have 1 batch with 100 records continuously if I have a lot of messages in the topic, but if I have a low ...
3 votes
1 answer
513 views
Spring Boot 4 + Kafka in transaction mode
I created a simple application which just sends in a loop messages to Kafka using KafkaTemplate with transaction mode. But, unfortunately, my code doesn't work with @Transactional in the new Spring. I ...
1 vote
0 answers
30 views
Storing Domain Events directly in Outbox table vs mapping to Integration Events in Java/Spring (DDD based Microservices) [duplicate]
I have a Spring Boot / Java application following Domain-Driven Design and Event-Driven Architecture. In my domain service, I create a ReservationCreatedEvent (a domain event) and publish it: ...
1 vote
0 answers
47 views
IdempotencyBreachExceptionHandling in service used in kafka listener
I’m encountering an issue with possible idempotencyBreachException in a service used by Kafka listener. I’m not entirely sure how to handle this situation correctly. I have a lockExecutor that locks a ...
Best practices
0 votes
0 replies
38 views
Throw message on DLT/DLQ from GlobalKTable using Kafka Streams
I am reading data from a Kafka topic using Kafka Streams and more specifically GlobalKTable to populate my store. In the case of corrupt data that can not successfully be parsed I wish to throw a ...
Best practices
0 votes
7 replies
85 views
How to populate two stores from one topic using Kafka Streams GlobalKTable
I am using Kafka Streams, and trying to figure out the best practice for handling multiple stores that are populated using the same data without having to read it twice. My Kafka Streams service is ...
1 vote
0 answers
70 views
Ack messages with StreamBridge::send and Kafka
Context. I have to use StreamBridge::send() with Kafka. This is a hard, external requirement. The call itself looks like streambridge.send(binding, message). All good. To capture the non-immediate ...
0 votes
1 answer
64 views
Could not use same main and retry topic with @RetryableTopic annotation
I have one main topic my-test-topic which is consumed in batch, done asynchronously for each message with Future and then joined before committing the offset for the whole batch. The failed ones are ...
0 votes
0 answers
143 views
Could not instantiate KafkaProperties
I'm migrating from Spring Boot 2 to Spring Boot3, i'm NOT migrating to Sprinc Cloud 4 but i will stay to SpringCloud 3 (i know Spring Boot 3 is mandatory if you want to use Spring Cloud 4 but not the ...
1 vote
1 answer
200 views
Should I create a separate Integration Event when using the Outbox Pattern in a DDD-based microservice? [closed]
I’m building a Java microservice using Spring Boot 3.5.7, Kafka, and the Outbox Pattern. In my domain layer, I raise a domain event: package com.turkcell.reservation_service.domain.event; import com....