Incorrect Kafka offset across consumer groups

Question

I have a topic which is consumed by two consumer groups. There are 10 messages in the topic.

Application 1 (Consumer group 1)has finished processing of messages from topic and when i describe kafka-consumer-groups (with --group consumerGroup1) then it correctly shows CURRENT-OFFSET =10 and LOG-END-OFFSET =10.

Now i start application 2 (Consumer group 2) which is consuming same topic. It is not processing messages . When i describe kafka-consumer-groups (with --group consumerGroup2) , it surprisingly shows CURRENT-OFFSET =10 and LOG-END-OFFSET =10.

Ideally this should not happen and kafka should be able to recognize that for the consumer group 2 there are no message processed and it should process all messages.

What could be wrong here.

Possible duplicate of Kafka consumer not returning any events — Bartosz Wardziński
– Bartosz Wardziński, Commented Jan 14, 2019 at 9:23

Bartosz Wardziński · Accepted Answer · 2019-01-14 09:23:14Z

2

You have to set earliest property in your KafkaStreams Properties

Kafka consumer not returning any events

answered Jan 14, 2019 at 9:23

Bartosz Wardziński

6,6531 gold badge25 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

whysoseriousson Over a year ago

All heroes don't wear capes . It Worked like a charm. Thanks a lot

Collectives™ on Stack Overflow

Incorrect Kafka offset across consumer groups

1 Answer 1

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Linked

Related