7 questions
1 vote
2 answers
1k views
Filtering out messages using tracing_subscriber::filter::Directive
I'm trying to filter out the PartitionEOF error log messages that the rdkafka crate produces when you have enable.partition.eof set to true. We're using the tracing and tracing-subscriber traits for ...
0 votes
1 answer
883 views
What is the purpose of the Kafka Consumer "subscription" function?
I am writing some test code to experiment with the Kafka Consumer subscription() function. I don't understand what the intended purpose of this function is. Here is a link to the JavaDoc reference, ...
-1 votes
1 answer
126 views
How to use functions which present an API in terms of "topic" and "partition"?
This is a question about how to use the Rust rdkafka APIs, most of which talk in terms of a topic name and partition number. Consider this example API: let metadata = consumer.fetch_watermarks(topic, ...
0 votes
0 answers
545 views
Rust rdkafka BaseConsumer can't poll data
I'm new to rust. Trying to read some data from kafka with rdkafka doesn't work. This is the most basic form of reading from kafka and it doesn't work. Here is my code: use std::time::Duration; use ...
0 votes
1 answer
442 views
Rust rd-kafka, how to find the valid string to set "partition.assignment.strategy"
I am trying to add "partition.assignment.strategy" to a Rust (rd-kafka) consumer. rd-kafka uses libkafka (C implementation) directly. I searched for both rd-kafka documentation and libkafaka ...
0 votes
1 answer
379 views
Setting up mateusjunges/laravel-kafka with AWS MSK cluster
I have defined the KAFKA_BROKERS key value with the aws broker string and specified the AWS AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY in the .env but when running the application, I am receiving the ...
1 vote
1 answer
468 views
Find kafka partition number programatically (or otherwise) using rust
New to both rust and kafka, so bear with me. I'm trying to seek to a particular offset when firing up a kafka consumer using rust-rdkafka. The method to do the seeking has a i32 parameter for ...