1,140 questions
-2 votes
0 answers
58 views
Public Key Retrieval is not allowed [duplicate]
I tried to connect to curl -X POST -H "Accept:application/json" --data @debezium-mysql.json http://localhost:8083/connectors debezium-mysql.json { "name": "mysql-...
0 votes
0 answers
38 views
dezebium connectors API not found [closed]
I tried to install debezium connector from docker compose yml. https://github.com/binodsuman/change_data_capture/tree/main and test the mysql connector if its works. curl -S http://localhost:8083/...
0 votes
1 answer
38 views
InvalidPartitionsException: Can not increase partition count due to FD limit
When I tried to create a topics on Redpanda (or Apache Kafka). The task is FAILED due to this specific error: { "name": "MY-table", "connector": { "...
Best practices
1 vote
2 replies
81 views
Debezium + Transaction Outbox in Spring Boot: how to avoid duplicate Kafka events with CDC when reprocessing and multiple consumers?
I’m implementing the Transaction Outbox pattern using Debezium CDC in a Spring Boot microservice and I’m struggling with duplicate event semantics in failure and reprocessing scenarios. Tech stack: ...
Best practices
0 votes
0 replies
30 views
Debezium SQL Server v2: Best practices for handling Schema Namespace fragmentation across multiple DB shards (SpecificRecord issue)
I am looking for advice on how to handle Avro schema namespaces when ingesting data from multiple identical SQL Server databases (sharding scenario) using the Confluent FullyManaged SQL Server ...
0 votes
0 answers
126 views
Kafka Connect REST API returns Request timed out. The worker is currently ensuring membership in the cluster
I am trying to register a Debezium MySQL connector using Kafka Connect REST API, but the request fails with a timeout error even before the connector configuration is validated. Command used curl -X ...
1 vote
1 answer
194 views
Understanding Debezium Snapshot
Debezium’s PostgreSQL snapshot docs note : always The connector performs a snapshot every time that it starts. The snapshot includes the structure and data of the captured tables. Specify this value ...
0 votes
1 answer
108 views
Capture Oracle metadata via Debezium connector
I'm sourcing Oracle data into Kafka topics using Debezium Oracle connector. I have a source Oracle table, as below: CREATE TABLE MYDATA.MY_USER ( USER_ID RAW(16) DEFAULT SYS_GUID() NOT ...
0 votes
1 answer
239 views
Setup Kafka Consumers to process Debezium snapshot before current events
I am working with Java/Spring/Kafka on a new system that will consume events from both compacted topics and standard non compacted CDC topics. The events on these topics are published by a Debezium ...
0 votes
1 answer
90 views
Google Cloud PubSub Synchronous Pull: Getting One Message at a Time Instead of Batches
Problem I'm using Google Cloud PubSub with synchronous pull and ordering enabled to consume messages from a Debezium Server setup, but I'm only receiving one message at a time instead of getting ...
0 votes
1 answer
255 views
Custom Debezium image falling with FileNotFoundException: /opt/kafka/custom-config/log4j.properties
I am trying to get debezium up and running on EKS. However i keep running into errors. Below is the dockerfile which i have created to build the image and push it to ECR FROM quay.io/strimzi/kafka:...
0 votes
1 answer
167 views
Cannot create second debezium connector to the same oracle DB
First, I know it is not suggested to run multiple connectors to the same DB but we have to do that in current ciscumstances, at least for a while. Soo in current scenario, we have two separate Azure ...
0 votes
0 answers
49 views
Debezium initial snapshot on demand
I have a debezium 3.0 in my python project. Postgres-debezium connector has the following structure: { "name": "dbz_name", "config": { "connector.class&...
0 votes
0 answers
41 views
Confluent S3 Sink Connector producing millions of small files despite large flush.size and rotate.interval
The S3 connector creates approximately 1 million tiny files per hour instead of the expected larger files. Each file contains only a few records (~3KB) RootCause : Two Debezium CDC connectors (owned ...
0 votes
0 answers
72 views
Restart Debezium by clicking a button on the web application In the Kubernetes environment
I have 3 pods running in a Kubernetes environment. The three pods are as follows: (1) Web application pod (2) Oracle database (3) Debezium The web application is connected to an Oracle database, ...