---
title: Kafka Connect 与 Debezium MySQL CDC 实战
keywords:
- Kafka Connect
- Debezium
- MySQL CDC
- Binlog
- Connector
description: 使用 Debezium 在 Kafka Connect 中捕获 MySQL 变更,提供 Connector 配置与主题命名规范,适合增量数据管道。
tags:
- Binlog
- Connector
- Debezium
- Kafka
- Kafka Connect
- MySQL CDC
- 后端
- 数据同步
categories:
- 文章资讯
- 技术教程
---
Kafka Connect 与 Debezium MySQL CDC 实战
前置条件
- MySQL 启用 binlog:
log_bin,binlog_format=ROW - 为连接器账户授予
REPLICATION SLAVE与REPLICATION CLIENT
连接器配置(HTTP)
POST /connectors
Content-Type: application/json
{
"name": "debezium-mysql",
"config": {
"connector.class": "io.debezium.connector.mysql.MySqlConnector",
"database.hostname": "mysql",
"database.port": "3306",
"database.user": "debezium",
"database.password": "secret",
"database.server.id": "184054",
"database.server.name": "db",
"database.include.list": "app",
"table.include.list": "app.items",
"include.schema.changes": "false",
"decimal.handling.mode": "double"
}
}
主题命名
- 变更主题:
db.app.items
验证
- 消费
db.app.items主题,观察op字段的c/u/d变更类型
总结
Debezium 提供稳定的 CDC 能力,配合 Kafka Connect 便于扩展增量数据处理链路。

发表评论 取消回复