Kafka Connect Elasticsearch Sink 连接器写入索引实践

es-sink.json：{

"name": "es-sink",

"config": {

"connector.class": "io.confluent.connect.elasticsearch.ElasticsearchSinkConnector",

"tasks.max": "2",

"topics": "orders",

"connection.url": "http://es:9200",

"key.ignore": "false",

"write.method": "upsert",

"type.name": "_doc",

"behavior.on.malformed.documents": "ignore",

"schema.ignore": "true",

"max.in.flight.requests": "1",

"flush.timeout.ms": "60000",

"batch.size": "2000",

"max.buffered.records": "20000"

}

}

REST 创建与状态：curl -X POST -H "Content-Type: application/json" --data @es-sink.json http://localhost:8083/connectors

curl http://localhost:8083/connectors/es-sink/status