alibaba / alibaba/DataX

elasticsearchwriter对 es7.9.2 版本settings不生效

Open
#866 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

使用elasticsearchwriter往 elasticsearch7.9.2 版本写数据, settings配置没有生效
elasticsearch 版本 7.9.2
datax配置:
"writer": {
"name": "elasticsearchwriter",
"parameter": {
"endpoint": "http://XXXX:9200",
"accessId": "xxxx",
"accessKey": "xxxx",
"index": "XXXXX",
"type": "_doc",
"cleanup": true,
"settings": {"index": {"number_of_shards": 2, "number_of_replicas": 0}},
"column": [
{"name": "company_id", "type": "integer"},
{ "name": "company_nm","type": "text" }
],
"discovery": false,
"dynamic": false,
"batchSize": 1000
}
}
}

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported DataX elasticsearchwriter configuration against Elasticsearch 7.9.2, then trace how the writer handles the supplied settings object. Done means the configured shard and replica settings are applied when the index is created.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, java
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.