对elasticsearch进行多个index在多个线程中同步的时候会产生丢数据问题？
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
我们的项目依赖的大概是一年以前的datax版本，然后elasticsearch的writer是基于2019-1-10的版本
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing synchronization from multiple indexes with multiple threads using the approximately one-year-old DataX version and the Elasticsearch writer based on the 2019-01-10 version. Inspect the Elasticsearch writer entry point and compare source and destination record counts; the issue is done when the reproduction no longer loses data and the behavior is verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch, java
- Domain
- data-engineering, search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100