apache / apache/doris-flink-connector
Release Note 1.4.0
- Dominant language
- Java
- Stars
- 385
- Forks
- 279
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 6
Description
## Feature & Improvement
1. Support Flink1.17 version
2. Support Synchronize the mysql database
In version 1.4.0, FlinkCDC is integrated to support MySQL's entire database synchronization. Users can use Connector to quickly access the upstream business database.
3. Asynchronous Lookup Join was introduced in version 1.4.0, and on this basis, the logic of querying and batching was added.
4. 1.4.0 introduced the thrift-service sdk, which blocked the Thrfit plug-in and lowered the threshold for compiling.
5. when there is no data import, the StreamLoad connection import will not be enabled
6. Version 1.4.0 introduces a polling mechanism, and BE nodes are replaced during each Checkpoint, avoiding the pressure of a single node acting as a Coordinator for a long time.
7. Support reading Doris's DecimalV3/DateV2/DateTimev2/Array/JSONB type (Doris must be 2.0 or above).
## Bug
1. Fix the concurrency problem when streamload link check
2. Fix the problem that some timeout parameters of connection doris do not take effect
3. Fix the problem that the hidden separator does not take effect when writing
4. Fix the problem that the query plan of reading dori is too long and the serialization fails
## Thanks
Thanks to everyone who has contributed to this release:
@caoliang-web
@DongLiang-0
@gnehil
@GoGoWen
@JNSimba
@legendtkl
@lsy3993
@Myasuka
@wolfboys
Contributor guide
Research direction
The payload names no file, test, or entry point. Review the repository's release-note location and conventions first; completion would require a confirmed, accurately formatted 1.4.0 release note covering the listed features, fixes, and contributors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100