apache / apache/doris-flink-connector

Release Note 1.4.0

Open
#148 7 comments 0 reactions 0 assignees View on GitHub
release notes
Dominant language
Java
Stars
385
Forks
279
Avg merge
2d 2h
Merged PRs (30d)
6

Description

## Feature & Improvement
1. Support Flink1.17 version
2. Support Synchronize the mysql database
In version 1.4.0, FlinkCDC is integrated to support MySQL's entire database synchronization. Users can use Connector to quickly access the upstream business database.
3. Asynchronous Lookup Join was introduced in version 1.4.0, and on this basis, the logic of querying and batching was added.
4. 1.4.0 introduced the thrift-service sdk, which blocked the Thrfit plug-in and lowered the threshold for compiling.
5. when there is no data import, the StreamLoad connection import will not be enabled
6. Version 1.4.0 introduces a polling mechanism, and BE nodes are replaced during each Checkpoint, avoiding the pressure of a single node acting as a Coordinator for a long time.
7. Support reading Doris's DecimalV3/DateV2/DateTimev2/Array/JSONB type (Doris must be 2.0 or above).

## Bug
1. Fix the concurrency problem when streamload link check
2. Fix the problem that some timeout parameters of connection doris do not take effect
3. Fix the problem that the hidden separator does not take effect when writing
4. Fix the problem that the query plan of reading dori is too long and the serialization fails

## Thanks
Thanks to everyone who has contributed to this release:
@caoliang-web
@DongLiang-0
@gnehil
@GoGoWen
@JNSimba
@legendtkl
@lsy3993
@Myasuka
@wolfboys

Contributor guide

Open the contributing guide

Research direction

The payload names no file, test, or entry point. Review the repository's release-note location and conventions first; completion would require a confirmed, accurately formatted 1.4.0 release note covering the listed features, fixes, and contributors.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
documentation
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.