[Umbrella] [Feature] Supported More Formats
- Dominant language
- Java
- Stars
- 3.4k
- Forks
- 1.4k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 396
Description
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
### Motivation
Flink provides several Kafka CDC formats :canal-json、debezium-json,ogg-json,maxwell-json. Now only supports canal, the scope of support needs to be expanded to achieve a better experience of entering the lake.
- [x] Optimize format scalability #1827
- [x] Supported Ogg Format #1827
- [ ] Supported debezium avro format ##2070
- [ ] Supported Debezium Format #2020
- [x] #1936
- [x] Supported Maxwell Format #1963
### Solution
_No response_
### Anything else?
_No response_
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
Contributor guide
No contributing guide indexed for this repository
Research direction
Begin with the unchecked Debezium Avro format item (#2070) and Debezium format item (#2020), then review the completed checklist entries for the intended scope. The issue does not name source files or tests; done means expanding supported Kafka CDC formats beyond canal, including the remaining formats.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, kafka
- Domain
- data-engineering, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100