apache / apache/paimon

[Bug] Row field descriptions are ignored when creating tables with Flink SQL

Open
#4,642 3 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Paimon version

a389af62b7a254ffabb91a9e43dfe8a90695e899

### Compute Engine

Flink

### Minimal reproduce step

Use `sql-client.sh` and create this table in a Paimon catalog:
```
CREATE TABLE my_table (my_row ROW);

SHOW CREATE TABLE my_table;
CREATE TABLE `my_catalog`.`my_database`.`my_table` (
`my_row` ROW<`my_field` INT>
) WITH (
'path' = 'file:/paimon_data/my_database.db/my_table'
)
```

### What doesn't meet your expectations?

Descriptions of row fields are not persisted when using Flink SQL. This is a problem when manually creating tables for the [KafkaSyncTableAction](https://paimon.apache.org/docs/master/api/java/org/apache/paimon/flink/action/cdc/kafka/KafkaSyncTableAction) which uses descriptions on row fields, causing schema mismatches.

### Anything else?

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the issue with Flink's sql-client.sh using the CREATE TABLE statement in the report, then inspect the Flink SQL schema conversion and the SHOW CREATE TABLE path. Compare the row-field description before and after table creation, and confirm the fix preserves it so KafkaSyncTableAction no longer encounters schema mismatches.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, sql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.