AvroSchemaConverter silently drops typed_value when converting shredded variant schemas
- 主要语言
- Java
- 星标
- 3.1k
- 派生
- 1.6k
- 平均合并
- 3 天 12 小时
- 30 天内合并 PR
- 33
描述
### Describe the bug, including details regarding any error messages, version, and platform.
I noticed this on the parquet-cli while checking the schema for a shredded parquet file.
Essentially, given this Parquet schema:
```
message table {
required group data (VARIANT(1)) {
required binary metadata;
optional binary value;
optional group typed_value {
required group name {
optional binary value;
optional binary typed_value (STRING);
}
required group age {
optional binary value;
optional int32 typed_value (INTEGER(8,true));
}
}
}
}
```
AvroSchemaConverter.convert() produces:
```
{
"type": "record",
"name": "data",
"fields": [
{"name": "metadata", "type": "bytes"},
{"name": "value", "type": "bytes"}
]
}
```
`typed_value` is missing
Expected: The converter should convert all children of the VARIANT group (including typed_value when present)
Version: 1.18.0-SNAPSHOT
I can add a fix to this myself if there are no objections. If we want to keep this behavior, we should make a note.
### Component(s)
Avro
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。