apache / apache/parquet-java

Question on parquet-protobuf and parquet-pig

Open
#1,870 0 comments 0 reactions 0 assignees View on GitHub
Component: Java Component: Parquet Priority: Major Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

Hi,

I have a question about protobuf to parquet conversion.
I have a message like this (simplified) :
```Java

message MyMessage {
repeated string language = 1;
}
```

parquet-protobuf convert it to the following schema :

```Java
message MyMessage {
repeated binary language (UTF8);
}
```

But, according to TestPigSchameConverter.java, the correct schema should be :

```Java
message MyMessage {
optional group language (LIST) {
repeated binary value (UTF8);
}
}
```

Language is an optional list of language, i want to store zero or more language.

Who have the correct schema for my case ? parquet-protobuf or parquet-pig ?

**Reporter**: [Christian Nguyen Van Than](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=cnguyen@nextperf.com)

**Note**: *This issue was originally created as [PARQUET-354](https://issues.apache.org/jira/browse/PARQUET-354). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.