apache / apache/beam

Parquet IO position invalid when writing integers

Open
#18,980 0 comments 0 reactions 0 assignees View on GitHub
bug io java P3 parquet
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Please see [https://github.com/apache/beam/blob/master/sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java#L345](https://github.com/apache/beam/blob/master/sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java#L345)

On write(int b), position is incremented by 1. On write(byte[] b, int off, int len) position is incremented by the length of the byte array.

write(int b) should increment by 4 bytes, if I'm understanding correctly.

Imported from Jira [BEAM-5222](https://issues.apache.org/jira/browse/BEAM-5222). Original Jira may contain additional context.
Reported by: ghilios.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.