apache / apache/parquet-java

Boolean format in Plain Decoder

Open
#1,957 6 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Priority: Trivial Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

In the encoding.md document is written that the plain encoder for boolean uses [RLE/BitPacking](https://github.com/apache/parquet-format/blob/master/Encodings.md#plain-plain--0)

While in the cpp implementation seems is just using [simple bit decoding back to back.](https://github.com/apache/parquet-cpp/blob/master/src/parquet/encodings/plain-encoding.h#L151)

Which one is the right format ?

**Reporter**: [Fabrizio Milo](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=fmilo)

**Note**: *This issue was originally created as [PARQUET-574](https://issues.apache.org/jira/browse/PARQUET-574). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with encoding.md and the linked Encodings.md section describing boolean PLAIN encoding, then compare it with parquet-cpp/src/parquet/encodings/plain-encoding.h around line 151. Determine which representation is correct and update the documentation or implementation accordingly, with the specification and behavior consistent when done.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, java
Domain
documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.