apache / apache/parquet-java

[parquet-tools] dump command shows binary values differenty than the cat or head commands

Open
#2,198 0 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Priority: Minor Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

`parquet-tools dump` shows binary values as strings, if they are valid UTF-8 sequences.

`parquet-tools cat` and `parquet-tools head` show binary values base64-encoded, regardless of whether they are valid UTF-8 sequences or not.

(If the type is annotated as UTF-8, the values are shown as strings by all of these commands.)

**Reporter**: [Zoltan Ivanfi](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=zi) / @zivanfi

**Note**: *This issue was originally created as [PARQUET-1347](https://issues.apache.org/jira/browse/PARQUET-1347). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the parquet-tools implementations of the dump, cat, and head commands and compare how they render binary values. Confirm the existing UTF-8 annotation behavior, then make the unannotated binary output consistent with cat and head by checking the command output against representative values.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
cli
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.