apache / apache/parquet-java

"parquet-tools cat -j" should not output metadata

Open
#2,559 0 comments 0 reactions 0 assignees View on GitHub
Component: Java Component: Parquet Priority: Major Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

Parquet-tools cat -help says:

```

parquet-tools cat:
Prints the content of a Parquet file. The output contains only the data, no
metadata is displayed
```

Let's say I have a structure like this in a Parquet file:
```json

{
"account":
[
{
"accountDepositType": "NA",
"accountNumber": "NA",
"accountHolderType": "NA"
}
]
}
```

it is extracted like this

```json

{
"account": {
"list": [
{
"element": {
"accountDepositType": "NA",
"accountNumber": "NA",
"accountHolderType": "NA"
}
}
]
}
}
```

**"list"** and **"element"** is metadata or type information if you like and it should not appear in output.

Can you please fix that ?

**Reporter**: [Dumitru Husleag](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=dumitru21)

**Note**: *This issue was originally created as [PARQUET-1956](https://issues.apache.org/jira/browse/PARQUET-1956). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the parquet-tools cat -j command and its help text, then trace how nested list data is rendered in the JSON output. Use the sample structure from the issue to verify that the list and element wrappers are omitted while the account fields remain. Done means the output contains the data without those metadata or type-information nodes.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
cli, data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.