"parquet-tools cat -j" should not output metadata
- Dominant language
- Java
- Stars
- 3.1k
- Forks
- 1.6k
- Avg merge
- 3d 12h
- Merged PRs (30d)
- 33
Description
Parquet-tools cat -help says:
```
parquet-tools cat:
Prints the content of a Parquet file. The output contains only the data, no
metadata is displayed
```
Let's say I have a structure like this in a Parquet file:
```json
{
"account":
[
{
"accountDepositType": "NA",
"accountNumber": "NA",
"accountHolderType": "NA"
}
]
}
```
it is extracted like this
```json
{
"account": {
"list": [
{
"element": {
"accountDepositType": "NA",
"accountNumber": "NA",
"accountHolderType": "NA"
}
}
]
}
}
```
**"list"** and **"element"** is metadata or type information if you like and it should not appear in output.
Can you please fix that ?
**Reporter**: [Dumitru Husleag](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=dumitru21)
**Note**: *This issue was originally created as [PARQUET-1956](https://issues.apache.org/jira/browse/PARQUET-1956). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the parquet-tools cat -j command and its help text, then trace how nested list data is rendered in the JSON output. Use the sample structure from the issue to verify that the list and element wrappers are omitted while the account fields remain. Done means the output contains the data without those metadata or type-information nodes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- cli, data
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100