Unable to parse parquet files with maps with complex keys
Open
bug
- Dominant language
- Rust
- Stars
- 3.6k
- Forks
- 1.3k
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 167
Description
**Describe the bug**
There's currently an assertion that forbids complex key types in parquet maps. No such restriction exists in the spec for parquet.
**To Reproduce**
Try to parse a parquet file with a map with an array key
**Expected behavior**
It should parse fine
Contributor guide
Research direction
Start by locating the assertion that forbids complex key types in parquet maps, then reproduce the issue with a parquet file whose map key is an array. The work is done when that file parses successfully without violating the parquet specification.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100