apache / apache/parquet-java

Variant getFieldByKey() on large objects silently fails if variant metadata is unsorted

Open
#3,529 4 comments 0 reactions 1 assignee Claimed by @nssalian View on GitHub
Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

### Describe the bug, including details regarding any error messages, version, and platform.

Variant method getFieldByKey(String key) looks up a key by simple walk if key count < 32, binary search if above that. But the binary search assumes the metadata is sorted. This is optional according to the format spec; there's a bit in the variant to indicate whether or not a variant's metadata is unsorted

the test `testUnsortedMetadataObject()` does test unsorted support -but it only checks on a small enough object that binary search isn't involved

### Component(s)

Core

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.