apache / apache/parquet-format
Deprecate RowGroup.file_offset
- Dominant language
- Thrift
- Stars
- 2.6k
- Forks
- 508
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 4
Description
Due to PARQUET-2078 RowGroup.file_offset is not reliable.
This field is also wrongly calculated in the C++ oss parquet implementation PARQUET-2089
**Reporter**: [Gabor Szadovszky](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gszadovszky) / @gszadovszky
**Assignee**: [Gidon Gershinsky](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gershinsky) / @ggershinsky
**Note**: *This issue was originally created as [PARQUET-2080](https://issues.apache.org/jira/browse/PARQUET-2080). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
Contributor guide
Research direction
No source file or test is named. Start by reviewing PARQUET-2078 and PARQUET-2089, then check the migration documentation referenced as PARQUET-2502; done means RowGroup.file_offset deprecation and the related migration guidance are aligned.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- data-engineering
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100