apache / apache/parquet-java

Add index support in the write path

Open
#2,485 0 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Priority: Major Type: task
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

The scope of this Jira is to add index support in the write path.

The changes will involve computing the indexes followed by serializing them and writing to the file.

**Reporter**: [Deepak Majeti](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mdeepak) / @majetideepak
**Assignee**: [Deepak Majeti](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mdeepak) / @majetideepak

**Note**: *This issue was originally created as [PARQUET-1849](https://issues.apache.org/jira/browse/PARQUET-1849). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the write path and reading the migration documentation referenced in the issue. Determine how indexes should be computed, serialized, and written to the file; the work is done when index support operates across that complete write path.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.