apache / apache/parquet-java

Enforce unique constraints on parquet column

Open
#2,894 0 comments 0 reactions 0 assignees View on GitHub
Component: Java Component: Parquet Priority: Major Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

While dealing with large datasets when its not feasible to load in memory, how can one enforce unique constraint on a parquet column?

Is there any provision right now to enforce unique constraint on a parquet column? 

 

**Reporter**: [Rohan](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=rpadshah)

**Note**: *This issue was originally created as [PARQUET-2455](https://issues.apache.org/jira/browse/PARQUET-2455). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by clarifying the intended Parquet-Java behavior and checking whether existing constraint support is relevant; done requires a concrete, implementable way to enforce uniqueness on a Parquet column for datasets that do not fit in memory.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.