apache / apache/gluten

[CH] New Paruqet Decoder

Open
#10,065 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

New Paruqet Decoder

### Gluten version

None

Contributor guide

Open the contributing guide

Research direction

Start by locating the existing decoder implementations and the ClickHouse integration entry points in the Gluten repository, then read how current decoders are tested. Define the Parquet decoder's supported inputs and expected behavior before implementation; done means the new decoder works with the relevant Spark SQL execution path and has coverage for its supported cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, scala
Domain
backend, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.