apache / apache/hudi

[Milestone 2] Remove encoding and column level stats for blob writers

Open
#18,117 0 comments 0 reactions 0 assignees View on GitHub
type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

### Task Description

**What needs to be done:**
Update the writers to ensure that we don't attempt any encodings on the blob inline data. We also don't need to include stats for these fields.

**Why this task is needed:**
Ensures the writers are optimal for this new data type

### Task Type

Code improvement/refactoring

### Related Issues

**Parent feature issue:** (if applicable )
**Related issues:**
NOTE: Use `Relationships` button to add parent/blocking issues after issue is created.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points; begin by locating the blob-writer implementations and tracing how inline blob fields are encoded and given column statistics. Done means the writers skip both operations for blob inline data and relevant writer tests confirm that behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.