apache / apache/hudi

Enable SANITIZE_SCHEMA_FIELD_NAMES (`hoodie.streamer.source.sanitize.invalid.schema.field.names`) by default

Open
#14,184 0 comments 0 reactions 0 assignees View on GitHub
type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

### Task Description

**What needs to be done:**
Enable SANITIZE_SCHEMA_FIELD_NAMES (`hoodie.streamer.source.sanitize.invalid.schema.field.names`) by default which avoids hitting the invalid schema issue.

**Why this task is needed:**
Improves out-of-the-box experience with Hudi Streamer.

### Task Type

Code improvement/refactoring

### Related Issues

**Parent feature issue:** (if applicable )
**Related issues:**
NOTE: Use `Relationships` button to add parent/blocking issues after issue is created.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Hudi Streamer configuration for SANITIZE_SCHEMA_FIELD_NAMES (`hoodie.streamer.source.sanitize.invalid.schema.field.names`) and its current default. Check the related Streamer tests, if present, and verify that the default avoids invalid schema field errors while preserving explicitly configured values.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing
Issue type
Refactor
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.