[Feature Request]: Beam File Output should support compression
Open
awaiting triage
Beam
P2
- Dominant language
- Java
- Stars
- 1.5k
- Forks
- 476
- Avg merge
- 19h
- Merged PRs (30d)
- 227
Description
### What would you like to happen?
Migration: https://issues.apache.org/jira/browse/HOP-4280
The Beam TextIO API supports writing compressed files.
We should be able to support this as well.
### Issue Priority
Priority: 2
### Issue Component
Component: Beam
Contributor guide
Research direction
Start by reviewing the Beam component and the linked HOP-4280 migration, then compare the existing Beam file output behavior with the Beam TextIO API's compression support. Done means Beam file output can write compressed files and the behavior is covered by the project's relevant tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100