There is no option to set ParquetWriterConfig when create new ParquetSink instance
- Dominant language
- Scala
- Stars
- 147
- Forks
- 32
- PR merge metrics
- No merged PRs in 30d
Description
There is no params to set ParquetWriterConfig when create new ParquetSink instance.
I couldn't set it after created.
Because some variables which for it were defined as val. And almost components were in closure.
How can I do that? Or, when you change this?
Contributor guide
No contributing guide indexed for this repository
Research direction
Look at the ParquetSink class and its constructor to see how ParquetWriterConfig is currently handled. The issue mentions that variables are defined as 'val' and components are in a closure, so examine the internal structure and dependencies. Determine where configuration can be injected or modified, then check for existing tests related to ParquetSink to understand the expected behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- backend, data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100