Add implicit conf/pipeline-default.conf options file
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Right now, most of users provide the pipeline options via the main arguments.
For instance, it's the classic way to provide pipeline input, etc.
For convenience, it would be great that the pipeline looks for options in conf/[pipeline_name]-default.conf by default, and override the options using the main arguments.
Thoughts ?
Imported from Jira [BEAM-137](https://issues.apache.org/jira/browse/BEAM-137). Original Jira may contain additional context.
Reported by: jbonofre.
Contributor guide
Research direction
The issue names the proposed conf/[pipeline_name]-default.conf file and the main pipeline arguments, but no implementation files or tests. Start by reviewing the linked BEAM-137 context and locating the pipeline option entry point; done requires an agreed default-file lookup and clear precedence for main arguments.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100