opensearch-project / opensearch-project/data-prepper
Recursively load pipeline configurations from directory
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
This is a follow-up to #1736 where one or more pipeline files can be loaded from the pipelines/ directory. This moves one step further to enable recursive loading in case that the pipeline files are organized into subdirectories.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the pipeline-loading work referenced in #1736 and how files in the pipelines/ directory are currently discovered. Extend that behavior to cover pipeline files in nested subdirectories, then verify that organized nested configurations are loaded without breaking existing directory loading.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100