Feature: graceful shutdown all pipelines
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Go
- Stars
- 504
- Forks
- 263
- Avg merge
- 4d 2h
- Merged PRs (30d)
- 5
Description
In the event of an error occurring in one of the pipelines (for example, an error during a retry in output plugins), it is important to implement a graceful shutdown of all pipelines.
This approach ensures that all offsets are committed to prevent data doubles.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests; start by tracing how pipeline errors, output-plugin retries, and offset commits are handled. Define the shutdown behavior across all pipelines, with completion meaning that an error in one pipeline stops the others gracefully and all offsets are committed to prevent duplicate data.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100