AbsaOSS / AbsaOSS/enceladus

Need a way to clean up orphaned runs

Open
#1,241 0 comments 0 reactions 0 assignees View on GitHub
feature Menas priority: low
Dominant language
Scala
Stars
33
Forks
16
PR merge metrics
No merged PRs in 30d

Description

## Background
Currently, if a job is interrupted in a way that it didn't have a chance to send the failure request, the status of the job is 'Running' forever.

## Feature
We need to periodically check all jobs that are in 'Running' state for days and switch them to 'Failed' with the appropriate error.

## Proposed Solution [Optional]
1. Such periodic cleanup can be done in Menas itself. Checking interval can be 1 hour by default and can be configurable.
2. The maximum age of a job can be a configuration parameter as well.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.