allegro / allegro/bigflow

Jobs draining after deployment of new workflow

未关闭
#95 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
120
派生
23
PR 合并指标
30 天内没有已合并 PR

描述

**Problem**
For this moment we remove old DAGS from the composer bucket when we deploy a new DAGS. It can result in gaps in data because in this flow it is possible to remove workflow with an in-progress state.

**How to fix**
We should use some kind of draining mechanism that allows ending the in-progress workflows after the current interval is completed and then starts freshly deployed workflows and remove the old one.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。