Automattic / Automattic/kue

Automatically removing failed jobs after a certain TTL?

Open
#1,153 3 comments 2 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

It seems like this feature doesn't exist at the moment so I thought I'd suggest it, but feel free to point me in the direction of the feature if it does exist.

When a job fails (ie retries are finished and we give up), it sits inside Redis forever until it is manually cleaned up either via the API, or by creating a script that scans through failed jobs and removes them.

It would be great to be able to give failed jobs a TTL, so that after say 1 week they are automatically removed from Redis.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing how failed jobs are retained in Redis and how the cleanup API exposes removal, then compare that with the existing retry-completion path. Done means a failed job can receive a configurable TTL and is automatically removed after it expires, without breaking manual cleanup.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, redis
Domain
backend, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.