Automatically removing failed jobs after a certain TTL?
- Dominant language
- JavaScript
- Stars
- 9.4k
- Forks
- 858
- PR merge metrics
- No merged PRs in 30d
Description
It seems like this feature doesn't exist at the moment so I thought I'd suggest it, but feel free to point me in the direction of the feature if it does exist.
When a job fails (ie retries are finished and we give up), it sits inside Redis forever until it is manually cleaned up either via the API, or by creating a script that scans through failed jobs and removes them.
It would be great to be able to give failed jobs a TTL, so that after say 1 week they are automatically removed from Redis.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing how failed jobs are retained in Redis and how the cleanup API exposes removal, then compare that with the existing retry-completion path. Done means a failed job can receive a configurable TTL and is automatically removed after it expires, without breaking manual cleanup.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, redis
- Domain
- backend, databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100