Automattic / Automattic/kue

Prevent data in failed job list

Open
#1,233 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
9.4k
Forks
858
PR merge metrics
No merged PRs in 30d

Description

I am passing html string as data to my jobs.
When a job failed all the html data will save in failed job in redis and cause 2 problem.
1.Use a lot of memory.
2.When I want to see failed job in web GUI, the AJAX response is too heavy and I should wait a lot to download it. `/jobs/failed/...` api response is too large and very slow.

Is there a way to customize what data should save in failed job?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the failed-job persistence path in Redis and the `/jobs/failed/...` API endpoint, which the issue identifies as the affected surfaces. Determine how failed-job data is selected and returned, then verify that the requested customization can omit large payloads and reduce the response without breaking the web GUI.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, redis
Domain
api, backend, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.