Classification : Implement cron job to update status of jobs/batch

Problem

Both the Fine-Tuning API and the Batch API in OpenAI run asynchronously. Once a request is created, the job continues processing on OpenAI’s side, and the status only updates when the job progresses (e.g., queued → running → succeeded/failed).

Currently, to know whether a fine-tuning job or batch job has completed, the user must manually call the Retrieve API for each object. This manual polling is tedious, inefficient, and not scalable.

Proposed Solution

• Set up a cron job (or background worker) that:

• Periodically calls the Retrieve API for both fine-tuning and batch jobs.

• Updates the database with the latest job status and results.

• Ensures that when users query the database, they receive up-to-date information without needing to manually poll OpenAI endpoints.

Start with the Fine-Tuning API and Batch API Retrieve API entry points described in the issue, then trace how job status and results are stored in the database. Define the periodic worker behavior for both job types, including status updates and retrieved results. Done means database queries expose current information without manual polling.