E3SM-Project / E3SM-Project/simboard

[DevOps]: Add centralized administrative job monitoring

Open
#301 0 comments 0 reactions 0 assignees View on GitHub
type: devops
Dominant language
Python
Stars
1
Forks
2
Avg merge
25m
Merged PRs (30d)
14

Description

### Task Details

As SimBoard scales, we will need to monitor metadata ingestion and provenance-scanning jobs across multiple DOE sites.

Add centralized job monitoring and a simple administrative dashboard in the SimBoard UI for viewing job status, history, and failures.

### Steps to Complete

1. Define a common job-status model and reporting API.
2. Update ingestion and provenance-scanner jobs to report status, progress, and errors.
3. Store job history and recent failure details.
4. Add an access-controlled administrative dashboard.
5. Test reporting across supported DOE sites.

### Additional Notes

Initial scope should focus on monitoring and troubleshooting, not remote job control or full log aggregation.

Contributor guide

Open the contributing guide

Research direction

Start by reading the existing metadata-ingestion and provenance-scanner job entry points, then trace how SimBoard exposes data to its UI. Define the common status and reporting boundaries, persistence for history and failures, and the access-controlled administrative dashboard. Done means job status, progress, errors, history, and failures are visible and tested across supported DOE sites without adding remote control or full log aggregation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
authorization, backend-api-design, frontend, observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.