E3SM-Project / E3SM-Project/simboard
[DevOps]: Add centralized administrative job monitoring
- Dominant language
- Python
- Stars
- 1
- Forks
- 2
- Avg merge
- 25m
- Merged PRs (30d)
- 14
Description
### Task Details
As SimBoard scales, we will need to monitor metadata ingestion and provenance-scanning jobs across multiple DOE sites.
Add centralized job monitoring and a simple administrative dashboard in the SimBoard UI for viewing job status, history, and failures.
### Steps to Complete
1. Define a common job-status model and reporting API.
2. Update ingestion and provenance-scanner jobs to report status, progress, and errors.
3. Store job history and recent failure details.
4. Add an access-controlled administrative dashboard.
5. Test reporting across supported DOE sites.
### Additional Notes
Initial scope should focus on monitoring and troubleshooting, not remote job control or full log aggregation.
Contributor guide
Research direction
Start by reading the existing metadata-ingestion and provenance-scanner job entry points, then trace how SimBoard exposes data to its UI. Define the common status and reporting boundaries, persistence for history and failures, and the access-controlled administrative dashboard. Done means job status, progress, errors, history, and failures are visible and tested across supported DOE sites without adding remote control or full log aggregation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- authorization, backend-api-design, frontend, observability
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100