finos / finos/tracdap

Repeatability tagging

Open
#660 0 comments 0 reactions 0 assignees View on GitHub
enhancement metadata platform-core
Dominant language
Java
Stars
55
Forks
18
Avg merge
6h 29m
Merged PRs (30d)
16

Description

Add a metadata tag to all jobs to define whether they are **repeatable** - i.e. could be resubmitted and will definitely delivery the same outputs. This would be:

- Yes/Repeatable for RunModel and RunFlow with no External Resource dependencies
- No/Not-Repeatable for ImportModel
- Partial for RunModel and RunFlow jobs with External Resource dependencies

Add a metadata tag to all Data and File objects to define whether they are **recreatable**:

- No if generate in a Job downstream of an External Resource dependency
- Yes if generated via a Job with no External Resource dependency

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by locating RunModel, RunFlow, ImportModel, External Resource dependencies, and the Data and File object definitions, then trace their metadata handling. Done means all listed job and object cases expose repeatability or recreatability metadata with the specified values.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.