apache / apache/dolphinscheduler-sdk-python

[improve] Unify the resource use in both yaml and Python API

Open
#24 0 comments 0 reactions 0 assignees View on GitHub
help wanted improvement
Dominant language
Python
Stars
71
Forks
26
PR merge metrics
No merged PRs in 30d

Description

in https://github.com/apache/dolphinscheduler/issues/10911, we add new mechanisms for reading resource from other system, but in yaml define, we also have its own file resource syntax

https://github.com/apache/dolphinscheduler-sdk-python/blob/6cd9784534eb3c78dbbf0daf53bf457a597fe3be/examples/yaml_define/Sagemaker.yaml#L24-L27

and we should combine then into unify

Contributor guide

Open the contributing guide

Research direction

Start by reading the resource mechanisms referenced in issue #10911 and the resource syntax in examples/yaml_define/Sagemaker.yaml at lines 24-27. Compare how resources are represented in the YAML definition and Python API, then define completion as both interfaces using one consistent resource mechanism.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, yaml
Domain
api
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.