common-workflow-language / common-workflow-language/cwltool

TES backend?

Open
#359 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
376
Forks
255
Avg merge
2d 7h
Merged PRs (30d)
12

Description

I'm exploring the possibility of cwltool being able to submit tasks to a [TES](https://github.com/ga4gh/task-execution-schemas) server as a means of cluster orchestration.

As I understand it, this has been sort of tried before in [funnel-client](https://github.com/bmeg/funnel-client/tree/master/test). There's also possibly something similar in [arvados-cwl](https://github.com/curoverse/arvados/tree/master/sdk/cwl/arvados_cwl). I'm not sure about arvados_cwl, but I've heard it was difficult to keep funnel-client working because the integration with cwltool was tricky.

Mostly I'd like to get the opinion of the devs here who are familiar with the cwltool code. Is there a clean way to write a new executor plugin? Is this something you'd be interested in having in the cwltool codebase?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.