facultyai / facultyai/faculty-distributed

Remove need to setup job and environment

Open
#5 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
5
Forks
0
PR merge metrics
No merged PRs in 30d

Description

It would be great if `faculty-distributed` handled all platform requirements. A way to achieve this could be to create a Job when `FacultyJobExecutor.map` is called. The command of the job could also install `faculty_distributed` to avoid the need for a server environment: `pip install -U git+ssh://git@github.com/facultyai/faculty-distributed.git && faculty_distributed_job $path $worker_id` with the appropriate parameters. Resource requests and optional additional server environment IDs could be passed as constructor arguments.

Optionally, the job could deleted as part of the cleanup function.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.