Enable Spark for the Cloud Pipeline's clusters
Open
kind/enhancement
state/underway
sys/core
- Dominant language
- Java
- Stars
- 163
- Forks
- 65
- Avg merge
- 11h 46m
- Merged PRs (30d)
- 29
Description
Users shall be able to setup an `Apache Spark` cluster in the same manner as `Grid Engine`
1. Configure scheduler type via the Web GUI (in a `static` mode for now)
2. Enable Spark master and workers ( in a `standalone` mode for now)
3. Enable access to the Object Storages (using `s3a` filesystem for `AWS` only for now)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.