Optional support for GPU sharing with CUDA MPS
- Dominant language
- Python
- Stars
- 670
- Forks
- 183
- Avg merge
- 17h 7m
- Merged PRs (30d)
- 358
Description
NVIDIA offers a proxy process that coalesces CUDA commands from multiple processes for concurrent kernel execution, called [MPS (Multi-Process Service)](https://docs.nvidia.com/deploy/pdf/CUDA_Multi_Process_Service_Overview.pdf).However, it requires `--ipc=host` option for nvidia-docker setups (NVIDIA/nvidia-docker#419) which may compromise security in multi-tenant setups like Backend.AI.
Let's keep track of how this technology is going to evolve and apply to Backend.AI when appropriate.
First we could make it an opt-in feature so that our customers who use private Backend.AI clusters with semi-trusted users (e.g., employees in the same company) can benefit from performance improvements.
JIRA Issue: BA-333
Contributor guide
Assessment
This issue has not been assessed yet.