oracle / oracle/oracle-database-operator
Private AI service container: GPU support enhancements please
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 192
- Forks
- 69
- Avg merge
- 16h 13m
- Merged PRs (30d)
- 1
Description
Currently, when creating a new PrivateAI resource in OraOperator 2.2.0,
one can only specify the worker node name where the PAI container is supposed to run on.
Especially in GPU enabled environments, I am requesting three enhancements:
- instead of specifying only a workernode host name, please let the user set his own nodeSelector clause. In my OKE environment, GPU enabled nodes get their own labels to select from. So allowing this selector syntax would be great:
nodeSelector:
node.kubernetes.io/instance-type: VM.GPU.A10.1
- GPU enabled nodes often have taints attached to them. To be able to run on that kind of node, the PAI container must tolerate the tainted node. In my environment, this looks like the following:
tolerations:
- effect: NoSchedule
key: nvidia.com/gpu
operator: Exists
- The GPU-enabled PAI container will not start if we dont allow him to use or see GPU devices. please set this environment variable in PAI deployments or allow specifying which GPU devices should be reachable.
- name: NVIDIA_VISIBLE_DEVICES
value: ALL
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the PrivateAI resource definition and the deployment logic that creates its PAI container. Check how Kubernetes node selection, taints, tolerations, and container environment variables are represented. Done means users can configure nodeSelector and tolerations and can expose the requested GPU devices for PrivateAI deployments, with corresponding tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, kubernetes
- Domain
- devops, infrastructure
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100