oracle / oracle/oracle-database-operator

Private AI service container: GPU support enhancements please

Open
#250 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
192
Forks
69
Avg merge
16h 13m
Merged PRs (30d)
1

Description

Currently, when creating a new PrivateAI resource in OraOperator 2.2.0,
one can only specify the worker node name where the PAI container is supposed to run on.
Especially in GPU enabled environments, I am requesting three enhancements:

  1. instead of specifying only a workernode host name, please let the user set his own nodeSelector clause. In my OKE environment, GPU enabled nodes get their own labels to select from. So allowing this selector syntax would be great:
        nodeSelector:
          node.kubernetes.io/instance-type: VM.GPU.A10.1

  1. GPU enabled nodes often have taints attached to them. To be able to run on that kind of node, the PAI container must tolerate the tainted node. In my environment, this looks like the following:
        tolerations:
        - effect: NoSchedule
          key: nvidia.com/gpu
          operator: Exists

  1. The GPU-enabled PAI container will not start if we dont allow him to use or see GPU devices. please set this environment variable in PAI deployments or allow specifying which GPU devices should be reachable.
          - name: NVIDIA_VISIBLE_DEVICES
            value: ALL

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the PrivateAI resource definition and the deployment logic that creates its PAI container. Check how Kubernetes node selection, taints, tolerations, and container environment variables are represented. Done means users can configure nodeSelector and tolerations and can expose the requested GPU devices for PrivateAI deployments, with corresponding tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, kubernetes
Domain
devops, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.