NVIDIA / NVIDIA/nvkind

Stuck at Install the k8s-device-plugin

Open
#85 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
211
Forks
32
PR merge metrics
No merged PRs in 30d

Description

nvkind cluster print-gpus is working

$ kubectl --context=kind-${KIND_CLUSTER_NAME} get pod -n nvidia
No resources found in nvidia namespace.

Please help! Thanks!

~$ helm list -n nvidia --kube-context kind-${KIND_CLUSTER_NAME}
NAME                    NAMESPACE       REVISION        UPDATED                                 STATUS          CHART                           APP VERSION
nvidia-device-plugin    nvidia          1               2026-07-14 10:51:41.427529115 +0800 CST deployed        nvidia-device-plugin-0.19.3     0.19.3
~$ kubectl --context kind-${KIND_CLUSTER_NAME} get ds -n nvidia
NAME                                      DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR                 AGE
nvidia-device-plugin                      0         0         0       0            0           <none>                        8m25s
nvidia-device-plugin-mps-control-daemon   0         0         0       0            0           nvidia.com/mps.capable=true   8m25s
~$ kubectl --context kind-${KIND_CLUSTER_NAME} describe ds nvidia-device-plugin -n nvidia
Name:           nvidia-device-plugin
Namespace:      nvidia
Selector:       app.kubernetes.io/instance=nvidia-device-plugin,app.kubernetes.io/name=nvidia-device-plugin
Node-Selector:  <none>
Labels:         app.kubernetes.io/instance=nvidia-device-plugin
                app.kubernetes.io/managed-by=Helm
                app.kubernetes.io/name=nvidia-device-plugin
                app.kubernetes.io/version=0.19.3
                helm.sh/chart=nvidia-device-plugin-0.19.3
Annotations:    deprecated.daemonset.template.generation: 1
                meta.helm.sh/release-name: nvidia-device-plugin
                meta.helm.sh/release-namespace: nvidia
Desired Number of Nodes Scheduled: 0
Current Number of Nodes Scheduled: 0
Number of Nodes Scheduled with Up-to-date Pods: 0
Number of Nodes Scheduled with Available Pods: 0
Number of Nodes Misscheduled: 0
Pods Status:  0 Running / 0 Waiting / 0 Succeeded / 0 Failed
Pod Template:
  Labels:           app.kubernetes.io/instance=nvidia-device-plugin
                    app.kubernetes.io/name=nvidia-device-plugin
  Service Account:  nvidia-device-plugin-service-account
  Containers:
   nvidia-device-plugin-ctr:
    Image:      nvcr.io/nvidia/k8s-device-plugin:v0.19.3
    Port:       <none>
    Host Port:  <none>
    Command:
      nvidia-device-plugin
    Environment:
      MPS_ROOT:                    /run/nvidia/mps
      NVIDIA_VISIBLE_DEVICES:      all
      NVIDIA_DRIVER_CAPABILITIES:  compute,utility
    Mounts:
      /dev/shm from mps-shm (rw)
      /mps from mps-root (rw)
      /var/lib/kubelet/device-plugins from kubelet-device-plugins-dir (rw)
      /var/run/cdi from cdi-root (rw)
  Volumes:
   kubelet-device-plugins-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/kubelet/device-plugins
    HostPathType:  Directory
   mps-root:
    Type:          HostPath (bare host directory volume)
    Path:          /run/nvidia/mps
    HostPathType:  DirectoryOrCreate
   mps-shm:
    Type:          HostPath (bare host directory volume)
    Path:          /run/nvidia/mps/shm
    HostPathType:
   cdi-root:
    Type:               HostPath (bare host directory volume)
    Path:               /var/run/cdi
    HostPathType:       DirectoryOrCreate
  Priority Class Name:  system-node-critical
  Node-Selectors:       <none>
  Tolerations:          CriticalAddonsOnly op=Exists
                        nvidia.com/gpu:NoSchedule op=Exists
Events:                 <none>

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the Helm release and the nvidia-device-plugin DaemonSets with the kubectl commands shown in the report, focusing on why both have zero desired nodes and no events. Confirm the cause and document or restore a state where the device-plugin DaemonSet schedules pods in the nvidia namespace.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, kubernetes
Domain
devops, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.