NVIDIA / NVIDIA/cccl

[BUG]: `AssertionError: LDL instruction found in SASS` in some of the tests

Open
#5,556 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

### Is this a duplicate?

- [x] I confirmed there appear to be no [duplicate issues](https://github.com/NVIDIA/cccl/issues) for this bug and that I agree to the [Code of Conduct](CODE_OF_CONDUCT.md)

### Type of Bug

Runtime Error

### Component

cuda.cccl.parallel (Python)

### Describe the bug

Hi. Apologies for a long report. I think, this error might be expected, and I'm posting it just for the record.

Thanks.

Following the instructions to install the cccl from 14.08. 2025 source:

```
git clone https://github.com/NVIDIA/cccl.git
cd cccl/python/cuda_cccl
pip install -e .

Cloning into 'cccl'...
remote: Enumerating objects: 236172, done.
remote: Counting objects: 100% (911/911), done.
remote: Compressing objects: 100% (453/453), done.
remote: Total 236172 (delta 688), reused 469 (delta 457), pack-reused 235261 (from 2)
Receiving objects: 100% (236172/236172), 88.78 MiB | 24.08 MiB/s, done.
Resolving deltas: 100% (183091/183091), done.
Updating files: 100% (7311/7311), done.
Obtaining file:///home/iosborne/Projects/PR4001/cccl/python/cuda_cccl
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build editable ... done
Installing backend dependencies ... done
Preparing editable metadata (pyproject.toml) ... done
Collecting numba>=0.60.0 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached numba-0.61.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.8 kB)
Collecting numpy (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading numpy-2.3.2-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl.metadata (62 kB)
Collecting cuda-bindings<13.0.0,>=12.9.1 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading cuda_bindings-12.9.1-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (2.6 kB)
Collecting cuda-pathfinder>=1.1.0 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading cuda_pathfinder-1.1.0-py3-none-any.whl.metadata (2.3 kB)
Collecting cuda-core (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading cuda_core-0.3.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.6 kB)
Collecting nvidia-cuda-nvrtc-cu12 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached nvidia_cuda_nvrtc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Collecting nvidia-nvjitlink-cu12 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached nvidia_nvjitlink_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl.metadata (1.7 kB)
Collecting numba-cuda>=0.18.0 (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading numba_cuda-0.18.1-py3-none-any.whl.metadata (3.8 kB)
Collecting llvmlite<0.45,>=0.44.0dev0 (from numba>=0.60.0->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached llvmlite-0.44.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.0 kB)
Collecting numpy (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached numpy-2.2.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Downloading cuda_bindings-12.9.1-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (12.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 38.3 MB/s eta 0:00:00
Downloading cuda_pathfinder-1.1.0-py3-none-any.whl (17 kB)
Using cached numba-0.61.2-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.9 MB)
Using cached llvmlite-0.44.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.4 MB)
Using cached numpy-2.2.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.5 MB)
Downloading numba_cuda-0.18.1-py3-none-any.whl (678 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 678.1/678.1 kB 57.2 MB/s eta 0:00:00
Downloading cuda_core-0.3.2-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (3.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.1/3.1 MB 84.9 MB/s eta 0:00:00
Using cached nvidia_cuda_nvrtc_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (89.6 MB)
Using cached nvidia_nvjitlink_cu12-12.9.86-py3-none-manylinux2010_x86_64.manylinux_2_12_x86_64.whl (39.7 MB)
Building wheels for collected packages: cuda-cccl
Building editable for cuda-cccl (pyproject.toml) ... done
Created wheel for cuda-cccl: filename=cuda_cccl-3.2.0.dev128+g6a2ce1c83-cp312-cp312-linux_x86_64.whl size=4111990 sha256=1c29e37776d5430062e875284f4763d78bdf9a64b360050f469f9e9dc0d7d202
Stored in directory: /tmp/pip-ephem-wheel-cache-kgh3fnnu/wheels/7a/65/81/d9d559d57c41647a25f256f9b9974cdfd6b78f249f269617b3
Successfully built cuda-cccl
Installing collected packages: nvidia-nvjitlink-cu12, nvidia-cuda-nvrtc-cu12, numpy, llvmlite, cuda-pathfinder, numba, cuda-core, cuda-bindings, numba-cuda, cuda-cccl
Successfully installed cuda-bindings-12.9.1 cuda-cccl-3.2.0.dev128+g6a2ce1c83 cuda-core-0.3.2 cuda-pathfinder-1.1.0 llvmlite-0.44.0 numba-0.61.2 numba-cuda-0.18.1 numpy-2.2.6 nvidia-cuda-nvrtc-cu12-12.9.86 nvidia-nvjitlink-cu12-12.9.86
```

```
(cuda-cccl-awkward) [iosborne@della-gpu cuda_cccl]$ pip install -e .[test]
Obtaining file:///home/iosborne/Projects/PR4001/cccl/python/cuda_cccl
Installing build dependencies ... done
Checking if build backend supports build_editable ... done
Getting requirements to build editable ... done
Installing backend dependencies ... done
Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: numba>=0.60.0 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (0.61.2)
Requirement already satisfied: numpy in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (2.2.6)
Requirement already satisfied: cuda-bindings<13.0.0,>=12.9.1 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (12.9.1)
Requirement already satisfied: cuda-pathfinder>=1.1.0 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (1.1.0)
Requirement already satisfied: cuda-core in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (0.3.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (12.9.86)
Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (12.9.86)
Requirement already satisfied: numba-cuda>=0.18.0 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from cuda-cccl==3.2.0.dev128+g6a2ce1c83) (0.18.1)
Collecting pytest (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached pytest-8.4.1-py3-none-any.whl.metadata (7.7 kB)
Collecting pytest-xdist (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading pytest_xdist-3.8.0-py3-none-any.whl.metadata (3.0 kB)
Collecting cupy-cuda12x (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached cupy_cuda12x-13.5.1-cp312-cp312-manylinux2014_x86_64.whl.metadata (2.4 kB)
Collecting typing_extensions (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached typing_extensions-4.14.1-py3-none-any.whl.metadata (3.0 kB)
Collecting pytest-benchmark (from cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading pytest_benchmark-5.1.0-py3-none-any.whl.metadata (25 kB)
Requirement already satisfied: llvmlite<0.45,>=0.44.0dev0 in /home/iosborne/.conda/envs/cuda-cccl-awkward/lib/python3.12/site-packages (from numba>=0.60.0->cuda-cccl==3.2.0.dev128+g6a2ce1c83) (0.44.0)
Collecting fastrlock>=0.5 (from cupy-cuda12x->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached fastrlock-0.8.3-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_28_x86_64.whl.metadata (7.7 kB)
Collecting iniconfig>=1 (from pytest->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached iniconfig-2.1.0-py3-none-any.whl.metadata (2.7 kB)
Collecting packaging>=20 (from pytest->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB)
Collecting pluggy<2,>=1.5 (from pytest->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached pluggy-1.6.0-py3-none-any.whl.metadata (4.8 kB)
Collecting pygments>=2.7.2 (from pytest->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Using cached pygments-2.19.2-py3-none-any.whl.metadata (2.5 kB)
Collecting py-cpuinfo (from pytest-benchmark->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes)
Collecting execnet>=2.1 (from pytest-xdist->cuda-cccl==3.2.0.dev128+g6a2ce1c83)
Downloading execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
Using cached cupy_cuda12x-13.5.1-cp312-cp312-manylinux2014_x86_64.whl (113.1 MB)
Using cached fastrlock-0.8.3-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_28_x86_64.whl (53 kB)
Using cached pytest-8.4.1-py3-none-any.whl (365 kB)
Using cached pluggy-1.6.0-py3-none-any.whl (20 kB)
Using cached iniconfig-2.1.0-py3-none-any.whl (6.0 kB)
Using cached packaging-25.0-py3-none-any.whl (66 kB)
Using cached pygments-2.19.2-py3-none-any.whl (1.2 MB)
Downloading pytest_benchmark-5.1.0-py3-none-any.whl (44 kB)
Downloading py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Downloading pytest_xdist-3.8.0-py3-none-any.whl (46 kB)
Downloading execnet-2.1.1-py3-none-any.whl (40 kB)
Using cached typing_extensions-4.14.1-py3-none-any.whl (43 kB)
Building wheels for collected packages: cuda-cccl
Building editable for cuda-cccl (pyproject.toml) ... done
Created wheel for cuda-cccl: filename=cuda_cccl-3.2.0.dev128+g6a2ce1c83-cp312-cp312-linux_x86_64.whl size=4111990 sha256=56b05f7603f93baeea42f231df11129c35d2d0b4e52002e83c86876643b85adc
Stored in directory: /tmp/pip-ephem-wheel-cache-ef16zgpy/wheels/7a/65/81/d9d559d57c41647a25f256f9b9974cdfd6b78f249f269617b3
Successfully built cuda-cccl
Installing collected packages: py-cpuinfo, fastrlock, typing_extensions, pygments, pluggy, packaging, iniconfig, execnet, cupy-cuda12x, pytest, pytest-xdist, pytest-benchmark, cuda-cccl
Attempting uninstall: cuda-cccl
Found existing installation: cuda-cccl 3.2.0.dev128+g6a2ce1c83
Uninstalling cuda-cccl-3.2.0.dev128+g6a2ce1c83:
Successfully uninstalled cuda-cccl-3.2.0.dev128+g6a2ce1c83
Successfully installed cuda-cccl-3.2.0.dev128+g6a2ce1c83 cupy-cuda12x-13.5.1 execnet-2.1.1 fastrlock-0.8.3 iniconfig-2.1.0 packaging-25.0 pluggy-1.6.0 py-cpuinfo-9.0.0 pygments-2.19.2 pytest-8.4.1 pytest-benchmark-5.1.0 pytest-xdist-3.8.0 typing_extensions-4.14.1
```
then starting tests with:
```
$ pytest tests/
=============================================================== test session starts ================================================================
platform linux -- Python 3.12.11, pytest-8.4.1, pluggy-1.6.0
benchmark: 5.1.0 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /home/iosborne/Projects/PR4001/cccl/python/cuda_cccl
configfile: pyproject.toml
plugins: xdist-3.8.0, benchmark-5.1.0
collected 2960 items
...
```

several tests fail with:
```
> assert "LDL" not in sass, "LDL instruction found in SASS"
^^^^^^^^^^^^^^^^^
E AssertionError: LDL instruction found in SASS

cuda/cccl/parallel/experimental/_cccl_interop.py:332: AssertionError
```

here is the list:
```
============================================================= short test summary info ==============================================================
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[uint64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[uint64-1024] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[uint64-1048576] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[float64-1024] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs[float64-1048576] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[uint64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[uint64-1024] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[uint64-1048576] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[float64-1024] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer[float64-1048576] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_bit_window[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_bit_window[float64-16777216] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer_bit_window[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_radix_sort.py::test_radix_sort_pairs_double_buffer_bit_window[float64-16777216] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_scan.py::test_scan_array_input[float64-True] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_scan.py::test_scan_array_input[float64-False] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint8-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint8-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint8-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint8-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint32-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint32-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint32-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[uint32-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int8-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int8-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int8-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int8-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int32-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int32-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int32-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[int32-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float32-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float32-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float32-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float32-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float64-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float64-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key[float64-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key_iterators[float64-4] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key_iterators[float64-256] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key_iterators[float64-65536] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key_iterators[float64-4194304] - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key.py::test_unique_by_key_with_stream - AssertionError: LDL instruction found in SASS
FAILED tests/parallel/test_unique_by_key_api.py::test_unique_by_key - AssertionError: LDL instruction found in SASS
======================================= 48 failed, 2888 passed, 24 skipped, 4 warnings in 7679.21s (2:07:59) =======================================
```
I'm running on della-gpu node with:
```
]$ nvidia-smi
Fri Aug 15 03:56:18 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.65.06 Driver Version: 580.65.06 CUDA Version: 13.0 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA A100-PCIE-40GB On | 00000000:21:00.0 Off | 0 |
| N/A 38C P0 51W / 250W | 36853MiB / 40960MiB | 0% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 557425 C python 6058MiB |
| 0 N/A N/A 1594966 C python 30778MiB |
+-----------------------------------------------------------------------------------------+
```

### How to Reproduce

this is specific to `della-gpu` node:
```
module load anaconda3/2024.10
conda create --name cuda-cccl-awkward python=3.12 -y
conda activate cuda-cccl-awkward
module load gcc-toolset/14
module load cudatoolkit/12.8
git clone https://github.com/NVIDIA/cccl.git
cd cccl/python/cuda_cccl
pip install -e .
pip install -e .[test]
```

### Expected behavior

it's possible that this is expected given that this is still experimental.

### Reproduction link

_No response_

### Operating System

$ uname -a Linux della-gpu.princeton.edu 5.14.0-570.33.2.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Aug 8 06:45:35 EDT 2025 x86_64 x86_64 x86_64 GNU/Linux

### nvidia-smi output

```
]$ nvidia-smi
Fri Aug 15 03:56:18 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.65.06 Driver Version: 580.65.06 CUDA Version: 13.0 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA A100-PCIE-40GB On | 00000000:21:00.0 Off | 0 |
| N/A 38C P0 51W / 250W | 36853MiB / 40960MiB | 0% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 557425 C python 6058MiB |
| 0 N/A N/A 1594966 C python 30778MiB |
+-----------------------------------------------------------------------------------------+
```

### NVCC version

```
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2025 NVIDIA Corporation
Built on Fri_Feb_21_20:23:50_PST_2025
Cuda compilation tools, release 12.8, V12.8.93
Build cuda_12.8.r12.8/compiler.35583870_0
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.