Poetry install failure of TensorRT 9.3.0.post12.dev1 when installing on Windows
@zeroepoch is already working on this.
Since May 17, 2024.
- Dominant language
- C++
- Stars
- 13.4k
- Forks
- 2.4k
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 2
Description
Description
I came across this error when installing tensorrt_llm==0.9.0 using poetry on windows. I referred to issue#3050 which described the same failure but was resolved by individually adding modules using poetry. The same steps fail on windows when installing as the dependency manager is unable to find a suitable installation candidate for nvidia-cudnn-cu12. With torch=2.2.0+cu121 already installed, running the following command:
poetry add --source pyindex-nvidia tensorrt-libs==9.3.0.post12.dev1
raises an error:
`Package operations: 3 installs, 0 updates, 0 removals
- Installing nvidia-cuda-runtime-cu12 (12.1.105): Installing...
- Installing nvidia-cudnn-cu12 (8.9.2.26): Failed
- Installing nvidia-cuda-runtime-cu12 (12.1.105)
- Installing nvidia-cudnn-cu12 (8.9.2.26): Failed
RuntimeError
Unable to find installation candidates for nvidia-cudnn-cu12 (8.9.2.26)
at C:\Program Files\Python310\lib\site-packages\poetry\installation\chooser.py:74 in choose_for
70│
71│ links.append(link)
72│
73│ if not links:
→ 74│ raise RuntimeError(f"Unable to find installation candidates for {package}")
75│
76│ # Get the best link
77│ chosen = max(links, key=lambda link: self._sort_key(package, link))
78│
Cannot install nvidia-cudnn-cu12.`
As far as I looked, there is no nvidia-cuda-cu12(8.9.2.26) for windows platform on nvidia and pytorch indexes.
Environment
TensorRT Version: 9.3.0.post12.dev1
NVIDIA GPU: RTX 4090
NVIDIA Driver Version: 551.52
CUDA Version: V12.2.140
CUDNN Version:
Operating System: Windows OS Build 27552
Python Version (if applicable): 3.10.11
Tensorflow Version (if applicable):
PyTorch Version (if applicable): 2.2.0+cu121
Baremetal or Container (if so, version):
Steps To Reproduce
poetry source add --priority=explicit pytorch-gpu-src https://download.pytorch.org/whl/cu121
poetry add --source pytorch-gpu-src torch==2.2.0+cu121
poetry source add --priority=explicit pyindex-nvidia https://pypi.nvidia.com
poetry add --source pyindex-nvidia tensorrt-libs==9.3.0.post12.dev1
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.