alibaba / alibaba/rtp-llm

HELP: No matching distribution found for torch==2.1.0+cu121 error while install maga_transformer with .whl in release 0.2.0

Open
#91 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
275
Avg merge
3d 17h
Merged PRs (30d)
33

Description

I'm preforming the instruction in Startup example, and
`pip3 install -r ./open_source/deps/requirements_torch_gpu_cuda12.txt` completed successfully, but when I installed maga_transformer-0.2.0+cuda121-cp310-cp310-manylinux1_x86_64.whl an ERROR occurred:
`Processing ./maga_transformer-0.2.0+cuda121-cp310-cp310-manylinux1_x86_64.whl
Requirement already satisfied: filelock==3.13.1 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (3.13.1)
Requirement already satisfied: jinja2 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (3.1.4)
Requirement already satisfied: sympy in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.13.1)
Requirement already satisfied: typing-extensions in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (4.12.2)
Requirement already satisfied: importlib_metadata in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (8.0.0)
Requirement already satisfied: transformers==4.39.3 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (4.39.3)
Requirement already satisfied: sentencepiece==0.1.99 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.1.99)
Requirement already satisfied: fastapi==0.108.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.108.0)
Requirement already satisfied: uvicorn==0.21.1 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.21.1)
Requirement already satisfied: dacite in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.8.1)
Requirement already satisfied: pynvml in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (11.5.3)
Requirement already satisfied: thrift in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.20.0)
Requirement already satisfied: numpy==1.24.1 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.24.1)
Requirement already satisfied: psutil in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (6.0.0)
Requirement already satisfied: tiktoken==0.7.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.7.0)
Requirement already satisfied: lru-dict in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.3.0)
Requirement already satisfied: py-spy in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.3.14)
Requirement already satisfied: safetensors in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.4.3)
Requirement already satisfied: cpm_kernels in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.0.11)
Requirement already satisfied: pyodps in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.11.6.1)
Requirement already satisfied: Pillow in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (10.4.0)
Requirement already satisfied: protobuf==3.20.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (3.20.0)
Collecting torchvision==0.16.0 (from maga-transformer==0.2.0+cuda121)
Using cached torchvision-0.16.0-cp310-cp310-manylinux1_x86_64.whl.metadata (6.6 kB)
Requirement already satisfied: einops in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.8.0)
Requirement already satisfied: prettytable in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (3.10.2)
Requirement already satisfied: pydantic==2.5.3 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (2.5.3)
Requirement already satisfied: timm==0.9.12 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.9.12)
Requirement already satisfied: sentence-transformers==2.7.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (2.7.0)
Requirement already satisfied: grpcio==1.62.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (1.62.0)
Collecting xfastertransformer_devel_icx==1.6.0.0 (from maga-transformer==0.2.0+cuda121)
Using cached xfastertransformer_devel_icx-1.6.0.0-py3-none-any.whl.metadata (16 kB)
Requirement already satisfied: decord==0.6.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.6.0)
Requirement already satisfied: accelerate==0.25.0 in /home/jason/anaconda3/envs/inferenceFrame/lib/python3.10/site-packages (from maga-transformer==0.2.0+cuda121) (0.25.0)
INFO: pip is looking at multiple versions of maga-transformer to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement torch==2.1.0+cu121 (from maga-transformer) (from versions: 1.11.0, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1)
ERROR: No matching distribution found for torch==2.1.0+cu121`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Startup example and open open_source/deps/requirements_torch_gpu_cuda12.txt, then inspect the dependency metadata in maga_transformer-0.2.0+cuda121-cp310-cp310-manylinux1_x86_64.whl. Reproduce the installation in a clean Python 3.10 environment and determine the expected torch source or constraint; done means the documented wheel installation completes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
build-system
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.