alibaba / alibaba/rtp-llm

Do you support Huawei Ascend NPU?

Open
#281 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
275
Avg merge
3d 17h
Merged PRs (30d)
33

Description

[Ascend NPU](https://www.hiascend.com/en/) is an AI processor that support AI frameworks like PyTorch, TensorFlow, which has already integrated by [huggingface](https://github.com/huggingface/accelerate/commit/c33adecc9f92808cbaeb0d34928e52e34180f964), [deepspeed](https://github.com/microsoft/DeepSpeed/commit/23a11a39510e2aefb48236e3d2672a7dcbfc42a3) and others popular LLM related software and tools.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start by checking the project's current hardware and backend support, then determine the Ascend integration scope and how compatibility would be validated; the issue does not define a concrete done condition.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch, tensorflow
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.