NVIDIA / NVIDIA/TensorRT-Edge-LLM

x86 CuteDSL cubins missing in the repo

Open
#203 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
563
Forks
135
Avg merge
14h 13m
Merged PRs (30d)
1

Description

Describe the bug

in kernelSrcs/cuteDSLPrebuilt there are prebuilt cubins for aarch64. Could x86 (+ sm89 - ampere) be included as well? This is important for CI workflows/unit tests that might have access to a L4 GPU but not a Thor.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Inspect kernelSrcs/cuteDSLPrebuilt and the existing aarch64 cubins first, then check the repository's build and CI instructions for generating x86 sm89 artifacts. Done means the matching x86 cubins are included and the relevant CI workflows or unit tests can use them.

Written by the indexing model from the issue text.

Assessment

Domain
build-system, ci-cd, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.