NVIDIA / NVIDIA/TransformerEngine

Pre-built wheels

Open
#2,249 5 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

build installation
Dominant language
Python
Stars
3.5k
Forks
831
Avg merge
3d 11h
Merged PRs (30d)
65

Description

Describe the bug

Hi,

Are there any plans to publish prebuilt wheels? Right now during pip install, the pybind modules are being built via CMake in a brittle manner (accessing nvidia.__file__ or expecting cuda toolkit to be installed in system path (non-hermetic behaviour).

Steps/Code to reproduce bug

pip install -vvv transformer_engine[jax]

Invokes the compiler to build c++ files.

Expected behavior

No building during pip install. Wheels should be released for all supported platforms/cuda/python versions.

Environment overview (please complete the following information)

  • Environment location: Local Ubuntu machine
  • Method of Transformer Engine install: [pip install]

Environment details

  • Python version = 3.12
  • Transformer Engine version = 2.8.0

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the pip install transformer_engine[jax] path and the CMake build of the pybind modules, then inspect the repository's packaging and release configuration. Done means pip install uses published wheels rather than compiling, with wheels covering the supported platforms, CUDA versions, and Python versions.

Written by the indexing model from the issue text.

Assessment

Tech stack
cmake, python
Domain
build-system, release
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.