NVIDIA / NVIDIA/TransformerEngine
Pre-built wheels
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3.5k
- Forks
- 831
- Avg merge
- 3d 11h
- Merged PRs (30d)
- 65
Description
Describe the bug
Hi,
Are there any plans to publish prebuilt wheels? Right now during pip install, the pybind modules are being built via CMake in a brittle manner (accessing nvidia.__file__ or expecting cuda toolkit to be installed in system path (non-hermetic behaviour).
Steps/Code to reproduce bug
pip install -vvv transformer_engine[jax]
Invokes the compiler to build c++ files.
Expected behavior
No building during pip install. Wheels should be released for all supported platforms/cuda/python versions.
Environment overview (please complete the following information)
- Environment location: Local Ubuntu machine
- Method of Transformer Engine install: [pip install]
Environment details
- Python version = 3.12
- Transformer Engine version = 2.8.0
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the pip install transformer_engine[jax] path and the CMake build of the pybind modules, then inspect the repository's packaging and release configuration. Done means pip install uses published wheels rather than compiling, with wheels covering the supported platforms, CUDA versions, and Python versions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cmake, python
- Domain
- build-system, release
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100