inducer / inducer/pycuda

Including nccl multi-gpu library to PyCUDA

Open
#108 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.1k
Forks
298
Avg merge
4m
Merged PRs (30d)
1

Description

Hello there,

I want to wrap NVIDIA's nccl library for multi-gpu communication collectives into Python, so as to be compatible with PyCUDA framework.

I thought that it would be appropriate to include this into PyCUDA itself, because the library refers to gpu-gpu communication and not to CUDA implementations of algorithms.
What are your thoughts about this?

In case you are interested, is there already an effort going on? What should I notice before I start implementing this?

Also, I could not find a developer-related documentation for extending PyCUDA functionalities. Where should I start from?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.