Comfy-Org / Comfy-Org/ComfyUI

[feature request]: integrate GDS (GPUDirect Storage)

Open
#10,257 0 comments 3 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

I want to integrate GDS to the system. This will allow more model inference for GPU-poors (like me).

Not all GPUs support GDS, and I am not sure the equivalent for AMD or Intel GPUs. But we can start with NVIDIA GPUs, and GDS is open source, so devs can try building for their own. And NVIDIA is activly developing this, so we should not be that much worried.

Willing to work on this one.

ref:
- https://docs.nvidia.com/gpudirect-storage/
- https://github.com/NVIDIA/gds-nvidia-fs

### Existing Solutions

targeting each node would require extensive changes in all the existing workflows, but we can simply change on the abstract layer, and we are done, we are up and running with new features

### Other

Willing to work on this one. Keep me in your prayers.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.