NVIDIA / NVIDIA/CUDALibrarySamples
Compress with facebook zstd, decompress with nvComp
@baliika is already working on this.
Since Jun 9, 2025.
- Dominant language
- Cuda
- Stars
- 2.5k
- Forks
- 478
- PR merge metrics
- No merged PRs in 30d
Description
Is it possible to realize any performance gains in the case where the entire buffer was compressed with facebook zstd (no chunking) by decompressing with nvComp or does nvComp completely rely on parallel chunk decompression and therefore no gains can be expected?
Update:
I was able to implement the path to successfully decompress cpu-compressed buffers with nvComp, but performance is at best approaching that of CPU decompress. In a multi-threaded test performance drop is quite significant.
I have not, however, implemented any resource sharing optimizations at this point to optimize allocations and object creation between competing threads or within the same threads, which, I'm guessing, should help.
But the main question remains, is it possible to improve performance decompressing CPU-compressed not chunked data? Single or multi-threaded.
Thanks!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.