NVIDIA / NVIDIA/CUDALibrarySamples

Compress with facebook zstd, decompress with nvComp

Open
#263 2 comments 0 reactions 1 assignee View on GitHub

@baliika is already working on this.

Since Jun 9, 2025.

nvCOMP
Dominant language
Cuda
Stars
2.5k
Forks
478
PR merge metrics
No merged PRs in 30d

Description

Is it possible to realize any performance gains in the case where the entire buffer was compressed with facebook zstd (no chunking) by decompressing with nvComp or does nvComp completely rely on parallel chunk decompression and therefore no gains can be expected?

Update:
I was able to implement the path to successfully decompress cpu-compressed buffers with nvComp, but performance is at best approaching that of CPU decompress. In a multi-threaded test performance drop is quite significant.
I have not, however, implemented any resource sharing optimizations at this point to optimize allocations and object creation between competing threads or within the same threads, which, I'm guessing, should help.

But the main question remains, is it possible to improve performance decompressing CPU-compressed not chunked data? Single or multi-threaded.

Thanks!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.