NVIDIA / NVIDIA/cudf

[FEA] Add support for the cuFile Stream API in cuIO

Open
#16,740 1 comment 0 reactions 0 assignees View on GitHub
cuIO feature request libcudf
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

**Is your feature request related to a problem? Please describe.**
cuFile provides both a synchronous API and an asynchronous "stream" API. kvikIO has bindings for the asynchronous API. We should add support for kvikIO's async cuFile backend in libcudf, so that we can test this and make it available to power-users.

**Describe the solution you'd like**
Somehow add an alternate set of kvikIO binding for device file reads.

**Additional context**
cuFile synchronous API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-io-api

cuFile async "stream" API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-stream-api

I think the kvikIO API is here: https://docs.rapids.ai/api/kvikio/stable/api/#kvikio.cufile.CuFile.raw_read_async.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.