[FEA] Add support for the cuFile Stream API in cuIO
- Dominant language
- C++
- Stars
- 9.8k
- Forks
- 1.1k
- Avg merge
- 3d 6m
- Merged PRs (30d)
- 278
Description
**Is your feature request related to a problem? Please describe.**
cuFile provides both a synchronous API and an asynchronous "stream" API. kvikIO has bindings for the asynchronous API. We should add support for kvikIO's async cuFile backend in libcudf, so that we can test this and make it available to power-users.
**Describe the solution you'd like**
Somehow add an alternate set of kvikIO binding for device file reads.
**Additional context**
cuFile synchronous API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-io-api
cuFile async "stream" API is documented here: https://docs.nvidia.com/gpudirect-storage/api-reference-guide/index.html#cufile-stream-api
I think the kvikIO API is here: https://docs.rapids.ai/api/kvikio/stable/api/#kvikio.cufile.CuFile.raw_read_async.
Contributor guide
Assessment
This issue has not been assessed yet.