NVIDIA / NVIDIA/cudf

[FEA] Provide a unified config API for all I/O controls currently managed with environment variables

Open
#23,881 0 comments 0 reactions 0 assignees View on GitHub
? - Needs Triage feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

**Is your feature request related to a problem? Please describe.**
A large number of cuIO's tuning knobs are currently only exposed as environment variables. That makes them difficult to tweak programmatically, Moreover, not all of them have historically been reread, so only their initial value controls behavior, meaning that iterative runs cannot be modified live.

**Describe the solution you'd like**
libcudf should expose a config API for all of these settings. That will allow engines built on top of libcudf to benchmark different options and determine optimal configurations.

Contributor guide

Open the contributing guide

Research direction

Start by inventorying cuIO tuning knobs currently exposed as environment variables and reviewing how libcudf reads them. Define the unified configuration surface and live-update behavior; done means engines can programmatically set and benchmark all of these I/O options, including settings that previously only took effect at startup.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
backend-api-design
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.