NVIDIA / NVIDIA/cudf

Initial pool size should not be hard coded

Open
#14,760 0 comments 0 reactions 0 assignees View on GitHub
feature request libcudf
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Now that `rmm::pool_memory_resource` does not by default use half of available memory for the initial pool size, cuDF has hard-coded 50% of free memory as the initial size to match previous behavior for benchmarks and tests. This should be configured globally somewhere.

I'm thinking about whether we should parse `percent_of_free_device_memory` from some env variable, instead of hard coding like this in many places. By doing so we can control the number we want at runtime.

_Originally posted by @ttnghia in https://github.com/rapidsai/cudf/pull/14741#discussion_r1448304244_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.