NVIDIA-NeMo / NVIDIA-NeMo/RL

Control/Data Plane Separation

Open
#2,414 0 comments 0 reactions 1 assignee Claimed by @ZhiyuLi-Nvidia View on GitHub
enhancement
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

NeMo RL has used the driver to deal with data and control. This has led to the driver being a bottleneck for data movement since all data funnels through one rank. This is no longer tenable at the scales we are now training at.

This issue tracks the separation of data plane from the driver.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.