NVIDIA-NeMo / NVIDIA-NeMo/RL

layer-by-layer comparison tool between policy/generation

Open
#1,513 0 comments 0 reactions 1 assignee Claimed by @hemildesai View on GitHub
enhancement
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

Automodel has added this nice util to compare HF and custom models layer by layer https://github.com/NVIDIA-NeMo/Automodel/pull/787

We should add a utility that does this.

We already have one util https://github.com/NVIDIA-NeMo/RL/blob/main/tools/refit_verifier.py that does e2e forward pass comparison, but most of the time we need to compare layer-by-layer once we see the difference

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.