huggingface / huggingface/alignment-handbook

ModuleNotFoundError: No module named 'h4'

Open
#193 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
490
Avg merge
2m
Merged PRs (30d)
1

Description

Hello, I want to load the `training_arg.bin` of [zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) and pass it to `DPOTrainer` of `trl` to compute the implicit rewards and logps conveniently, but it seems lack some private modules.

```
import torch
training_args = torch.load("training_args.bin")
```
`ModuleNotFoundError: No module named 'h4'`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the failure with torch.load("training_args.bin") from the zephyr-7b-beta artifact, then trace how DPOTrainer expects to consume the loaded training arguments. Investigate where the missing private h4 module is referenced and whether the artifact can be loaded through a supported path. Done means the documented loading workflow works without ModuleNotFoundError, or the limitation and workaround are clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.