huggingface / huggingface/alignment-handbook

Is there a way to freeze some layers of a model ?

Open
#134 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
490
Avg merge
2m
Merged PRs (30d)
1

Description

Can we follow the normal way of:

```
for param in model.base_model.parameters():
param.requires_grad = False
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.