AnswerDotAI / AnswerDotAI/ModernBERT

What's the difference among the different mode when initialize model from pretrained model?

Open
#171 0 comments 0 reactions 1 assignee Claimed by @warner-benjamin View on GitHub
Dominant language
Python
Stars
1.7k
Forks
145
PR merge metrics
No merged PRs in 30d

Description

```python
def init_model_from_pretrained(
pretrained_model: FlexBertModel,
new_model: FlexBertModel,
mode: Union[str, TileMode] = TileMode.tile_weights_from_middle,
):
```
I notice the method take mode as an argument, and it has three kinds of mode,`'center_weights', 'tile_weights_from_edge', or 'tile_weights_from_middle'`, may I ask what's the differences among those three, and how they influence the initializing process?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.