AnswerDotAI / AnswerDotAI/ModernBERT

The checkpoint you are trying to load has model type `modernbert` but Transformers does not recognize this architecture

Open
#145 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
145
PR merge metrics
No merged PRs in 30d

Description

Hi,

I run the example code:

`from transformers import AutoTokenizer, AutoModelForMaskedLM

model_id = "answerdotai/ModernBERT-base"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForMaskedLM.from_pretrained(model_id)`

It shows an error:

`ValueError: The checkpoint you are trying to load has model type `modernbert` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
`

I have installed the up-to-date version:
Transformers=4.47.1
Flash-attn=2.7.2.post1

Could you please advise how to fix it? Thanks.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.