AnswerDotAI / AnswerDotAI/ModernBERT
The checkpoint you are trying to load has model type `modernbert` but Transformers does not recognize this architecture
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 145
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I run the example code:
`from transformers import AutoTokenizer, AutoModelForMaskedLM
model_id = "answerdotai/ModernBERT-base"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForMaskedLM.from_pretrained(model_id)`
It shows an error:
`ValueError: The checkpoint you are trying to load has model type `modernbert` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
`
I have installed the up-to-date version:
Transformers=4.47.1
Flash-attn=2.7.2.post1
Could you please advise how to fix it? Thanks.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.