dbiir / dbiir/UER-py

KeyError when convert_bert_from_huggingface_to_uer 出错

Open
#223 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3.1k
Forks
520
PR merge metrics
No merged PRs in 30d

Description

由于uer的modelzoo里面没有提供英文bert的下载地址,所以去 huggingface 下载了一个再转换格式。
转换格式期间遇到错误。

可能是您用的旧版本的huggingface bert. 我刚下载的 huggingface bert (https://huggingface.co/bert-base-uncased/tree/main), key 已经变了
```python
output_model["embedding.layer_norm.gamma"] = input_model["model.encoder.layernorm_embedding.weight"]
```
报错:`KeyError: 'model.encoder.layernorm_embedding.weight'`
我看到 input model里面有个key是 `bert.embeddings.LayerNorm.gamma` 应该就是这个了,其他的key我还没有一一核对。

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.