allenai / allenai/scibert

Tensorflow error when loading checkpoints

Aperta
#117 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
1.7k
Fork
232
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

I am trying to rebuild the model using tf.official like so:
```
import tensorflow as tf
import official
import json

config_dict = json.loads(tf.io.gfile.GFile('/content/drive/MyDrive/TREC-COVID/scibert_scivocab_uncased/bert_config.json').read())

bert_config = official.nlp.bert.configs.BertConfig.from_dict(config_dict)
bert_model = official.nlp.bert.bert_models.get_transformer_encoder(bert_config)

checkpoint = tf.train.Checkpoint(encoder=bert_model)
checkpoint.read('/content/drive/MyDrive/TREC-COVID/scibert_scivocab_uncased/bert_model.ckpt').assert_consumed()
```

The last line of the code runs into an error:

```
AssertionError Traceback (most recent call last)
in ()
1 checkpoint = tf.train.Checkpoint(encoder=bert_model)
----> 2 checkpoint.read('/content/drive/MyDrive/TREC-COVID/scibert_scivocab_uncased/bert_model.ckpt').assert_consumed()

/usr/local/lib/python3.7/dist-packages/tensorflow/python/training/tracking/util.py in assert_consumed(self)
1000 raise AssertionError(
1001 "Some objects had attributes which were not restored:{}".format(
-> 1002 "".join(unused_attribute_strings)))
1003 for trackable in self._graph_view.list_objects():
1004 # pylint: disable=protected-access

AssertionError: Some objects had attributes which were not restored:

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.