lucidrains / lucidrains/vector-quantize-pytorch

Hi,I meet some debug when i inference the model

Open
#60 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4k
Forks
338
PR merge metrics
No merged PRs in 30d

Description

What are the causes of the following problems?

Missing key(s) in state_dict: "quantizer.vq.layers.12._codebook.inited", "quantizer.vq.layers.12._codebook.cluster_size", "quantizer.vq.layers.12._codebook.embed", "quantizer.vq.layers.12._codebook.embed_avg", "quantizer.vq.layers.13._codebook.inited", "quantizer.vq.layers.13._codebook.cluster_size", "quantizer.vq.layers.13._codebook.embed", "quantizer.vq.layers.13._codebook.embed_avg", "quantizer.vq.layers.14._codebook.inited", "quantizer.vq.layers.14._codebook.cluster_size", "quantizer.vq.layers.14._codebook.embed", "quantizer.vq.layers.14._codebook.embed_avg", "quantizer.vq.layers.15._codebook.inited", "quantizer.vq.layers.15._codebook.cluster_size", "quantizer.vq.layers.15._codebook.embed", "quantizer.vq.layers.15._codebook.embed_avg", "quantizer.vq.layers.16._codebook.inited", "quantizer.vq.layers.16._codebook.cluster_size", "quantizer.vq.layers.16._codebook.embed", "quantizer.vq.layers.16._codebook.embed_avg", "quantizer.vq.layers.17._codebook.inited", "quantizer.vq.layers.17._codebook.cluster_size", "quantizer.vq.layers.17._codebook.embed", "quantizer.vq.layers.17._codebook.embed_avg", "quantizer.vq.layers.18._codebook.inited", "quantizer.vq.layers.18._codebook.cluster_size", "quantizer.vq.layers.18._codebook.embed", "quantizer.vq.layers.18._codebook.embed_avg", "quantizer.vq.layers.19._codebook.inited", "quantizer.vq.layers.19._codebook.cluster_size", "quantizer.vq.layers.19._codebook.embed", "quantizer.vq.layers.19._codebook.embed_avg", "quantizer.vq.layers.20._codebook.inited", "quantizer.vq.layers.20._codebook.cluster_size", "quantizer.vq.layers.20._codebook.embed", "quantizer.vq.layers.20._codebook.embed_avg", "quantizer.vq.layers.21._codebook.inited", "quantizer.vq.layers.21._codebook.cluster_size", "quantizer.vq.layers.21._codebook.embed", "quantizer.vq.layers.21._codebook.embed_avg", "quantizer.vq.layers.22._codebook.inited", "quantizer.vq.layers.22._codebook.cluster_size", "quantizer.vq.layers.22._codebook.embed", "quantizer.vq.layers.22._codebook.embed_avg", "quantizer.vq.layers.23._codebook.inited", "quantizer.vq.layers.23._codebook.cluster_size", "quantizer.vq.layers.23._codebook.embed", "quantizer.vq.layers.23._codebook.embed_avg".

Contributor guide

No contributing guide indexed for this repository

Research direction

No repository file or test is named in the report. Start by reproducing model inference with the reported state_dict and comparing the model configuration with the saved model; done means the cause of the missing quantizer keys is identified and a reproducible resolution is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.