lucidrains/vector-quantize-pytorch

View on GitHub

Vector (and Scalar) Quantization, in Pytorch

Stars: 4k
Forks: 338
Open beginner issues: 0
Indexed issues: 49

Dominant language: Python
License: MIT
Last GitHub push: Sep 2, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

49 open issues indexed

Learning codebooks also updates the encoder ? Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lucidrains/vector-quantize-pytorch#236 · 3 comments · 1 reaction · Opened Dec 12, 2025
Multi-Scale Residual Vector Quantization Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#225 · 12 comments · 1 reaction · Opened Oct 4, 2025
Which technique works? Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lucidrains/vector-quantize-pytorch#216 · 2 comments · 4 reactions · Opened May 3, 2025
SimVQ trains Failed! Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#212 · Opened Apr 18, 2025
about BSQ Loss Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#199 · 1 comment · Opened Mar 6, 2025
FSQ Oddness Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#194 · 5 comments · Opened Feb 6, 2025
LFQ: why can't we have projections? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#192 · Opened Feb 4, 2025
Building intuition about the latent quantizer Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lucidrains/vector-quantize-pytorch#190 · Opened Jan 28, 2025
Residual simVQ loss Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#184 · Opened Dec 26, 2024
About multi-head vq Open

Difficulty 1/5 1-3 hours Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#183 · Opened Dec 23, 2024
Extracting learnt embeddings for analysis Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lucidrains/vector-quantize-pytorch#182 · Opened Dec 20, 2024
DDP: RuntimeError: shape mismatch: value tensor of shape [535, 256] cannot be broadcast to indexing result of shape [537, 256] Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#169 · 3 comments · Opened Nov 6, 2024
output dimensions for vector quantize Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#168 · 2 comments · Opened Oct 28, 2024
What is the difference between Grouped VQ and Multi-codebook VQ when used for Autoregressive LLM training? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#157 · Opened Aug 30, 2024
Difference between FSQ and LFQ Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#152 · 2 comments · Opened Aug 6, 2024
LatentQuantize exploding loss Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#151 · 2 comments · 1 reaction · Opened Aug 1, 2024
Seeking clarifications regarding learnable codebook Open

Difficulty 4/5 3-5 days Newbie friendliness 32/100

lucidrains/vector-quantize-pytorch#147 · Opened Jul 17, 2024
Bug in FSQ, with return_indices to False and image-type feature input Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#139 · Opened Jun 20, 2024
How to generate image using this repository Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#134 · Opened Jun 13, 2024
Why do I get almost the same codes after the 1st batch? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#131 · 1 comment · 2 reactions · Opened May 23, 2024
Some clarification required Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#130 · 3 comments · Opened May 19, 2024
Will the 16 or 32 codebook dimension hamper the representational capacity of autoencoders? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#127 · 2 comments · 2 reactions · Opened May 13, 2024
codebook merge Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#126 · 1 comment · Opened May 8, 2024
Examples Codebook Utilization does not generalize Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

lucidrains/vector-quantize-pytorch#109 · Opened Feb 25, 2024
Gumbel max trick does not seem to make sense in here Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lucidrains/vector-quantize-pytorch#108 · 1 reaction · Opened Feb 23, 2024
How to Train Residual LFQ Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#103 · 1 comment · 4 reactions · Opened Jan 19, 2024
How to get the original code by saved codebook and index Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#102 · 1 comment · Opened Jan 18, 2024
learnable_codebook and in-place optimization Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

lucidrains/vector-quantize-pytorch#97 · 1 comment · 3 reactions · Opened Dec 27, 2023
LFQ loss is negative? Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

lucidrains/vector-quantize-pytorch#92 · 4 comments · Opened Dec 11, 2023
Is it possible to use Cosine Distance in Residual-VQ? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#90 · 1 comment · Opened Dec 4, 2023
Allow for sample_codebook_temp to be annealed? Open

Difficulty 3/5 1-2 days Newbie friendliness 32/100

lucidrains/vector-quantize-pytorch#67 · 1 comment · Opened Aug 16, 2023
How about ChamferDistance instead of cdist to calculate KNN? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#64 · 2 comments · 1 reaction · Opened Jul 26, 2023
Support perplexity to measure index collapse Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#63 · 4 comments · 3 reactions · Opened Jul 24, 2023
Hi，I meet some debug when i inference the model Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#60 · 3 comments · Opened Jun 21, 2023
Error when using `sync_codebook=True` with `torch.compile` Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#41 · 1 comment · Opened Mar 17, 2023
EMA update on CosineCodebook Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#26 · 8 comments · Opened Sep 27, 2022
Loss and Backprop Details Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#23 · 3 comments · Opened Aug 11, 2022
Missing parameter of beta Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#22 · 3 comments · 1 reaction · Opened Aug 9, 2022
No way of training the codebook Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#20 · 5 comments · 10 reactions · Opened Jul 26, 2022
RVQ loss Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lucidrains/vector-quantize-pytorch#18 · 2 comments · Opened Jul 6, 2022
Plugging vector-quantize-pytorch into taming-transformers Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#16 · 2 comments · 1 reaction · Opened Mar 31, 2022
How to gather cluster_size and embed_sum when use DataParallel (DP) Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#15 · 1 comment · Opened Jan 28, 2022
Explain DDP example Open

Difficulty 3/5 1-2 days Newbie friendliness 32/100

lucidrains/vector-quantize-pytorch#14 · Opened Jan 10, 2022
[Feature Request] Reservoir Restart & Batch Normalisation Before Flattening Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#11 · 1 reaction · Opened Dec 10, 2021
How to train this? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#9 · 2 comments · Opened Dec 3, 2021
VectorQuantize not JIT-safe Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#8 · 8 comments · Opened Dec 2, 2021
Eval mode Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lucidrains/vector-quantize-pytorch#6 · 2 comments · Opened Nov 4, 2021
Missing feature to reproduce SoundStream's Residual Vector Quantizer Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lucidrains/vector-quantize-pytorch#3 · 19 comments · 1 reaction · Opened Oct 17, 2021
[Feature request] Implement dead code revival Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

lucidrains/vector-quantize-pytorch#2 · 7 comments · Opened Oct 2, 2021

lucidrains/vector-quantize-pytorch

Get new issues in your inbox