lucidrains / lucidrains/vector-quantize-pytorch

How to train this?

Open
#9 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4k
Forks
338
PR merge metrics
No merged PRs in 30d

Description

Hi, I want to use this package to experiment with data different than images (multivariate time series).
I see that the `commitment_loss` that is returned is not a tensor, but rather a built in `float`, hence it's not possible to backprop through it.

For now i didn't modify any of my other loss calculation code, i just plugged in the quantizer at the beginning of my architecture, but i'd like to be sure if this is the correct way to go about this.

Thanks and keep up, you're doing god's work with your repositories!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the quantizer's commitment_loss return value and how the quantizer is inserted at the beginning of the architecture. Reproduce the multivariate time-series setup and verify whether the loss remains differentiable; done means establishing a supported training path or documenting the limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.