bytedance / bytedance/MegaTTS3

The details of the wavae loss function in the paper

Open
#80 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.1k
Forks
474
PR merge metrics
No merged PRs in 30d

Description

In the paper, the wavae loss function consists of three components: spectrogram reconstruction loss, KL loss, and LSGAN-styled adversarial loss. I have three questions:
1. Does the spectrogram reconstruction loss refer to the MSE loss of the mel-spectrogram?
2. In the KL loss , the shape of the posterior sampling is [bs, channel, frame_T]. When calculating the loss, over which dimension is the summation performed? In other words, does this loss constrain the channels or each frame?
3. Does the LSGAN-styled adversarial loss only include MPD, MRD, and MSD?

I would greatly appreciate it if the authors could address my questions. Thank you very much for your time and clarification!

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no repository files, tests, or entry points. Start with the paper's definitions of spectrogram reconstruction, KL, and LSGAN losses; done means clarifying the three questions raised in the issue.

Written by the indexing model from the issue text.

Assessment

Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.