InternLM / InternLM/SIM-CoT

Questions on SIM-CoT training dynamics (decoder training, K selection, and step alignment)

Open
#12 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
215
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Hi, thanks for the great work!

I have a few quick questions about the training dynamics of SIM-CoT. First, is the auxiliary decoder jointly trained with the base model, or is it kept fixed during training? It seems gradients flow through it, but I want to confirm whether its parameters are updated.

Second, regarding the choice of the number of implicit steps `K` and its relation to step-level alignment. In practice, different QA sample (and datasets) may require different numbers of reasoning steps—for example, harder math problems typically involve longer reasoning steps. In this case, for each latent token `z`, which step I should use to supervise it? I also have the same question for the curriculum strategy: when K is gradually increased during training, how is consistent alignment between latent tokens and reasoning steps maintained?

Thanks again for the insightful work!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.