deepseek-ai / deepseek-ai/DeepSeek-Math

DPO的梯度系数推导不够严格？

Open
#38 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3.4k
Forks
592
No merged PRs in 30d

Description

sigmoid内的求和号，应该不能被提取出来，和后面的token求和项融合？

![Image](https://github.com/user-attachments/assets/4afbf129-07d3-4432-b98e-88a5105a1728)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.