deepseek-ai / deepseek-ai/DeepSeek-Coder

markdown格式的数据预训练

Open
#154 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
24.3k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

你好,我看你们v1.5版本的模型加入markdown格式的数据,在做预训练的时候,比如表格markdown的数据是不是在计算损失的时候是不是应该mask掉

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.