deepseek-ai / deepseek-ai/DeepSeek-Coder

How is the amount of training data measured?

Open
#128 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
24.3k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

Thanks for open-sourcing this excellent work! I have a question about the amount of training data in your tech report and hope for your kind reply.
In Table 1, there are totally 797.92 GB size of training data. Is the size measured by the number of bytes of raw text or by the size of saved files? Some file extensions may compress raw text significantly.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.