deepseek-ai / deepseek-ai/3FS

对于Checkpoint Manager的高性能CKPT读写的疑问

Open
#165 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
10.2k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

Fire-Flyer AI-HPC论文中关于CheckPoint Manager 原文:

During the saving process, each tensor is recorded with its index and the offset within the checkpoint., which makes the location of tensors more convenient during the loading process. With the 3FS batch read API, a loading process can be completed in just a few seconds.

想问一下,这个秒级读入,除了CKPT本身的分块批量读出,在计算节点聚合以外,还有什么技巧么?
另外,这个秒级读出的指标,相应的参数量和单节点带宽是多少?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.