[QUESTION] in_memory checkpoint type seem not support
Open
bug
- Dominant language
- Python
- Stars
- 17.9k
- Forks
- 4.5k
- Avg merge
- 4d 6h
- Merged PRs (30d)
- 271
Description
Can we remove the in_memory type in the arguments.py [#](https://github.com/NVIDIA/Megatron-LM/blob/b47a9bbc72618a3857f38cfe58c073d76de84c5e/megatron/training/arguments.py#L2023C1-L2023C4) of non-persistent checkpoint?
It seems useless since we can directly use a memory filesystem for writing to memory
Contributor guide
Assessment
This issue has not been assessed yet.