deepspeed_to_megatron several issues

1. A recent commit removed tools/convert_checkpoint/deepspeed_checkpoint.py but there is still an attempt to import it in tools/convert_checkpoint/deepspeed_to_megatron.py. The other scripts in the folder appear to be ok. I guess the import on the line 7 should be changed from from .deepspeed_checkpoint import ARGS_KEY, DeepSpeedCheckpoint to from deepspeed.checkpoint.deepspeed_checkpoint import ARGS_KEY, DeepSpeedCheckpoint?

2. https://github.com/microsoft/Megatron-DeepSpeed/issues/91 applies here as well.

3. The function _renest_sd defined on line 90, splits the keys, but I encounter a ValueError: too many values to unpack (expected 2) as one of the keys is named word_embeddings.norm.weight, containing two dots. There are probably more such layer names. I'm attempting to convert my own model bf16_zero (pp=1, tp=1) checkpoints to megatron and/or hf format. Entirely possible this is all my own wrongdoing. If so, please advise, how to successfully convert.

Inizia leggendo tools/convert_checkpoint/deepspeed_to_megatron.py, in particolare il suo import e la funzione _renest_sd, poi esamina il modulo checkpoint correlato a cui si fa riferimento nell’issue. Riproduci la conversione del checkpoint bf16_zero con pp=1 e tp=1 per verificare il fallimento dell’import e il ValueError relativo a dotted-key. Il lavoro è completato quando i problemi di conversione segnalati sono risolti e la conversione viene completata per quel checkpoint.