InternLM / InternLM/Tutorial

Conda环境和下载pip包(torch)在8GB A100上很慢

Aperta
#1,788 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
2k
Fork
1.5k
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

Hello,

In 1.2. 基础关卡, 第 2 关 (the demo which gives 30% A100 computing access), it takes a very long time to set up the "demo" conda environment (approximately 5 minutes); when I install a pip package it takes 25 minutes, for 30 minutes in total.

Mainly, the issue is installing the packages; downloading works okay but when installing the collected packages it takes quite a long time.

If creating the demo conda environment takes time due to the small amount of CPU resources in the virtual machine, maybe it would be a good idea to do either or both of two things:

1. Tell learners in advance to partition some of their time specifically to only download the conda environment and LLM, or
2. Create the demo conda environment on all the 10% A100 machines (which should be possible as the download size is ~5 GB, while the total memory available to users is ~40 GB.)

Do you think this a good idea? Thank you very much!

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.