Kaggle / Kaggle/docker-python

Optimized pillow-simd needed to leverage new GPU instances

Aperta
#212 14 commenti 3 reazioni 1 assegnatario Rivendicata da @rosbo Vedi su GitHub
Lingua principale
Python
Stelle
2.7k
Fork
1k
Merge medio
7g 14h
PR unite (30g)
2

Descrizione

(Copied from https://www.kaggle.com/dansbecker/running-kaggle-kernels-with-a-gpu/code#328307 as requested by @sebbov ).

With the limited CPU available, being able to quickly read and manipulate images is important. Can I suggest you install pillow-simd with an optimized jpeg library? It will reduce CPU use by around 2-4x when training models, which will dramatically increase the utility of these new instances. The step by step instructions for installing it have been kindly provided by Soumith Chintala here (note that without these exact steps pillow-simd will not use libjpeg-turbo, even if you have it installed as your system libjpeg):

https://gist.github.com/soumith/01da3874bf014d8a8c53406c2b95d56b

I'm not familiar enough with docker to know what PR to send in exactly - hopefully this is enough info for the in-house experts to set it up.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.