Kaggle / Kaggle/docker-python

Optimized pillow-simd needed to leverage new GPU instances

Open
#212 14 comments 3 reactions 1 assignee Claimed by @rosbo View on GitHub
Dominant language
Python
Stars
2.7k
Forks
1k
Avg merge
7d 14h
Merged PRs (30d)
2

Description

(Copied from https://www.kaggle.com/dansbecker/running-kaggle-kernels-with-a-gpu/code#328307 as requested by @sebbov ).

With the limited CPU available, being able to quickly read and manipulate images is important. Can I suggest you install pillow-simd with an optimized jpeg library? It will reduce CPU use by around 2-4x when training models, which will dramatically increase the utility of these new instances. The step by step instructions for installing it have been kindly provided by Soumith Chintala here (note that without these exact steps pillow-simd will not use libjpeg-turbo, even if you have it installed as your system libjpeg):

https://gist.github.com/soumith/01da3874bf014d8a8c53406c2b95d56b

I'm not familiar enough with docker to know what PR to send in exactly - hopefully this is enough info for the in-house experts to set it up.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.