jupyterhub / jupyterhub/batchspawner

Speed up spawning and Python on HPC

Open
#190 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
207
Forks
136
PR merge metrics
No merged PRs in 30d

Description

Dear Batchspawner developers/users,

this is not an issue, just asking for best practices/advices.
Technically, our Jupyterhub (1.1.0) deployment on HPC using batchspwner (1.0.0) works fine. However, there are still some drawbacks that reduce the use of the server.

1. Spawning notebooks is taking so long even if computing nodes already affected to the Slurm job
2. Loading/importing python packages is very slow

Anyone facing this problem? is there a way to speed up those processes on HPC?

For information, we use modules for python packages and also jupyterhub-singleuser is located in a conda env.

Thank you in advance.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.