Imageomics / Imageomics/saev

`launch.py` import times are slow

Open
#26 0 comments 1 reaction 0 assignees View on GitHub
performance
Dominant language
Python
Stars
66
Forks
12
PR merge metrics
No merged PRs in 30d

Description

@MisteFr reports slow launch times on the ETH cluster when running `uv run scripts/launch.py shards ...`. I suspect this is a problem because it needs to import every subcommand's package.

There are some issues with directly running modules in `src/saev/framework` because of submitit + cloudpickle + jaxtyping (see [this open issue](https://github.com/patrick-kidger/jaxtyping/issues/332)) but perhaps there is a better way to do this.

Contributor guide

Open the contributing guide

Research direction

Start with scripts/launch.py and profile `uv run scripts/launch.py shards ...` to confirm whether importing every subcommand causes the delay. Read the related code under src/saev/framework and account for the submitit, cloudpickle, and jaxtyping constraints. Done means launch imports are faster without breaking command execution or serialization.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.