dchaley / dchaley/deepcell-segmentation

Scale preprocessing

Open
#320 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
9
Forks
2
PR merge metrics
No merged PRs in 30d

Description

**Input**: npz file
**Output**: pre-processed npz file

Historically, preprocessing has been very light: some intensity normalization and converting to float64 type.

The problem is, for a 1TB image, we can’t just load it into memory. We estimate max GPU to be a few hundred GBs.

Still, we think the parallelization is “straightforward” (e.g. find min/max and/or histogram per tile then normalize each tile).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.