Imageomics / Imageomics/hpc-inference

Package Renaming

Open
#23 1 comment 0 reactions 1 assignee View on GitHub

@NetZissou is already working on this.

Since Dec 3, 2025.

Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

We need a new name for the package. The original hpc-inference name isn't very intuitive.

We rely heavily on AI for image workflows—animal and face detection, open-ended grounding, BioCLIP embeddings, etc. These tasks require model inference on large batches of images, but a typical simple workflow suffer from I/O bottlenecks and sequential processing, which starve GPUs and waste resources.

This package solves that by parallelizing data loading and preprocessing for large-scale image datasets (folders, Parquet, HDF5). It provides a custom iterable dataset and a set of scalable workflows designed for SLURM clusters so GPUs stay fully fed.

Image

Plan

  • Discuss with Informatics Team to come up with a new package name
  • Refactor codebase to reflect new package name in a separate branch
  • Update documentation
  • Validation
  • Merge changes back to main
  • Update the package dependency for other packages.
  • Reinstall in local venv

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.