Imageomics / Imageomics/pybioclip

Add parquet format as an output for embeddings?

Open
#177 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
67
Forks
14
PR merge metrics
No merged PRs in 30d

Description

The [Embedding Explorer](https://github.com/Imageomics/emb-explorer) (and [image search](https://github.com/Imageomics/bioclip-image-search-lite)?) uses a Parquet database for input of vision embeddings. Maybe we should offer the option here to generate Parquet right here to reduce friction from getting from pybioclip output to Embedding Explorer input.

@netzissou thoughts? Is there a spec for required columns?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the pybioclip CLI output path and inspect the Parquet input requirements of Embedding Explorer and image search. Confirm the required columns and output option with the issue participants; done means pybioclip can produce Parquet accepted by the referenced tools.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.