Imageomics / Imageomics/bioclip

Access to 5-shot training data for rare-species dataset

Open
#34 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
278
Forks
26
PR merge metrics
No merged PRs in 30d

Description

Hello, I am looking to compare some on-device model performance for the rare-species dataset by end of week (9/19/2025) for a paper submission and would like to cite the bioclip2 few shot accuracy values. However, I am unable to find the [`seen_in_training`](https://github.com/Imageomics/bioclip/blob/main/data/rarespecies/seen_in_training.json#L2) data online although "Five-Shot Classification" is mentioned on the huggingface data page. They don't seem to overlap with the official [huggingface dataset](https://huggingface.co/datasets/imageomics/rare-species) (using `load_dataset`) base file names or the manual download dataset (using `Dataset Structure` step 3 download instructions) base file names.

My current plan is to randomly sample five items from the test dataset for training and report few shot test performance on the rest of the data but this can't be compared with the [bioclip2 paper](https://arxiv.org/pdf/2505.23883?) values for reference. Any assistance in finding the five shot training data would be greatly appreciated! @rwightman @rom1504 @mitchellnw @Zasder3 @samuelstevens @carlini

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with data/rarespecies/seen_in_training.json and compare its filenames with the official Hugging Face rare-species dataset loaded with load_dataset and the manual download described under Dataset Structure step 3. Check how the Five-Shot Classification data relates to the BioCLIP2 paper values. Done means locating the five-shot data or documenting clearly how it can be accessed.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
data, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.