Imageomics / Imageomics/bioclip
Access to 5-shot training data for rare-species dataset
- Dominant language
- Python
- Stars
- 278
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
Hello, I am looking to compare some on-device model performance for the rare-species dataset by end of week (9/19/2025) for a paper submission and would like to cite the bioclip2 few shot accuracy values. However, I am unable to find the [`seen_in_training`](https://github.com/Imageomics/bioclip/blob/main/data/rarespecies/seen_in_training.json#L2) data online although "Five-Shot Classification" is mentioned on the huggingface data page. They don't seem to overlap with the official [huggingface dataset](https://huggingface.co/datasets/imageomics/rare-species) (using `load_dataset`) base file names or the manual download dataset (using `Dataset Structure` step 3 download instructions) base file names.
My current plan is to randomly sample five items from the test dataset for training and report few shot test performance on the rest of the data but this can't be compared with the [bioclip2 paper](https://arxiv.org/pdf/2505.23883?) values for reference. Any assistance in finding the five shot training data would be greatly appreciated! @rwightman @rom1504 @mitchellnw @Zasder3 @samuelstevens @carlini
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with data/rarespecies/seen_in_training.json and compare its filenames with the official Hugging Face rare-species dataset loaded with load_dataset and the manual download described under Dataset Structure step 3. Check how the Five-Shot Classification data relates to the BioCLIP2 paper values. Done means locating the five-shot data or documenting clearly how it can be accessed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- data, machine-learning
- Issue type
- Documentation
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100