huggingface / huggingface/diffusers
CLIP Score Evaluation without Pre-processing.
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
I am referring to [Evaluating Diffusion Models](https://huggingface.co/docs/diffusers/main/en/conceptual/evaluation), specifically the quantitative evaluation using CLIP score example.
We have images of shape (6, 512, 512, 3).
CLIP score is calculated using `"openai/clip-vit-base-patch16"`.
However, as far as I can tell, the images are not pre-processed to match the format that `"openai/clip-vit-base-patch16"` was trained on (e.g., images of size 224x224 pixels).
Should the images have been processed before or can we still reliably use the CLIP score with the images in their original format?
Please let me know if I have overlooked or am misunderstanding something. Thanks!
Contributor guide
Assessment
This issue has not been assessed yet.