huggingface / huggingface/diffusers

CLIP Score Evaluation without Pre-processing.

Open
#10,904 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

I am referring to [Evaluating Diffusion Models](https://huggingface.co/docs/diffusers/main/en/conceptual/evaluation), specifically the quantitative evaluation using CLIP score example.

We have images of shape (6, 512, 512, 3).

CLIP score is calculated using `"openai/clip-vit-base-patch16"`.

However, as far as I can tell, the images are not pre-processed to match the format that `"openai/clip-vit-base-patch16"` was trained on (e.g., images of size 224x224 pixels).

Should the images have been processed before or can we still reliably use the CLIP score with the images in their original format?

Please let me know if I have overlooked or am misunderstanding something. Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.