allenai / allenai/satlas-super-resolution

CLIPScore

Offen
#52 1 Kommentar 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Python
Sterne
347
Forks
51
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

Hi,

Thank you for this interesting repository and contributions.
I clone the repo and tried to reproduce the results. However, I had higher values of CLIPScore than the paper claims. So, I undertake a little study to better understand the results of CLIPScore.
I used the clipa-ViT-bigG-14 pretrained on the DataComp-1B on different pairs of images :

![Image](https://github.com/user-attachments/assets/dcbd324e-836d-45d2-968e-6b4593b5f0c7)

Respectively : semantically different, same, ill-generated and mid- generated images (mid-generated means well generated but not perfectly)

In order to compute the ClipScore, I follow the provided pipeline (F.interpolate(), image_encode() and F.cosine_similarity).
For this pairs I have the following results : (approx. 10**-2)
- semantically different : 0,67
- same picture : 1.0
- ill-generated : 0,91
- mid-generated : 0,83
The remote sensing were generated with the pretrained weights for 8 inputs on the val_set with the configuration proposed (esrgan_baseline_8S2.yml), so the small esrgan proposed.

Thank you for your time,
Hope you can help me

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.