alipay / alipay/VCSL

Some labels are duplicate

Aperta
#13 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
144
Fork
21
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

Thanks for your great work on VCSL dataset! When checking test pair in `split_meta_pairs.json`, we found about 1% of the labels are self-duplicate (e.g. `e45b9eec5ea54e00a2d6e6689cd5fe92-e45b9eec5ea54e00a2d6e6689cd5fe92`, `dd44c4be9fdc4c95bdf075e7e756294e-dd44c4be9fdc4c95bdf075e7e756294e`) or query-reference reverse duplicate (e.g. `dd44c4be9fdc4c95bdf075e7e756294e-0a25c04af29940e5b34676b6c1a7eca1`(label:`[[65, 1, 79, 156]]`) and `0a25c04af29940e5b34676b6c1a7eca1-dd44c4be9fdc4c95bdf075e7e756294e`(label:`[[1, 65, 156, 79]]`)). And labels of some query-reference reverse duplicate pairs are different (e.g. `dd44c4be9fdc4c95bdf075e7e756294e-ca334995c55c45af93dee776799f0433`(label:`[[52, 9, 82, 44], [68, 84, 82, 96], [9, 1, 16, 7], [46, 97, 49, 100], [47, 45, 49, 47]]`) and `ca334995c55c45af93dee776799f0433-dd44c4be9fdc4c95bdf075e7e756294e` (label:`[[9, 52, 44, 82], [1, 9, 7, 16], [97, 46, 100, 49]]`)). These duplicate pairs may cause inaccurate results. I would like to ask that are these duplicate pairs made by mistake or by designed, thank you!

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.