alipay / alipay/VCSL

Some labels are duplicate

Abierto
#13 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
144
Forks
21
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Thanks for your great work on VCSL dataset! When checking test pair in `split_meta_pairs.json`, we found about 1% of the labels are self-duplicate (e.g. `e45b9eec5ea54e00a2d6e6689cd5fe92-e45b9eec5ea54e00a2d6e6689cd5fe92`, `dd44c4be9fdc4c95bdf075e7e756294e-dd44c4be9fdc4c95bdf075e7e756294e`) or query-reference reverse duplicate (e.g. `dd44c4be9fdc4c95bdf075e7e756294e-0a25c04af29940e5b34676b6c1a7eca1`(label:`[[65, 1, 79, 156]]`) and `0a25c04af29940e5b34676b6c1a7eca1-dd44c4be9fdc4c95bdf075e7e756294e`(label:`[[1, 65, 156, 79]]`)). And labels of some query-reference reverse duplicate pairs are different (e.g. `dd44c4be9fdc4c95bdf075e7e756294e-ca334995c55c45af93dee776799f0433`(label:`[[52, 9, 82, 44], [68, 84, 82, 96], [9, 1, 16, 7], [46, 97, 49, 100], [47, 45, 49, 47]]`) and `ca334995c55c45af93dee776799f0433-dd44c4be9fdc4c95bdf075e7e756294e` (label:`[[9, 52, 44, 82], [1, 9, 7, 16], [97, 46, 100, 49]]`)). These duplicate pairs may cause inaccurate results. I would like to ask that are these duplicate pairs made by mistake or by designed, thank you!

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.