Question regarding image overlap between WildDet3D-Data and WildDet3D-Bench
Open
- Dominant language
- Python
- Stars
- 622
- Forks
- 45
- PR merge metrics
- No merged PRs in 30d
Description
Some images appear to be shared between WildDet3D-Data and WildDet3D-Bench. They all belong to the COCO train subset.
After removing these overlapping images from the test set, the performance of WildDet3D decreases consistently, with the `Dist 3D AP` being:
| w/ Depth | Box-to-3d | Label-to-3d |
| --- | --- | --- |
| Before Removing | 50.31 | 45.21 |
| After Removing | 44.75 | 40.27 |
| wo/ Depth | Box-to-3d | Label-to-3d |
| --- | --- | --- |
| Before Removing | 23.21 | 22.33 |
| After Removing | 19.94 | 20.53 |
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.