GAP-LAB-CUHK-SZ / GAP-LAB-CUHK-SZ/Total3DUnderstanding

LEN, ODN, and Joint training result looks odd

Open
#19 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
445
Forks
52
PR merge metrics
No merged PRs in 30d

Description

Hi Yinyu:

I tried LEN, ODN training code with batch size 32, but get the following loss curve:
![image](https://user-images.githubusercontent.com/9084912/95763550-bcd23600-0ce1-11eb-815d-debc05f5ad15.png)
It looks like the test loss stops converging soon after a few epochs.
All the test loss shows below:
![image](https://user-images.githubusercontent.com/9084912/95763707-fc991d80-0ce1-11eb-8130-825551f51e39.png)

I then tried joint training with the best LEN and ODN I have and the downloaded pretrained MGNet (Total3D_downloaded_mgnet):
![image](https://user-images.githubusercontent.com/9084912/95763669-ebe8a780-0ce1-11eb-8c90-399f443541a0.png)
The test results of IoU compared to Total3D without joint training (Total3D_mgnet_beforejoint) and the downloaded pretrained Total3D (Total3D downloaded):
![image](https://user-images.githubusercontent.com/9084912/95800573-4574c480-0d2a-11eb-87b9-bb072297e69f.png)

The results shows that joint training with my best LEN and ODN makes 3D Layout IoU worsen. However it's slightly better than the downloaded Total3D which is close to the results of the paper.

Also, It seems that only IoU is provided in the testing results. How can I get the mean absolute error of cam pose, mAP of 3D detection, object translation, rotation and scale errors same as the paper?
![image](https://user-images.githubusercontent.com/9084912/95801131-f9c31a80-0d2b-11eb-8711-c8c730da1904.png)
![image](https://user-images.githubusercontent.com/9084912/96067614-c5d32b00-0ecc-11eb-9500-2a053b4f6bc2.png)
![image](https://user-images.githubusercontent.com/9084912/95801143-fdef3800-0d2b-11eb-9597-7a7c50394669.png)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.