GAP-LAB-CUHK-SZ / GAP-LAB-CUHK-SZ/Total3DUnderstanding

Evaluation code roomlayout.m of cooperative_scene_parsing don't work on the output

Open
#21 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
445
Forks
52
PR merge metrics
No merged PRs in 30d

Description

Hi Yinyu:

I followed your guide to evaluate the results using code from [cooperative_scene_parsing](https://github.com/thusiyuan/cooperative_scene_parsing). With GT downloaded and some essential changes to path settings, the roomlayout.m runs successfully on the results predicted by your work.

However, the roomlayout.m outputs the same IoU of 0 on every sample. Here is sample 1 as an example:
![image](https://user-images.githubusercontent.com/9084912/96606771-37c2ce80-132a-11eb-880b-54fc3bea181b.png)

I tried to turn on the visualization option looking to find the reason:
![image](https://user-images.githubusercontent.com/9084912/96606738-2f6a9380-132a-11eb-89d2-c8069a64c877.png)

The predicted layout bounding box showed in the visualization above is nothing like the visualization with your code utils/visualize.py:
![image](https://user-images.githubusercontent.com/9084912/96606987-78224c80-132a-11eb-96a2-42482dfebc20.png)
![image](https://user-images.githubusercontent.com/9084912/96606998-79ec1000-132a-11eb-8327-d536a6613852.png)

Is there anything I missed? If some more changes need to be made on the evaluation code from [cooperative_scene_parsing](https://github.com/thusiyuan/cooperative_scene_parsing), Is it possible to open-source your version of the final evaluation code?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.