baidu / baidu/ICE-BA

Evalutation Scripts, RMSE 0% on all sequences, trajectory file consists only of small number of frames

Open
#39 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
762
Forks
235
PR merge metrics
No merged PRs in 30d

Description

Hi, I have two issues with the code base.

1. I have got to compare accuracy of ICE-BA with some different front-end. But I could not find any evaluation script for computing ATE.
2. I went through the code and found that back-end consists of RMSE calculations. However when I run it, I always get zero LBA and GBA error.

I get the following output:

../bin/back_end ../config/config_of_stereo.txt
Loaded '../config/config_of_stereo.txt'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam0/data/1403637010601666560.png'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/dat/1403637010601666560.png.dat'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam1/data/1403637010601666560.png'
Loaded '/home/isl-server/vo_seqs/vo_sequences/MH02/./calibration.dat'
Tcu = 0.014865 0.999557 -0.025774 0.065223
-0.999881 0.014967 0.003756 -0.020706
0.004140 0.025716 0.999661 -0.008055
Tlr = 0.999997 -0.002317 -0.000343 0.110074
0.002312 0.999898 -0.014091 -0.000157
0.000376 0.014090 0.999901 0.000889
K = 458.653992 457.295990 367.214996 248.375000
d = -0.283408 0.073959 0.000194 0.000018 0.000000 0.000000 0.000000 0.000000
Kr = 457.587006 456.134003 379.998993 255.238007
dr = -0.283684 0.074513 -0.000105 -0.000036 0.000000 0.000000 0.000000 0.000000
Loaded '../config/config_of_stereo.txt'
3040 / 3040 = 100.000000%
-------------------------------------------------------------------------------
RMSE
LBA = 0.000000 / 73.761749 = 0.000000%
GBA = 0.000000 / 73.761749 = 0.000000%
Saved '/home/isl-server/vo_seqs/vo_sequences/MH02/../RMSE_stereo/MH02_1.txt'
-------------------------------------------------------------------------------
Time
LBA = 7206.813965 / 3040 = 2.370662 ms
GBA = 2642.825439 / 315 = 8.389922 ms

Kindly provide solution as soon as possible as we need to meet a near deadline.

Thank you

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce ../bin/back_end ../config/config_of_stereo.txt and inspect the generated RMSE_stereo/MH02_1.txt alongside the trajectory inputs under the MH02 paths shown. Trace the evaluation entry point for the missing ATE calculation and the reported LBA/GBA values; done means an ATE evaluation is available and the run no longer produces an unexpectedly short trajectory or all-zero errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
backend, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.