Evalutation Scripts, RMSE 0% on all sequences, trajectory file consists only of small number of frames
- Dominant language
- C++
- Stars
- 762
- Forks
- 235
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I have two issues with the code base.
1. I have got to compare accuracy of ICE-BA with some different front-end. But I could not find any evaluation script for computing ATE.
2. I went through the code and found that back-end consists of RMSE calculations. However when I run it, I always get zero LBA and GBA error.
I get the following output:
../bin/back_end ../config/config_of_stereo.txt
Loaded '../config/config_of_stereo.txt'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam0/data/1403637010601666560.png'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/dat/1403637010601666560.png.dat'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam1/data/1403637010601666560.png'
Loaded '/home/isl-server/vo_seqs/vo_sequences/MH02/./calibration.dat'
Tcu = 0.014865 0.999557 -0.025774 0.065223
-0.999881 0.014967 0.003756 -0.020706
0.004140 0.025716 0.999661 -0.008055
Tlr = 0.999997 -0.002317 -0.000343 0.110074
0.002312 0.999898 -0.014091 -0.000157
0.000376 0.014090 0.999901 0.000889
K = 458.653992 457.295990 367.214996 248.375000
d = -0.283408 0.073959 0.000194 0.000018 0.000000 0.000000 0.000000 0.000000
Kr = 457.587006 456.134003 379.998993 255.238007
dr = -0.283684 0.074513 -0.000105 -0.000036 0.000000 0.000000 0.000000 0.000000
Loaded '../config/config_of_stereo.txt'
3040 / 3040 = 100.000000%
-------------------------------------------------------------------------------
RMSE
LBA = 0.000000 / 73.761749 = 0.000000%
GBA = 0.000000 / 73.761749 = 0.000000%
Saved '/home/isl-server/vo_seqs/vo_sequences/MH02/../RMSE_stereo/MH02_1.txt'
-------------------------------------------------------------------------------
Time
LBA = 7206.813965 / 3040 = 2.370662 ms
GBA = 2642.825439 / 315 = 8.389922 ms
Kindly provide solution as soon as possible as we need to meet a near deadline.
Thank you
Contributor guide
No contributing guide indexed for this repository
Research direction
Reproduce ../bin/back_end ../config/config_of_stereo.txt and inspect the generated RMSE_stereo/MH02_1.txt alongside the trajectory inputs under the MH02 paths shown. Trace the evaluation entry point for the missing ATE calculation and the reported LBA/GBA values; done means an ATE evaluation is available and the run no longer produces an unexpectedly short trajectory or all-zero errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- backend, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100