adjust likelihood using z-score#1272
Conversation
|
Thanks for the suggestion, though as it is touching a core feature of RTAB-Map, I would prefer to have an parameter/option to switch on/off this new approach (with default "off") until I can compare with the original Precision/Recall results (with all those datasets https://github.com/introlab/rtabmap/wiki/Benchmark) to see if results are similar, better or worst. To do so, I'll check if I could make a docker file to automate/test against at least the main loop closure datasets. |
|
Yes, this change needs more testing. I've only done some preliminary testing so far, and found it produces pretty pleasing likelihood curves. In particular, no matter which method is used to calculate the raw likelihood, the likelihood curves are very similar. It’s just that the PDF curves have become a bit flat, so we may need to further adjust the parameters of the Bayesian filter. The reason is that z-score is not prone to particularly large values. A significant loop event generally only has 3 to 6 σ. New location likelihood is limited to between 1 and 2. Since such distribution characteristics are stable, Bayesian filtering should be able to handle them well. |
|
I added a new parameter to select this approach: set Here is a comparison of resulting hypotheses of the Bayes filter based on the old (original) and proposed approaches. Note that for the proposed approach, we should set NewCollege dataset:
CityCentre dataset:
UdeS_1Hz dataset:
In conclusion, the resulting Precision/Recall curves are similar using one or the other approach for BOW. However, the To reproduce the results, see https://github.com/introlab/rtabmap/tree/master/archive/2010-LoopClosure#readme |
|
Great to see your test results. I've been doing real-time testing with the OAK camera recently, so I haven't tested it on these datasets yet. I'm a little surprised that from your PR curves, it seems that the AUC is higher even if you still use BOW? |






I constructed a new method to adjust the likelihood, as a solution to #1105 (comment). It should be compatible with previous similarity evaluation methods, as well as VLAD. The idea is to calculate z-score for values greater than μ + σ. This eliminates the effect of different distributions. For new location likelihood, how significant the max value is will be evaluated.