Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test on Roxford5k benchmark #8

Open
wickai opened this issue Feb 15, 2019 · 1 comment
Open

Test on Roxford5k benchmark #8

wickai opened this issue Feb 15, 2019 · 1 comment

Comments

@wickai
Copy link

wickai commented Feb 15, 2019

I am doing some research on image retrieval. I find your method really innovative. But when I use the model you gave to evaluate on Roxford5k benchmark (Medium level) extracting 1000 keypoints, the conclusion indicators are very low, mAP only 26.7, mp@10 50.14. I also did RANSAC after extracting keypoints.

Is this a reasonable conclusion or I did somethin wrong?
Easier queries seems right, but a little difficult queries with view point change turn out wrong.

image

thanks~

@kmyi
Copy link
Member

kmyi commented Feb 15, 2019

lfnet is trained for stereo matching, so we honestly have little idea on how it would perform for image retrieval. A few things that we've noticed is that ratio tests or other heuristics involved in traditional matching could be harmful instead. Thus, a bit of care must be taken when plugging the features into a sophisticated pipeline. Which is true for all local features I guess...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants