NetVLAD: CNN architecture for weakly supervised place recognition. Arandjelović, R., Gronat, P., Torii, A., Pajdla, T., & Sivic, J. arXiv:1511.07247 [cs], May, 2016. arXiv: 1511.07247
Paper abstract bibtex We tackle the problem of large scale visual place recognition, where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the "Vector of Locally Aggregated Descriptors" image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture significantly outperforms non-learnt image representations and off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and improves over current state-of-the-art compact image representations on standard image retrieval benchmarks.
@article{arandjelovic_netvlad_2016,
title = {{NetVLAD}: {CNN} architecture for weakly supervised place recognition},
shorttitle = {{NetVLAD}},
url = {http://arxiv.org/abs/1511.07247},
abstract = {We tackle the problem of large scale visual place recognition, where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the "Vector of Locally Aggregated Descriptors" image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture significantly outperforms non-learnt image representations and off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and improves over current state-of-the-art compact image representations on standard image retrieval benchmarks.},
urldate = {2022-03-02},
journal = {arXiv:1511.07247 [cs]},
author = {Arandjelović, Relja and Gronat, Petr and Torii, Akihiko and Pajdla, Tomas and Sivic, Josef},
month = may,
year = {2016},
note = {arXiv: 1511.07247},
keywords = {Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning},
}
Downloads: 0
{"_id":"f8iJYdoQLfwKCX2zo","bibbaseid":"arandjelovi-gronat-torii-pajdla-sivic-netvladcnnarchitectureforweaklysupervisedplacerecognition-2016","author_short":["Arandjelović, R.","Gronat, P.","Torii, A.","Pajdla, T.","Sivic, J."],"bibdata":{"bibtype":"article","type":"article","title":"NetVLAD: CNN architecture for weakly supervised place recognition","shorttitle":"NetVLAD","url":"http://arxiv.org/abs/1511.07247","abstract":"We tackle the problem of large scale visual place recognition, where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the \"Vector of Locally Aggregated Descriptors\" image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture significantly outperforms non-learnt image representations and off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and improves over current state-of-the-art compact image representations on standard image retrieval benchmarks.","urldate":"2022-03-02","journal":"arXiv:1511.07247 [cs]","author":[{"propositions":[],"lastnames":["Arandjelović"],"firstnames":["Relja"],"suffixes":[]},{"propositions":[],"lastnames":["Gronat"],"firstnames":["Petr"],"suffixes":[]},{"propositions":[],"lastnames":["Torii"],"firstnames":["Akihiko"],"suffixes":[]},{"propositions":[],"lastnames":["Pajdla"],"firstnames":["Tomas"],"suffixes":[]},{"propositions":[],"lastnames":["Sivic"],"firstnames":["Josef"],"suffixes":[]}],"month":"May","year":"2016","note":"arXiv: 1511.07247","keywords":"Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning","bibtex":"@article{arandjelovic_netvlad_2016,\n\ttitle = {{NetVLAD}: {CNN} architecture for weakly supervised place recognition},\n\tshorttitle = {{NetVLAD}},\n\turl = {http://arxiv.org/abs/1511.07247},\n\tabstract = {We tackle the problem of large scale visual place recognition, where the task is to quickly and accurately recognize the location of a given query photograph. We present the following three principal contributions. First, we develop a convolutional neural network (CNN) architecture that is trainable in an end-to-end manner directly for the place recognition task. The main component of this architecture, NetVLAD, is a new generalized VLAD layer, inspired by the \"Vector of Locally Aggregated Descriptors\" image representation commonly used in image retrieval. The layer is readily pluggable into any CNN architecture and amenable to training via backpropagation. Second, we develop a training procedure, based on a new weakly supervised ranking loss, to learn parameters of the architecture in an end-to-end manner from images depicting the same places over time downloaded from Google Street View Time Machine. Finally, we show that the proposed architecture significantly outperforms non-learnt image representations and off-the-shelf CNN descriptors on two challenging place recognition benchmarks, and improves over current state-of-the-art compact image representations on standard image retrieval benchmarks.},\n\turldate = {2022-03-02},\n\tjournal = {arXiv:1511.07247 [cs]},\n\tauthor = {Arandjelović, Relja and Gronat, Petr and Torii, Akihiko and Pajdla, Tomas and Sivic, Josef},\n\tmonth = may,\n\tyear = {2016},\n\tnote = {arXiv: 1511.07247},\n\tkeywords = {Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning},\n}\n\n","author_short":["Arandjelović, R.","Gronat, P.","Torii, A.","Pajdla, T.","Sivic, J."],"key":"arandjelovic_netvlad_2016","id":"arandjelovic_netvlad_2016","bibbaseid":"arandjelovi-gronat-torii-pajdla-sivic-netvladcnnarchitectureforweaklysupervisedplacerecognition-2016","role":"author","urls":{"Paper":"http://arxiv.org/abs/1511.07247"},"keyword":["Computer Science - Computer Vision and Pattern Recognition","Computer Science - Machine Learning"],"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/mxmplx","dataSources":["aXmRAq63YsH7a3ufx"],"keywords":["computer science - computer vision and pattern recognition","computer science - machine learning"],"search_terms":["netvlad","cnn","architecture","weakly","supervised","place","recognition","arandjelović","gronat","torii","pajdla","sivic"],"title":"NetVLAD: CNN architecture for weakly supervised place recognition","year":2016}