author_facet Kniaz, V. V.
Fedorenko, V. V.
Fomin, N. A.
Kniaz, V. V.
Fedorenko, V. V.
Fomin, N. A.
author Kniaz, V. V.
Fedorenko, V. V.
Fomin, N. A.
spellingShingle Kniaz, V. V.
Fedorenko, V. V.
Fomin, N. A.
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
General Earth and Planetary Sciences
General Environmental Science
author_sort kniaz, v. v.
spelling Kniaz, V. V. Fedorenko, V. V. Fomin, N. A. 2194-9034 Copernicus GmbH General Earth and Planetary Sciences General Environmental Science http://dx.doi.org/10.5194/isprs-archives-xlii-2-513-2018 <jats:p>Abstract. Low-textured objects pose challenges for an automatic 3D model reconstruction. Such objects are common in archeological applications of photogrammetry. Most of the common feature point descriptors fail to match local patches in featureless regions of an object. Hence, automatic documentation of the archeological process using Structure from Motion (SfM) methods is challenging. Nevertheless, such documentation is possible with the aid of a human operator. Deep learning-based descriptors have outperformed most of common feature point descriptors recently. This paper is focused on the development of a new Wide Image Zone Adaptive Robust feature Descriptor (WIZARD) based on the deep learning. We use a convolutional auto-encoder to compress discriminative features of a local path into a descriptor code. We build a codebook to perform point matching on multiple images. The matching is performed using the nearest neighbor search and a modified voting algorithm. We present a new “Multi-view Amphora” (Amphora) dataset for evaluation of point matching algorithms. The dataset includes images of an Ancient Greek vase found at Taman Peninsula in Southern Russia. The dataset provides color images, a ground truth 3D model, and a ground truth optical flow. We evaluated the WIZARD descriptor on the “Amphora” dataset to show that it outperforms the SIFT and SURF descriptors on the complex patch pairs. </jats:p> DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
doi_str_mv 10.5194/isprs-archives-xlii-2-513-2018
facet_avail Online
Free
format ElectronicArticle
fullrecord blob:ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNTE5NC9pc3Bycy1hcmNoaXZlcy14bGlpLTItNTEzLTIwMTg
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNTE5NC9pc3Bycy1hcmNoaXZlcy14bGlpLTItNTEzLTIwMTg
institution DE-D275
DE-Bn3
DE-Brt1
DE-Zwi2
DE-D161
DE-Gla1
DE-Zi4
DE-15
DE-Pl11
DE-Rs1
DE-105
DE-14
DE-Ch1
DE-L229
imprint Copernicus GmbH, 2018
imprint_str_mv Copernicus GmbH, 2018
issn 2194-9034
issn_str_mv 2194-9034
language English
mega_collection Copernicus GmbH (CrossRef)
match_str kniaz2018deeplearningforlowtexturedimagematching
publishDateSort 2018
publisher Copernicus GmbH
recordtype ai
record_format ai
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
source_id 49
title DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_unstemmed DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_full DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_fullStr DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_full_unstemmed DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_short DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_sort deep learning for lowtextured image matching
topic General Earth and Planetary Sciences
General Environmental Science
url http://dx.doi.org/10.5194/isprs-archives-xlii-2-513-2018
publishDate 2018
physical 513-518
description <jats:p>Abstract. Low-textured objects pose challenges for an automatic 3D model reconstruction. Such objects are common in archeological applications of photogrammetry. Most of the common feature point descriptors fail to match local patches in featureless regions of an object. Hence, automatic documentation of the archeological process using Structure from Motion (SfM) methods is challenging. Nevertheless, such documentation is possible with the aid of a human operator. Deep learning-based descriptors have outperformed most of common feature point descriptors recently. This paper is focused on the development of a new Wide Image Zone Adaptive Robust feature Descriptor (WIZARD) based on the deep learning. We use a convolutional auto-encoder to compress discriminative features of a local path into a descriptor code. We build a codebook to perform point matching on multiple images. The matching is performed using the nearest neighbor search and a modified voting algorithm. We present a new “Multi-view Amphora” (Amphora) dataset for evaluation of point matching algorithms. The dataset includes images of an Ancient Greek vase found at Taman Peninsula in Southern Russia. The dataset provides color images, a ground truth 3D model, and a ground truth optical flow. We evaluated the WIZARD descriptor on the “Amphora” dataset to show that it outperforms the SIFT and SURF descriptors on the complex patch pairs. </jats:p>
container_start_page 513
container_title The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
container_volume XLII-2
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
_version_ 1792330375789281289
geogr_code not assigned
last_indexed 2024-03-01T13:24:05.225Z
geogr_code_person not assigned
openURL url_ver=Z39.88-2004&ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fvufind.svn.sourceforge.net%3Agenerator&rft.title=DEEP+LEARNING+FOR+LOWTEXTURED+IMAGE+MATCHING&rft.date=2018-05-30&genre=article&issn=2194-9034&volume=XLII-2&spage=513&epage=518&pages=513-518&jtitle=The+International+Archives+of+the+Photogrammetry%2C+Remote+Sensing+and+Spatial+Information+Sciences&atitle=DEEP+LEARNING+FOR+LOWTEXTURED+IMAGE+MATCHING&aulast=Fomin&aufirst=N.+A.&rft_id=info%3Adoi%2F10.5194%2Fisprs-archives-xlii-2-513-2018&rft.language%5B0%5D=eng
SOLR
_version_ 1792330375789281289
author Kniaz, V. V., Fedorenko, V. V., Fomin, N. A.
author_facet Kniaz, V. V., Fedorenko, V. V., Fomin, N. A., Kniaz, V. V., Fedorenko, V. V., Fomin, N. A.
author_sort kniaz, v. v.
container_start_page 513
container_title The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
container_volume XLII-2
description <jats:p>Abstract. Low-textured objects pose challenges for an automatic 3D model reconstruction. Such objects are common in archeological applications of photogrammetry. Most of the common feature point descriptors fail to match local patches in featureless regions of an object. Hence, automatic documentation of the archeological process using Structure from Motion (SfM) methods is challenging. Nevertheless, such documentation is possible with the aid of a human operator. Deep learning-based descriptors have outperformed most of common feature point descriptors recently. This paper is focused on the development of a new Wide Image Zone Adaptive Robust feature Descriptor (WIZARD) based on the deep learning. We use a convolutional auto-encoder to compress discriminative features of a local path into a descriptor code. We build a codebook to perform point matching on multiple images. The matching is performed using the nearest neighbor search and a modified voting algorithm. We present a new “Multi-view Amphora” (Amphora) dataset for evaluation of point matching algorithms. The dataset includes images of an Ancient Greek vase found at Taman Peninsula in Southern Russia. The dataset provides color images, a ground truth 3D model, and a ground truth optical flow. We evaluated the WIZARD descriptor on the “Amphora” dataset to show that it outperforms the SIFT and SURF descriptors on the complex patch pairs. </jats:p>
doi_str_mv 10.5194/isprs-archives-xlii-2-513-2018
facet_avail Online, Free
format ElectronicArticle
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
geogr_code not assigned
geogr_code_person not assigned
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNTE5NC9pc3Bycy1hcmNoaXZlcy14bGlpLTItNTEzLTIwMTg
imprint Copernicus GmbH, 2018
imprint_str_mv Copernicus GmbH, 2018
institution DE-D275, DE-Bn3, DE-Brt1, DE-Zwi2, DE-D161, DE-Gla1, DE-Zi4, DE-15, DE-Pl11, DE-Rs1, DE-105, DE-14, DE-Ch1, DE-L229
issn 2194-9034
issn_str_mv 2194-9034
language English
last_indexed 2024-03-01T13:24:05.225Z
match_str kniaz2018deeplearningforlowtexturedimagematching
mega_collection Copernicus GmbH (CrossRef)
physical 513-518
publishDate 2018
publishDateSort 2018
publisher Copernicus GmbH
record_format ai
recordtype ai
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
source_id 49
spelling Kniaz, V. V. Fedorenko, V. V. Fomin, N. A. 2194-9034 Copernicus GmbH General Earth and Planetary Sciences General Environmental Science http://dx.doi.org/10.5194/isprs-archives-xlii-2-513-2018 <jats:p>Abstract. Low-textured objects pose challenges for an automatic 3D model reconstruction. Such objects are common in archeological applications of photogrammetry. Most of the common feature point descriptors fail to match local patches in featureless regions of an object. Hence, automatic documentation of the archeological process using Structure from Motion (SfM) methods is challenging. Nevertheless, such documentation is possible with the aid of a human operator. Deep learning-based descriptors have outperformed most of common feature point descriptors recently. This paper is focused on the development of a new Wide Image Zone Adaptive Robust feature Descriptor (WIZARD) based on the deep learning. We use a convolutional auto-encoder to compress discriminative features of a local path into a descriptor code. We build a codebook to perform point matching on multiple images. The matching is performed using the nearest neighbor search and a modified voting algorithm. We present a new “Multi-view Amphora” (Amphora) dataset for evaluation of point matching algorithms. The dataset includes images of an Ancient Greek vase found at Taman Peninsula in Southern Russia. The dataset provides color images, a ground truth 3D model, and a ground truth optical flow. We evaluated the WIZARD descriptor on the “Amphora” dataset to show that it outperforms the SIFT and SURF descriptors on the complex patch pairs. </jats:p> DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spellingShingle Kniaz, V. V., Fedorenko, V. V., Fomin, N. A., The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING, General Earth and Planetary Sciences, General Environmental Science
title DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_full DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_fullStr DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_full_unstemmed DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_short DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
title_sort deep learning for lowtextured image matching
title_unstemmed DEEP LEARNING FOR LOWTEXTURED IMAGE MATCHING
topic General Earth and Planetary Sciences, General Environmental Science
url http://dx.doi.org/10.5194/isprs-archives-xlii-2-513-2018