View : 853 Download: 0
DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation
- Title
- DASC: Robust Dense Descriptor for Multi-Modal and Multi-Spectral Correspondence Estimation
- Authors
- Kim, Seungryong; Min, Dongbo; Ham, Bumsub; Do, Minh N.; Sohn, Kwanghoon
- Ewha Authors
- 민동보
- SCOPUS Author ID
- 민동보
- Issue Date
- 2017
- Journal Title
- IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
- ISSN
- 0162-8828
1939-3539
- Citation
- IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE vol. 39, no. 9, pp. 1712 - 1729
- Keywords
- Dense correspondence; descriptor; multi-spectral; multi-modal; edge-aware filtering
- Publisher
- IEEE COMPUTER SOC
- Indexed
- SCIE; SCOPUS
- Document Type
- Article
- Abstract
- Establishing dense correspondences between multiple images is a fundamental task in many applications. However, finding a reliable correspondence between multi-modal or multi-spectral images still remains unsolved due to their challenging photometric and geometric variations. In this paper, we propose a novel dense descriptor, called dense adaptive self-correlation (DASC), to estimate dense multi-modal and multi-spectral correspondences. Based on an observation that self-similarity existing within images is robust to imaging modality variations, we define the descriptor with a series of an adaptive self-correlation similarity measure between patches sampled by a randomized receptive field pooling, in which a sampling pattern is obtained using a discriminative learning. The computational redundancy of dense descriptors is dramatically reduced by applying fast edge-aware filtering. Furthermore, in order to address geometric variations including scale and rotation, we propose a geometry-invariant DASC (GI-DASC) descriptor that effectively leverages the DASC through a superpixel-based representation. For a quantitative evaluation of the GI-DASC, we build a novel multi-modal benchmark as varying photometric and geometric conditions. Experimental results demonstrate the outstanding performance of the DASC and GI-DASC in many cases of dense multi-modal and multi-spectral correspondences.
- DOI
- 10.1109/TPAMI.2016.2615619
- Appears in Collections:
- 인공지능대학 > 컴퓨터공학과 > Journal papers
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML