View : 720 Download: 0
Single Image Deraining Using Time-Lapse Data
- Title
- Single Image Deraining Using Time-Lapse Data
- Authors
- Cho, Jaehoon; Kim, Seungryong; Min, Dongbo; Sohn, Kwanghoon
- Ewha Authors
- 민동보
- SCOPUS Author ID
- 민동보
- Issue Date
- 2020
- Journal Title
- IEEE TRANSACTIONS ON IMAGE PROCESSING
- ISSN
- 1057-7149
1941-0042
- Citation
- IEEE TRANSACTIONS ON IMAGE PROCESSING vol. 29, pp. 7274 - 7289
- Keywords
- Rain; Training data; Task analysis; Convolutional neural networks; Rendering (computer graphics); Training; Feature extraction; Single image deraining; convolutional neural networks (CNNs); time-lapse dataset; dynamic fusion module
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Indexed
- SCIE; SCOPUS
- Document Type
- Article
- Abstract
- Leveraging on recent advances in deep convolutional neural networks (CNNs), single image deraining has been studied as a learning task, achieving an outstanding performance over traditional hand-designed approaches. Current CNNs based deraining approaches adopt the supervised learning framework that uses a massive training data generated with synthetic rain streaks, having a limited generalization ability on real rainy images. To address this problem, we propose a novel learning framework for single image deraining that leverages time-lapse sequences instead of the synthetic image pairs. The deraining networks are trained using the time-lapse sequences in which both camera and scenes are static except for time-varying rain streaks. Specifically, we formulate a background consistency loss such that the deraining networks consistently generate the same derained images from the time-lapse sequences. We additionally introduce two loss functions, the structure similarity loss that encourages the derained image to be similar with an input rainy image and the directional gradient loss using the assumption that the estimated rain streaks are likely to be sparse and have dominant directions. To consider various rain conditions, we leverage a dynamic fusion module that effectively fuses multi-scale features. We also build a novel large-scale time-lapse dataset providing real world rainy images containing various rain conditions. Experiments demonstrate that the proposed method outperforms state-of-the-art techniques on synthetic and real rainy images both qualitatively and quantitatively. On the high-level vision tasks under severe rainy conditions, it has been shown that the proposed method can be utilized as a pre-preprocessing step for subsequent tasks.
- DOI
- 10.1109/TIP.2020.3000612
- Appears in Collections:
- 인공지능대학 > 컴퓨터공학과 > Journal papers
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML