Unpaired Cross-Spectral Pedestrian Detection Via Adversarial Feature Learning

Minsu Kim, Sunghun Joung, Kihong Park, Seungryong Kim, Kwanghoon Sohn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Even though there exist significant advances in recent studies, existing methods for pedestrian detection still have shown limited performances under challenging illumination conditions especially at nighttime. To address this, cross-spectral pedestrian detection methods have been presented using color and thermal, and shown substantial performance gains on the challenging circumstances. However, their paired cross-spectral settings have limited applicability in real-world scenarios. To overcome this, we propose a novel learning framework for cross-spectral pedestrian detection in an unpaired setting. Based on an assumption that features from color and thermal images share their characteristics in a common feature space to benefit their complement information, we design the separate feature embedding networks for color and thermal images followed by sharing detection networks. To further improve the cross-spectral feature representation, we apply an adversarial learning scheme to intermediate features of the color and thermal images. Experiments demonstrate the outstanding performance of the proposed method on the KAIST multi-spectral benchmark in comparison to the state-of-the-art methods.

Original languageEnglish
Title of host publication2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
PublisherIEEE Computer Society
Pages1650-1654
Number of pages5
ISBN (Electronic)9781538662496
DOIs
Publication statusPublished - 2019 Sep
Event26th IEEE International Conference on Image Processing, ICIP 2019 - Taipei, Taiwan, Province of China
Duration: 2019 Sep 222019 Sep 25

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2019-September
ISSN (Print)1522-4880

Conference

Conference26th IEEE International Conference on Image Processing, ICIP 2019
CountryTaiwan, Province of China
CityTaipei
Period19/9/2219/9/25

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'Unpaired Cross-Spectral Pedestrian Detection Via Adversarial Feature Learning'. Together they form a unique fingerprint.

  • Cite this

    Kim, M., Joung, S., Park, K., Kim, S., & Sohn, K. (2019). Unpaired Cross-Spectral Pedestrian Detection Via Adversarial Feature Learning. In 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings (pp. 1650-1654). [8803098] (Proceedings - International Conference on Image Processing, ICIP; Vol. 2019-September). IEEE Computer Society. https://doi.org/10.1109/ICIP.2019.8803098