Decision boundary formation of deep convolution networks with relu

Seongyoun Woo, Chulhee Lee Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Although deep convolution networks have been successfully applied to many applications, their working mechanisms have been barely understood. In this paper, we investigate the decision boundary formation of convolution neural networks that use the ReLU function. Due to the non-linearity of ReLU, the convolution neural networks can be viewed as a non-linear transformation. However, the decision boundary in the original input space will be always locally linear, which may produce undesirable decision boundaries. We also present some examples that show interesting properties of decision boundary of convolution neural networks with ReLU.

Original languageEnglish
Title of host publicationProceedings - IEEE 16th International Conference on Dependable, Autonomic and Secure Computing, IEEE 16th International Conference on Pervasive Intelligence and Computing, IEEE 4th International Conference on Big Data Intelligence and Computing and IEEE 3rd Cyber Science and Technology Congress, DASC-PICom-DataCom-CyberSciTec 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages881-884
Number of pages4
ISBN (Electronic)9781538675182
DOIs
Publication statusPublished - 2018 Oct 26
Event16th IEEE International Conference on Dependable, Autonomic and Secure Computing, IEEE 16th International Conference on Pervasive Intelligence and Computing, IEEE 4th International Conference on Big Data Intelligence and Computing and IEEE 3rd Cyber Science and Technology Congress, DASC-PICom-DataCom-CyberSciTec 2018 - Athens, Greece
Duration: 2018 Aug 122018 Aug 15

Publication series

NameProceedings - IEEE 16th International Conference on Dependable, Autonomic and Secure Computing, IEEE 16th International Conference on Pervasive Intelligence and Computing, IEEE 4th International Conference on Big Data Intelligence and Computing and IEEE 3rd Cyber Science and Technology Congress, DASC-PICom-DataCom-CyberSciTec 2018

Conference

Conference16th IEEE International Conference on Dependable, Autonomic and Secure Computing, IEEE 16th International Conference on Pervasive Intelligence and Computing, IEEE 4th International Conference on Big Data Intelligence and Computing and IEEE 3rd Cyber Science and Technology Congress, DASC-PICom-DataCom-CyberSciTec 2018
CountryGreece
CityAthens
Period18/8/1218/8/15

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Information Systems
  • Artificial Intelligence
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Control and Optimization

Fingerprint Dive into the research topics of 'Decision boundary formation of deep convolution networks with relu'. Together they form a unique fingerprint.

Cite this