Fast implementation of neural network classification

Guiwon Seo, Jiheon Ok, Chul Hee Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Most artificial neural networks use a nonlinear activation function that includes sigmoid and hyperbolic tangent functions. Most artificial networks employ nonlinear functions such as these sigmoid and hyperbolic tangent functions, which incur high complexity costs, particularly during hardware implementation. In this paper, we propose new polynomial approximation methods for nonlinear activation functions that can substantially reduce complexity without sacrificing performance. The proposed approximation methods were applied to pattern classification problems. Experimental results show that the processing time was reduced by up to 50% without any performance degradations in terms of computer simulation.

Original languageEnglish
Title of host publicationSatellite Data Compression, Communications, and Processing IX
PublisherSPIE
Volume8871
ISBN (Print)9780819497215
DOIs
Publication statusPublished - 2013 Jan 1
EventSatellite Data Compression, Communications, and Processing IX - San Diego, CA, United States
Duration: 2013 Aug 262013 Aug 27

Other

OtherSatellite Data Compression, Communications, and Processing IX
CountryUnited States
CitySan Diego, CA
Period13/8/2613/8/27

Fingerprint

Nonlinear Function
Tangent function
Hyperbolic tangent
Hyperbolic functions
Hyperbolic function
Activation Function
Neural Networks
Neural networks
Approximation Methods
Chemical activation
Nonlinear networks
Polynomial approximation
Polynomial Methods
tangents
Pattern Classification
Hardware Implementation
Polynomial Approximation
Classification Problems
Pattern recognition
Artificial Neural Network

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Seo, G., Ok, J., & Lee, C. H. (2013). Fast implementation of neural network classification. In Satellite Data Compression, Communications, and Processing IX (Vol. 8871). [887107] SPIE. https://doi.org/10.1117/12.2026666
Seo, Guiwon ; Ok, Jiheon ; Lee, Chul Hee. / Fast implementation of neural network classification. Satellite Data Compression, Communications, and Processing IX. Vol. 8871 SPIE, 2013.
@inproceedings{a6b3dc2f71e948efa77b0bcb8b75c923,
title = "Fast implementation of neural network classification",
abstract = "Most artificial neural networks use a nonlinear activation function that includes sigmoid and hyperbolic tangent functions. Most artificial networks employ nonlinear functions such as these sigmoid and hyperbolic tangent functions, which incur high complexity costs, particularly during hardware implementation. In this paper, we propose new polynomial approximation methods for nonlinear activation functions that can substantially reduce complexity without sacrificing performance. The proposed approximation methods were applied to pattern classification problems. Experimental results show that the processing time was reduced by up to 50{\%} without any performance degradations in terms of computer simulation.",
author = "Guiwon Seo and Jiheon Ok and Lee, {Chul Hee}",
year = "2013",
month = "1",
day = "1",
doi = "10.1117/12.2026666",
language = "English",
isbn = "9780819497215",
volume = "8871",
booktitle = "Satellite Data Compression, Communications, and Processing IX",
publisher = "SPIE",
address = "United States",

}

Seo, G, Ok, J & Lee, CH 2013, Fast implementation of neural network classification. in Satellite Data Compression, Communications, and Processing IX. vol. 8871, 887107, SPIE, Satellite Data Compression, Communications, and Processing IX, San Diego, CA, United States, 13/8/26. https://doi.org/10.1117/12.2026666

Fast implementation of neural network classification. / Seo, Guiwon; Ok, Jiheon; Lee, Chul Hee.

Satellite Data Compression, Communications, and Processing IX. Vol. 8871 SPIE, 2013. 887107.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Fast implementation of neural network classification

AU - Seo, Guiwon

AU - Ok, Jiheon

AU - Lee, Chul Hee

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Most artificial neural networks use a nonlinear activation function that includes sigmoid and hyperbolic tangent functions. Most artificial networks employ nonlinear functions such as these sigmoid and hyperbolic tangent functions, which incur high complexity costs, particularly during hardware implementation. In this paper, we propose new polynomial approximation methods for nonlinear activation functions that can substantially reduce complexity without sacrificing performance. The proposed approximation methods were applied to pattern classification problems. Experimental results show that the processing time was reduced by up to 50% without any performance degradations in terms of computer simulation.

AB - Most artificial neural networks use a nonlinear activation function that includes sigmoid and hyperbolic tangent functions. Most artificial networks employ nonlinear functions such as these sigmoid and hyperbolic tangent functions, which incur high complexity costs, particularly during hardware implementation. In this paper, we propose new polynomial approximation methods for nonlinear activation functions that can substantially reduce complexity without sacrificing performance. The proposed approximation methods were applied to pattern classification problems. Experimental results show that the processing time was reduced by up to 50% without any performance degradations in terms of computer simulation.

UR - http://www.scopus.com/inward/record.url?scp=84887934901&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887934901&partnerID=8YFLogxK

U2 - 10.1117/12.2026666

DO - 10.1117/12.2026666

M3 - Conference contribution

AN - SCOPUS:84887934901

SN - 9780819497215

VL - 8871

BT - Satellite Data Compression, Communications, and Processing IX

PB - SPIE

ER -

Seo G, Ok J, Lee CH. Fast implementation of neural network classification. In Satellite Data Compression, Communications, and Processing IX. Vol. 8871. SPIE. 2013. 887107 https://doi.org/10.1117/12.2026666