TY - JOUR
T1 - An online fault tolerant actor-critic neuro-control for a class of nonlinear systems using neural network HJB approach
AU - Chang, Seung Jin
AU - Lee, Jae Young
AU - Park, Jin Bae
AU - Choi, Yoon Ho
N1 - Publisher Copyright:
© 2015, Institute of Control, Robotics and Systems and The Korean Institute of Electrical Engineers and Springer-Verlag Berlin Heidelberg.
Copyright:
Copyright 2016 Elsevier B.V., All rights reserved.
PY - 2015/4/1
Y1 - 2015/4/1
N2 - In this paper, we propose an actor-critic neuro-control for a class of continuous-time nonlinear systems under nonlinear abrupt faults, which is combined with an adaptive fault diagnosis observer (AFDO). Together with its estimation laws, an AFDO scheme, which estimates the faults in real time, is designed based on Lyapunov analysis. Then, based on the designed AFDO, a fault tolerant actor- critic control scheme is proposed where the critic neural network (NN) is used to approximate the value function and the actor NN updates the fault tolerant policy based on the approximated value function in the critic NN. The weight update laws for critic NN and actor NN are designed using the gradient descent method. By Lyapunov analysis, we prove the uniform ultimately boundedness (UUB) of all the states, their estimation errors, and NN weights of the fault tolerant system under the unpredictable faults. Finally, we verify the effectiveness of the proposed method through numerical simulations.
AB - In this paper, we propose an actor-critic neuro-control for a class of continuous-time nonlinear systems under nonlinear abrupt faults, which is combined with an adaptive fault diagnosis observer (AFDO). Together with its estimation laws, an AFDO scheme, which estimates the faults in real time, is designed based on Lyapunov analysis. Then, based on the designed AFDO, a fault tolerant actor- critic control scheme is proposed where the critic neural network (NN) is used to approximate the value function and the actor NN updates the fault tolerant policy based on the approximated value function in the critic NN. The weight update laws for critic NN and actor NN are designed using the gradient descent method. By Lyapunov analysis, we prove the uniform ultimately boundedness (UUB) of all the states, their estimation errors, and NN weights of the fault tolerant system under the unpredictable faults. Finally, we verify the effectiveness of the proposed method through numerical simulations.
UR - http://www.scopus.com/inward/record.url?scp=84939978194&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84939978194&partnerID=8YFLogxK
U2 - 10.1007/s12555-014-0034-3
DO - 10.1007/s12555-014-0034-3
M3 - Article
AN - SCOPUS:84939978194
VL - 13
SP - 311
EP - 318
JO - International Journal of Control, Automation and Systems
JF - International Journal of Control, Automation and Systems
SN - 1598-6446
IS - 2
ER -