Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals

Jae Young Lee, Jin Bae Park, Yoon Ho Choi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper proposes a novel policy-iteration-based adaptive optimal scheme for uncertain continuous-time linear systems with excitation signals. The proposed method can solve the related linear quadratic optimal control problem in online fashion exactly and safely. In order to maintain persistence excitation condition, the controller injects the small excitation signals to the system. For this linear system with excitation signals, the policy iteration (PI) technique is investigated to adaptively find the optimal control law in the presence of both internal uncertainties and known excitation signals. For the proposed PI technique, the stability of the closed-loop system and convergence to the optimal solution are mathematically proven. Numerical simulations are carried out to verify the effectiveness of the proposed method.

Original languageEnglish
Title of host publicationICCAS 2010 - International Conference on Control, Automation and Systems
Pages646-651
Number of pages6
Publication statusPublished - 2010 Dec 1
EventInternational Conference on Control, Automation and Systems, ICCAS 2010 - Gyeonggi-do, Korea, Republic of
Duration: 2010 Oct 272010 Oct 30

Other

OtherInternational Conference on Control, Automation and Systems, ICCAS 2010
CountryKorea, Republic of
CityGyeonggi-do
Period10/10/2710/10/30

Fingerprint

Linear systems
Closed loop systems
Controllers
Computer simulation
Uncertainty

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Lee, J. Y., Park, J. B., & Choi, Y. H. (2010). Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals. In ICCAS 2010 - International Conference on Control, Automation and Systems (pp. 646-651). [5670225]
Lee, Jae Young ; Park, Jin Bae ; Choi, Yoon Ho. / Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals. ICCAS 2010 - International Conference on Control, Automation and Systems. 2010. pp. 646-651
@inproceedings{116461b0197d451cb747a71a159be127,
title = "Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals",
abstract = "This paper proposes a novel policy-iteration-based adaptive optimal scheme for uncertain continuous-time linear systems with excitation signals. The proposed method can solve the related linear quadratic optimal control problem in online fashion exactly and safely. In order to maintain persistence excitation condition, the controller injects the small excitation signals to the system. For this linear system with excitation signals, the policy iteration (PI) technique is investigated to adaptively find the optimal control law in the presence of both internal uncertainties and known excitation signals. For the proposed PI technique, the stability of the closed-loop system and convergence to the optimal solution are mathematically proven. Numerical simulations are carried out to verify the effectiveness of the proposed method.",
author = "Lee, {Jae Young} and Park, {Jin Bae} and Choi, {Yoon Ho}",
year = "2010",
month = "12",
day = "1",
language = "English",
isbn = "9781424474530",
pages = "646--651",
booktitle = "ICCAS 2010 - International Conference on Control, Automation and Systems",

}

Lee, JY, Park, JB & Choi, YH 2010, Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals. in ICCAS 2010 - International Conference on Control, Automation and Systems., 5670225, pp. 646-651, International Conference on Control, Automation and Systems, ICCAS 2010, Gyeonggi-do, Korea, Republic of, 10/10/27.

Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals. / Lee, Jae Young; Park, Jin Bae; Choi, Yoon Ho.

ICCAS 2010 - International Conference on Control, Automation and Systems. 2010. p. 646-651 5670225.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals

AU - Lee, Jae Young

AU - Park, Jin Bae

AU - Choi, Yoon Ho

PY - 2010/12/1

Y1 - 2010/12/1

N2 - This paper proposes a novel policy-iteration-based adaptive optimal scheme for uncertain continuous-time linear systems with excitation signals. The proposed method can solve the related linear quadratic optimal control problem in online fashion exactly and safely. In order to maintain persistence excitation condition, the controller injects the small excitation signals to the system. For this linear system with excitation signals, the policy iteration (PI) technique is investigated to adaptively find the optimal control law in the presence of both internal uncertainties and known excitation signals. For the proposed PI technique, the stability of the closed-loop system and convergence to the optimal solution are mathematically proven. Numerical simulations are carried out to verify the effectiveness of the proposed method.

AB - This paper proposes a novel policy-iteration-based adaptive optimal scheme for uncertain continuous-time linear systems with excitation signals. The proposed method can solve the related linear quadratic optimal control problem in online fashion exactly and safely. In order to maintain persistence excitation condition, the controller injects the small excitation signals to the system. For this linear system with excitation signals, the policy iteration (PI) technique is investigated to adaptively find the optimal control law in the presence of both internal uncertainties and known excitation signals. For the proposed PI technique, the stability of the closed-loop system and convergence to the optimal solution are mathematically proven. Numerical simulations are carried out to verify the effectiveness of the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=78751528766&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78751528766&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:78751528766

SN - 9781424474530

SP - 646

EP - 651

BT - ICCAS 2010 - International Conference on Control, Automation and Systems

ER -

Lee JY, Park JB, Choi YH. Policy-iteration-based adaptive optimal control for uncertain continuous-time linear systems with excitation signals. In ICCAS 2010 - International Conference on Control, Automation and Systems. 2010. p. 646-651. 5670225