Explorized policy iteration for continuous-time linear systems

Tae Yoon Chun, Yoon Ho Choi, Jin Bae Park

Research output: Contribution to journalArticlepeer-review


This paper addresses the problem that policy iteration (PI) for continuous-time (CT) systems requires explorations of the state space which is known as persistency of excitation in adaptive control community, and as a result, proposes a PI scheme explorized by an additional probing signal to solve the addressed problem. The proposed PI method efficiently finds in online fashion the related CT linear quadratic (LQ) optimal control without knowing the system matrix A, and guarantees the stability and convergence to the LQ optimal control, which is proven in this paper in the presence of the probing signal. A design method for the probing signal is also presented to balance the exploration of the state space and the control performance. Finally, several simulation results are provided to verify the effectiveness of the proposed explorized PI method.

Original languageEnglish
Pages (from-to)451-458
Number of pages8
JournalTransactions of the Korean Institute of Electrical Engineers
Issue number3
Publication statusPublished - 2012 Mar

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering


Dive into the research topics of 'Explorized policy iteration for continuous-time linear systems'. Together they form a unique fingerprint.

Cite this