Comparisons of continuous-time and discrete-time Q-learning schemes for adaptive linear quadratic control

Tae Yoon Chun, Jae Young Lee, Jin Bae Park, Yoon Ho Choi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we compare two online model-free Q-learning schemes for adaptive linear quadratic (LQ) control of discrete-time (DT) and continuous-time (CT) dynamical systems. Both Q-learning schemes come from the optimality principles, but the DT and CT g-learning is designed with different β-functions. This difference may results in the different exploration properties and convergence speeds. Numerical simulations with an ideal DC motor are carried out to further investigate and compare the Q-learning methods.

Original languageEnglish
Title of host publication2012 Proceedings of SICE Annual Conference, SICE 2012
PublisherSociety of Instrument and Control Engineers (SICE)
Pages1228-1233
Number of pages6
ISBN (Print)9781467322591
Publication statusPublished - 2012
Event2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012 - Akita, Japan
Duration: 2012 Aug 202012 Aug 23

Publication series

NameProceedings of the SICE Annual Conference

Other

Other2012 51st Annual Conference on of the Society of Instrument and Control Engineers of Japan, SICE 2012
CountryJapan
CityAkita
Period12/8/2012/8/23

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Comparisons of continuous-time and discrete-time Q-learning schemes for adaptive linear quadratic control'. Together they form a unique fingerprint.

  • Cite this

    Chun, T. Y., Lee, J. Y., Park, J. B., & Choi, Y. H. (2012). Comparisons of continuous-time and discrete-time Q-learning schemes for adaptive linear quadratic control. In 2012 Proceedings of SICE Annual Conference, SICE 2012 (pp. 1228-1233). [6318633] (Proceedings of the SICE Annual Conference). Society of Instrument and Control Engineers (SICE).