Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems

Jae Young Lee, Jin Bae Park, Yoon Ho Choi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, a model-free approximate dynamic programming (ADP) technique for continuous-time linear systems is proposed to solve the infinite horizon optimal regulator problems with input derivative constraints. By the fact that the input coupling matrix B is not shown in the explicit formula of the solution to the input-derivative-constrained optimal regulator problem, the assumption of the known B matrix is relaxed. And then, partially model-free ADP technique given in [13] is employed to this regulator problem in order to develop the modelfree approximate dynamic programming technique. Moreover, using the inherent property of the input-derivative-constrained optimal regulator problem, we extend the proposed model-free ADP technique to the more general linear systems which include constant matching disturbances. The proposed technique can be considered an adaptive optimal controller since it updates the parameters in the controller in a way that the parameters converge to the optimal ones. The simulation is executed to verify the applicability of the proposed method.

Original languageEnglish
Title of host publicationProceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics
Pages1148-1153
Number of pages6
DOIs
Publication statusPublished - 2009 Dec 1
EventIEEE International Symposium on Industrial Electronics, IEEE ISIE 2009 - Seoul, Korea, Republic of
Duration: 2009 Jul 52009 Jul 8

Other

OtherIEEE International Symposium on Industrial Electronics, IEEE ISIE 2009
CountryKorea, Republic of
CitySeoul
Period09/7/509/7/8

Fingerprint

Dynamic programming
Linear systems
Derivatives
Controllers

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering
  • Control and Systems Engineering

Cite this

Lee, J. Y., Park, J. B., & Choi, Y. H. (2009). Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems. In Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics (pp. 1148-1153). [5218330] https://doi.org/10.1109/ISIE.2009.5218330
Lee, Jae Young ; Park, Jin Bae ; Choi, Yoon Ho. / Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems. Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics. 2009. pp. 1148-1153
@inproceedings{2b433c4c047141b4810fed5e4041d869,
title = "Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems",
abstract = "In this paper, a model-free approximate dynamic programming (ADP) technique for continuous-time linear systems is proposed to solve the infinite horizon optimal regulator problems with input derivative constraints. By the fact that the input coupling matrix B is not shown in the explicit formula of the solution to the input-derivative-constrained optimal regulator problem, the assumption of the known B matrix is relaxed. And then, partially model-free ADP technique given in [13] is employed to this regulator problem in order to develop the modelfree approximate dynamic programming technique. Moreover, using the inherent property of the input-derivative-constrained optimal regulator problem, we extend the proposed model-free ADP technique to the more general linear systems which include constant matching disturbances. The proposed technique can be considered an adaptive optimal controller since it updates the parameters in the controller in a way that the parameters converge to the optimal ones. The simulation is executed to verify the applicability of the proposed method.",
author = "Lee, {Jae Young} and Park, {Jin Bae} and Choi, {Yoon Ho}",
year = "2009",
month = "12",
day = "1",
doi = "10.1109/ISIE.2009.5218330",
language = "English",
isbn = "9781424443499",
pages = "1148--1153",
booktitle = "Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics",

}

Lee, JY, Park, JB & Choi, YH 2009, Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems. in Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics., 5218330, pp. 1148-1153, IEEE International Symposium on Industrial Electronics, IEEE ISIE 2009, Seoul, Korea, Republic of, 09/7/5. https://doi.org/10.1109/ISIE.2009.5218330

Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems. / Lee, Jae Young; Park, Jin Bae; Choi, Yoon Ho.

Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics. 2009. p. 1148-1153 5218330.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems

AU - Lee, Jae Young

AU - Park, Jin Bae

AU - Choi, Yoon Ho

PY - 2009/12/1

Y1 - 2009/12/1

N2 - In this paper, a model-free approximate dynamic programming (ADP) technique for continuous-time linear systems is proposed to solve the infinite horizon optimal regulator problems with input derivative constraints. By the fact that the input coupling matrix B is not shown in the explicit formula of the solution to the input-derivative-constrained optimal regulator problem, the assumption of the known B matrix is relaxed. And then, partially model-free ADP technique given in [13] is employed to this regulator problem in order to develop the modelfree approximate dynamic programming technique. Moreover, using the inherent property of the input-derivative-constrained optimal regulator problem, we extend the proposed model-free ADP technique to the more general linear systems which include constant matching disturbances. The proposed technique can be considered an adaptive optimal controller since it updates the parameters in the controller in a way that the parameters converge to the optimal ones. The simulation is executed to verify the applicability of the proposed method.

AB - In this paper, a model-free approximate dynamic programming (ADP) technique for continuous-time linear systems is proposed to solve the infinite horizon optimal regulator problems with input derivative constraints. By the fact that the input coupling matrix B is not shown in the explicit formula of the solution to the input-derivative-constrained optimal regulator problem, the assumption of the known B matrix is relaxed. And then, partially model-free ADP technique given in [13] is employed to this regulator problem in order to develop the modelfree approximate dynamic programming technique. Moreover, using the inherent property of the input-derivative-constrained optimal regulator problem, we extend the proposed model-free ADP technique to the more general linear systems which include constant matching disturbances. The proposed technique can be considered an adaptive optimal controller since it updates the parameters in the controller in a way that the parameters converge to the optimal ones. The simulation is executed to verify the applicability of the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=77950135314&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77950135314&partnerID=8YFLogxK

U2 - 10.1109/ISIE.2009.5218330

DO - 10.1109/ISIE.2009.5218330

M3 - Conference contribution

AN - SCOPUS:77950135314

SN - 9781424443499

SP - 1148

EP - 1153

BT - Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics

ER -

Lee JY, Park JB, Choi YH. Input-derivative-constrained approximate dynamic programming for unknown continuous-time linear systems. In Proceedings - IEEE ISIE 2009, IEEE International Symposium on Industrial Electronics. 2009. p. 1148-1153. 5218330 https://doi.org/10.1109/ISIE.2009.5218330