Action-dependent updated terminal cost receding horizon control for discrete-time linear systems

Mi Youn Moon, Jae Young Lee, Jin Bae Park, Yoon Ho Choi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In case of linear quadratic regulator (LQR), the updated terminal cost receding horizon control (UTC-RHC) enhances the standard RHC in terms of the stability and the convergence to the optimal solution. Based on the action-dependent (AD) value functions, known as Q-function, this paper proposes two modified RHC methods, AD-RHC and AD-UTC-RHC and proves the stability and convergence by using the matrix equivalence of the established control schemes. Additionally, in case of the horizon size N = 1, as like UTC-RHC is connected with heuristic dynamic programming (HDP), we shows the connection between the AD-UTC-RHC and ADHDP which has the learning abilities of the optimal solution without using the explicit descriptions of the system dynamics.

Original languageEnglish
Title of host publicationICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems
Pages896-901
Number of pages6
Publication statusPublished - 2012 Dec 1
Event2012 12th International Conference on Control, Automation and Systems, ICCAS 2012 - Jeju, Korea, Republic of
Duration: 2012 Oct 172012 Oct 21

Publication series

NameInternational Conference on Control, Automation and Systems
ISSN (Print)1598-7833

Other

Other2012 12th International Conference on Control, Automation and Systems, ICCAS 2012
CountryKorea, Republic of
CityJeju
Period12/10/1712/10/21

Fingerprint

Linear systems
Costs
Dynamic programming
Dynamical systems

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Moon, M. Y., Lee, J. Y., Park, J. B., & Choi, Y. H. (2012). Action-dependent updated terminal cost receding horizon control for discrete-time linear systems. In ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems (pp. 896-901). [6393350] (International Conference on Control, Automation and Systems).
Moon, Mi Youn ; Lee, Jae Young ; Park, Jin Bae ; Choi, Yoon Ho. / Action-dependent updated terminal cost receding horizon control for discrete-time linear systems. ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems. 2012. pp. 896-901 (International Conference on Control, Automation and Systems).
@inproceedings{7bf8a83f40764919814f4c80c67c2dc8,
title = "Action-dependent updated terminal cost receding horizon control for discrete-time linear systems",
abstract = "In case of linear quadratic regulator (LQR), the updated terminal cost receding horizon control (UTC-RHC) enhances the standard RHC in terms of the stability and the convergence to the optimal solution. Based on the action-dependent (AD) value functions, known as Q-function, this paper proposes two modified RHC methods, AD-RHC and AD-UTC-RHC and proves the stability and convergence by using the matrix equivalence of the established control schemes. Additionally, in case of the horizon size N = 1, as like UTC-RHC is connected with heuristic dynamic programming (HDP), we shows the connection between the AD-UTC-RHC and ADHDP which has the learning abilities of the optimal solution without using the explicit descriptions of the system dynamics.",
author = "Moon, {Mi Youn} and Lee, {Jae Young} and Park, {Jin Bae} and Choi, {Yoon Ho}",
year = "2012",
month = "12",
day = "1",
language = "English",
isbn = "9781467322478",
series = "International Conference on Control, Automation and Systems",
pages = "896--901",
booktitle = "ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems",

}

Moon, MY, Lee, JY, Park, JB & Choi, YH 2012, Action-dependent updated terminal cost receding horizon control for discrete-time linear systems. in ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems., 6393350, International Conference on Control, Automation and Systems, pp. 896-901, 2012 12th International Conference on Control, Automation and Systems, ICCAS 2012, Jeju, Korea, Republic of, 12/10/17.

Action-dependent updated terminal cost receding horizon control for discrete-time linear systems. / Moon, Mi Youn; Lee, Jae Young; Park, Jin Bae; Choi, Yoon Ho.

ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems. 2012. p. 896-901 6393350 (International Conference on Control, Automation and Systems).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Action-dependent updated terminal cost receding horizon control for discrete-time linear systems

AU - Moon, Mi Youn

AU - Lee, Jae Young

AU - Park, Jin Bae

AU - Choi, Yoon Ho

PY - 2012/12/1

Y1 - 2012/12/1

N2 - In case of linear quadratic regulator (LQR), the updated terminal cost receding horizon control (UTC-RHC) enhances the standard RHC in terms of the stability and the convergence to the optimal solution. Based on the action-dependent (AD) value functions, known as Q-function, this paper proposes two modified RHC methods, AD-RHC and AD-UTC-RHC and proves the stability and convergence by using the matrix equivalence of the established control schemes. Additionally, in case of the horizon size N = 1, as like UTC-RHC is connected with heuristic dynamic programming (HDP), we shows the connection between the AD-UTC-RHC and ADHDP which has the learning abilities of the optimal solution without using the explicit descriptions of the system dynamics.

AB - In case of linear quadratic regulator (LQR), the updated terminal cost receding horizon control (UTC-RHC) enhances the standard RHC in terms of the stability and the convergence to the optimal solution. Based on the action-dependent (AD) value functions, known as Q-function, this paper proposes two modified RHC methods, AD-RHC and AD-UTC-RHC and proves the stability and convergence by using the matrix equivalence of the established control schemes. Additionally, in case of the horizon size N = 1, as like UTC-RHC is connected with heuristic dynamic programming (HDP), we shows the connection between the AD-UTC-RHC and ADHDP which has the learning abilities of the optimal solution without using the explicit descriptions of the system dynamics.

UR - http://www.scopus.com/inward/record.url?scp=84872569144&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872569144&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84872569144

SN - 9781467322478

T3 - International Conference on Control, Automation and Systems

SP - 896

EP - 901

BT - ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems

ER -

Moon MY, Lee JY, Park JB, Choi YH. Action-dependent updated terminal cost receding horizon control for discrete-time linear systems. In ICCAS 2012 - 2012 12th International Conference on Control, Automation and Systems. 2012. p. 896-901. 6393350. (International Conference on Control, Automation and Systems).