Determination of optimal feedback terminal controllers for general boundary conditions using generating functions

Chandeok Park, Daniel J. Scheeres

Research output: Contribution to journalArticle

63 Citations (Scopus)

Abstract

Given a nonlinear system and a performance index to be minimized, we present a general approach to expressing the finite time optimal feedback control law applicable to different types of boundary conditions. Starting from the necessary conditions for optimality represented by a Hamiltonian system, we solve the Hamilton-Jacobi equation for a generating function for a specific canonical transformation. This enables us to obtain the optimal feedback control for fundamentally different sets of boundary conditions only using a series of algebraic manipulations and partial differentiations. Furthermore, the proposed approach reveals an insight that the optimal cost functions for a given dynamical system can be decomposed into a single generating function that is only a function of the dynamics plus a term representing the boundary conditions. This result is formalized as a theorem. The whole procedure provides an advantage over methods rooted in dynamic programming, which require one to solve the Hamilton-Jacobi-Bellman equation repetitively for each type of boundary condition. The cost of this favorable versatility is doubling the dimension of the partial differential equation to be solved.

Original languageEnglish
Pages (from-to)869-875
Number of pages7
JournalAutomatica
Volume42
Issue number5
DOIs
Publication statusPublished - 2006 May 1

Fingerprint

Boundary conditions
Feedback
Controllers
Feedback control
Hamiltonians
Dynamic programming
Cost functions
Partial differential equations
Nonlinear systems
Dynamical systems
Costs

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

@article{eccbd3e2dfb94eb0a5ca7bb2ac94b192,
title = "Determination of optimal feedback terminal controllers for general boundary conditions using generating functions",
abstract = "Given a nonlinear system and a performance index to be minimized, we present a general approach to expressing the finite time optimal feedback control law applicable to different types of boundary conditions. Starting from the necessary conditions for optimality represented by a Hamiltonian system, we solve the Hamilton-Jacobi equation for a generating function for a specific canonical transformation. This enables us to obtain the optimal feedback control for fundamentally different sets of boundary conditions only using a series of algebraic manipulations and partial differentiations. Furthermore, the proposed approach reveals an insight that the optimal cost functions for a given dynamical system can be decomposed into a single generating function that is only a function of the dynamics plus a term representing the boundary conditions. This result is formalized as a theorem. The whole procedure provides an advantage over methods rooted in dynamic programming, which require one to solve the Hamilton-Jacobi-Bellman equation repetitively for each type of boundary condition. The cost of this favorable versatility is doubling the dimension of the partial differential equation to be solved.",
author = "Chandeok Park and Scheeres, {Daniel J.}",
year = "2006",
month = "5",
day = "1",
doi = "10.1016/j.automatica.2006.01.015",
language = "English",
volume = "42",
pages = "869--875",
journal = "Automatica",
issn = "0005-1098",
publisher = "Elsevier Limited",
number = "5",

}

Determination of optimal feedback terminal controllers for general boundary conditions using generating functions. / Park, Chandeok; Scheeres, Daniel J.

In: Automatica, Vol. 42, No. 5, 01.05.2006, p. 869-875.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Determination of optimal feedback terminal controllers for general boundary conditions using generating functions

AU - Park, Chandeok

AU - Scheeres, Daniel J.

PY - 2006/5/1

Y1 - 2006/5/1

N2 - Given a nonlinear system and a performance index to be minimized, we present a general approach to expressing the finite time optimal feedback control law applicable to different types of boundary conditions. Starting from the necessary conditions for optimality represented by a Hamiltonian system, we solve the Hamilton-Jacobi equation for a generating function for a specific canonical transformation. This enables us to obtain the optimal feedback control for fundamentally different sets of boundary conditions only using a series of algebraic manipulations and partial differentiations. Furthermore, the proposed approach reveals an insight that the optimal cost functions for a given dynamical system can be decomposed into a single generating function that is only a function of the dynamics plus a term representing the boundary conditions. This result is formalized as a theorem. The whole procedure provides an advantage over methods rooted in dynamic programming, which require one to solve the Hamilton-Jacobi-Bellman equation repetitively for each type of boundary condition. The cost of this favorable versatility is doubling the dimension of the partial differential equation to be solved.

AB - Given a nonlinear system and a performance index to be minimized, we present a general approach to expressing the finite time optimal feedback control law applicable to different types of boundary conditions. Starting from the necessary conditions for optimality represented by a Hamiltonian system, we solve the Hamilton-Jacobi equation for a generating function for a specific canonical transformation. This enables us to obtain the optimal feedback control for fundamentally different sets of boundary conditions only using a series of algebraic manipulations and partial differentiations. Furthermore, the proposed approach reveals an insight that the optimal cost functions for a given dynamical system can be decomposed into a single generating function that is only a function of the dynamics plus a term representing the boundary conditions. This result is formalized as a theorem. The whole procedure provides an advantage over methods rooted in dynamic programming, which require one to solve the Hamilton-Jacobi-Bellman equation repetitively for each type of boundary condition. The cost of this favorable versatility is doubling the dimension of the partial differential equation to be solved.

UR - http://www.scopus.com/inward/record.url?scp=33645158414&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33645158414&partnerID=8YFLogxK

U2 - 10.1016/j.automatica.2006.01.015

DO - 10.1016/j.automatica.2006.01.015

M3 - Article

AN - SCOPUS:33645158414

VL - 42

SP - 869

EP - 875

JO - Automatica

JF - Automatica

SN - 0005-1098

IS - 5

ER -