Solutions to the inverse LQR problem with application to biological systems analysis

M. Cody Priess, Richard Conway, Jongeun Choi, John M. Popovich, Clark Radcliffe

Research output: Contribution to journalArticle

43 Citations (Scopus)

Abstract

In this brief, we present a set of techniques for finding a cost function to the time-invariant linear quadratic regulator (LQR) problem in both continuous- and discrete-time cases. Our methodology is based on the solution to the inverse LQR problem, which can be stated as: does a given controller K describe the solution to a time-invariant LQR problem, and if so, what weights Q and R produce K as the optimal solution? Our motivation for investigating this problem is the analysis of motion goals in biological systems. We first describe an efficient linear matrix inequality (LMI) method for determining a solution to the general case of this inverse LQR problem when both the weighting matrices Q and R are unknown. Our first LMI-based formulation provides a unique solution when it is feasible. In addition, we propose a gradient-based, least-squares minimization method that can be applied to approximate a solution in cases when the LMIs are infeasible. This new method is very useful in practice since the estimated gain matrix K from the noisy experimental data could be perturbed by the estimation error, which may result in the infeasibility of the LMIs. We also provide an LMI minimization problem to find a good initial point for the minimization using the proposed gradient descent algorithm. We then provide a set of examples to illustrate how to apply our approaches to several different types of problems. An important result is the application of the technique to human subject posture control when seated on a moving robot. Results show that we can recover a cost function which may provide a useful insight on the human motor control goal.

Original languageEnglish
Article number6880317
Pages (from-to)770-777
Number of pages8
JournalIEEE Transactions on Control Systems Technology
Volume23
Issue number2
DOIs
Publication statusPublished - 2015 Mar 1

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Solutions to the inverse LQR problem with application to biological systems analysis'. Together they form a unique fingerprint.

  • Cite this