Suspension Control Strategies Using Switched Soft Actor-Critic Models for Real Roads

Hwanmoo Yong, Joohwan Seo, Jaeyoung Kim, Myounghoe Kim, Jongeun Choi

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


In this article, we propose learning and control strategies for a semiactive suspension system in a full car using soft actor-critic (SAC) models on real roads, where many road profiles with various power of disturbance exist (e.g., speed bumps and general roads). Therefore, a technique that enables deep reinforcement learning to cover different domains with largely different reward functions is proposed. This concept was first realized in a simulation environment. Our proposed switching learning system continuously identifies two different road disturbance profiles in real time such that the appropriately designed SAC model can be learned and applied accordingly. The results of the proposed switching SAC algorithm were compared against those of advanced and conventional benchmark suspension systems. Based on the results, the proposed algorithm showed smaller root-mean-square values of the z-directional acceleration and pitch at the center of the body mass. Finally, we also presented our successfully implemented SAC training system in a real car on real roads. The trained SAC model outperforms conventional controllers reducing the z-directional acceleration and pitch, similar to the simulation results, which is highly related to the riding comfort and vehicle maneuverability.

Original languageEnglish
Pages (from-to)824-832
Number of pages9
JournalIEEE Transactions on Industrial Electronics
Issue number1
Publication statusPublished - 2023 Jan 1

Bibliographical note

Publisher Copyright:
© 1982-2012 IEEE.

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering
  • Electrical and Electronic Engineering


Dive into the research topics of 'Suspension Control Strategies Using Switched Soft Actor-Critic Models for Real Roads'. Together they form a unique fingerprint.

Cite this