报告地点：信息楼自动化学院310报告厅
ZOOM（会议ID：983 3576 8192，密码：201127）
报告时间：11月27日（星期五）10:30
报 告 人：谢立华，南洋理工大学教授
报告题目：Efficient Reinforcement Learning-Based Control of Uncertain Nonlinear Systems
内容简介：Reinforcement learning (RL), which inspired by learning behaviour in nature, is a goal-oriented learning strategy wherein the agent learns the policy to optimize a pre-defined reward by interacting with the environment. For being data-driven, effectiveness in reaching optimal behavior, and adaptiveness to uncertain environment, RL has undergone rapid progress in control community. In this talk, we shall first discuss RL based disturbance rejection control for uncertain nonlinear systems with known nominal part. An extended state observer is first designed to estimate the system state and the total uncertainty. Based on the output of the observer, the control compensates for the total uncertainty in real time, and simultaneously, online approximates the optimal policy for the compensated system using a simulation of experience based RL technique. The approach does not require PE condition or probing signals. We further extend the study to systems with unknown nominal part, where a novel concurrent adaptive extended observer is developed to jointly estimate the parameters of the systems and the state, and a simulation of experience based RL is used to approximate the optimal policy.
报告人简介：Lihua Xie received the Ph.D. degree in electrical engineering from the University of Newcastle, Australia, in 1992. He was a faculty with the Department of Automatic Control, Nanjing University of Science and Technology from 1986 to 1989. Since 1992, he has been with the School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, where he is currently a professor and the Director of the Delta-NTU Corporate Laboratory for Cyber-Physical Systems. He served as the Head of Division of Control and Instrumentation from July 2011 to June 2014. His research areas include robust control, networked control, compressive sensing, localization and unmanned systems. He has been listed as a highly cited researcher by Thomson Routers and Clarivate Analytics annually since 2014. He is currently an Editor-in-Chief of Unmanned Systems and Associate Editor of IEEE Transactions on Control of Network Systems. He has served as an Editor of IET Book Series on Control and Associate Editor of IEEE Transactions on Automatic Control, IEEE Transactions on Control Systems Technology, Automatica, IEEE Transactions on Circuits and Systems-II, etc. He was an IEEE Distinguished Lecturer (2011-2014) and an elected member of the Board of Governors of IEEE Control System Society (Jan. 2016- Dec. 2018). He is Fellow of Academy of Engineering Singapore, Fellow of IEEE and Fellow of IFAC.