文章基本信息

标题：Parameter Optimal Iterative Learning Control Design: from Model-based, Data-driven to Reinforcement Learning
本地全文：下载
作者：Yueqing Zhang ; Bing Chu ; Zhan Shu 等
期刊名称：IFAC PapersOnLine
印刷版ISSN：2405-8963
出版年度：2022
卷号：55
期号：12
页码：494-499
DOI：10.1016/j.ifacol.2022.07.360
语种：English
出版社：Elsevier
摘要：AbstractIterative learning control (ILC) is a high-performance control design method for systems operating in a repetitive fashion by learning from past experience. Our recent work shows that reinforcement learning (RL) shares many features with ILC and thus opens the door to new ILC algorithm designs. This paper continues the research by considering a parameter optimal iterative learning control (POILC) algorithm. It has a very simple structure and appealing convergence properties, but requires a model of the system. We first develop a data-driven POILC algorithm without using model information by performing an extra experiment on the plant. We then use a policy gradient RL algorithm to design a new model-free POILC algorithm. Both algorithms achieve the high-performance control target without using model information, but the convergence properties do differ. In particular, by increasing the number of function approximators in the latter, the RL-based model-free ILC can approach the performance of the model-based POILC. A numerical study is presented to compare the performance of different approaches and demonstrate the effectiveness of the proposed designs.
关键词：KeywordsIterative learning controlreinforcement learning controldata-based control