文章基本信息

标题：Adaptive actor-critic structure for parametrized controllers
本地全文：下载
作者：Thomas Göhrt ; Pavel Osinenko ; Stefan Streif 等
期刊名称：IFAC PapersOnLine
印刷版ISSN：2405-8963
出版年度：2019
卷号：52
期号：16
页码：652-657
DOI：10.1016/j.ifacol.2019.12.036
语种：English
出版社：Elsevier
摘要：Given a parametrized stabilizing controller, the approach presented in this work seeks to find optimal parameters with respect to an infinite-horizon cost. Since the latter is in general not computable, it is suggested to apply an adaptive actor-critic structure to approximate the respective value function. The actor is realized explicitly using the projected subgradient method. A particular challenge arises from the fact that the approximated value function is time-varying depending on the evolution of the dynamical system and critic’s approximation of the value function. Provided that a certain stability constraint is convex and under persistence of excitation conditions, it is shown that the actor and critic parameters converge to prescribed vicinities of the optimal values. The whole setup is done in continuous time. A computational study is presented.
关键词：KeywordsNonlinear controladaptive controloptimal controloptimization algorithms