文章基本信息

标题：Compositional Construction of Finite MDPs for Large-Scale Stochastic Switched Systems: A Dissipativity Approach
本地全文：下载
作者：Abolfazl Lavaei ; Majid Zamani
期刊名称：IFAC PapersOnLine
印刷版ISSN：2405-8963
出版年度：2019
卷号：52
期号：3
页码：31-36
DOI：10.1016/j.ifacol.2019.06.006
语种：English
出版社：Elsevier
摘要：AbstractIn this paper, we provide a compositional technique for constructing finite abstractions (a.k.a. finite Markov decision processes) for networks of discrete-time stochastic switched systems. The proposed framework is based on the notion ofstochastic simulation functions,using which one can employ a finite MDP as a substitution of the original one in the controller design process with guaranteed error bounds on their output trajectories. In this respect, we first leverage dissipativity-type compositional conditions for quantifying the error between the interconnection of stochastic switched subsystems and that of their finite abstractions. We then propose an approach to construct finite MDPs together with their corresponding stochastic simulation functions for a particular class ofnonlinearstochastic switched systems. To demonstrate the effectiveness of our proposed results, we apply our approaches to two different case studies.
关键词：KeywordsLarge-Scale Stochastic Switched SystemsFinite Markov Decision ProcessesMultiple Storage FunctionsDwell-TimeDissipativity ReasoningCompositionality