文章基本信息

标题：Optimal Energy Allocation for Linear Control over a Packet-Dropping Link with Energy Harvesting Constraints ∗
本地全文：下载
作者：Steffi Knorn ; Subhrakanti Dey
期刊名称：IFAC PapersOnLine
印刷版ISSN：2405-8963
出版年度：2015
卷号：48
期号：22
页码：215-220
DOI：10.1016/j.ifacol.2015.10.333
语种：English
出版社：Elsevier
摘要：AbstractA sensor computes a state estimate of a closed loop linear control system. The state estimate is packetized and sent to the controller in the receiver block over a randomly time-varying (fading) packet dropping link. The receiver sends an ACK/NACK packet to the transmitter over a perfect feedback channel. The energy used in packet transmission depletes a battery of limited capacity at the sensor. The battery is replenished by an energy harvester, which has access to a source of everlasting but random harvested energy. Further, the energy harvesting and the fading channel gain processes are described as finite-state Markov chain models. The objective is to design an optimal energy allocation policy at the transmitter and an optimal control policy at the receiver so that an average infinite horizon linear quadratic Gaussian (LQG) control cost is minimised. It is shown that a separation principle holds, the optimal controller is linear, the Kalman filter at the sensor is optimal, and the optimal energy allocation policy at the transmitter can be obtained via solving the Bellman dynamic programming equation to a Markov decision process based stochastic control problem. A Q-learning algorithm is used to approximate the optimal energy allocation policy. Numerical simulations illustrate that the dynamic programming based policies outperform the simple heuristic policies.
关键词：KeywordsKalman filtering (KF)energy harvestingoptimal controlenergy allocation