文章基本信息

标题：Relational Reinforcement Learning with Continuous Actions by Combining Behavioural Cloning and Locally Weighted Regression
本地全文：下载
作者：Julio H. Zaragoza ; Eduardo F. Morales
期刊名称：Journal of Intelligent Learning Systems and Applications
印刷版ISSN：2150-8402
电子版ISSN：2150-8410
出版年度：2010
卷号：2
期号：2
页码：69-79
DOI：10.4236/jilsa.2010.22010
出版社：Scientific Research Publishing
摘要：Reinforcement Learning is a commonly used technique for learning tasks in robotics, however, traditional algorithms are unable to handle large amounts of data coming from the robot’s sensors, require long training times, and use dis-crete actions. This work introduces TS-RRLCA, a two stage method to tackle these problems. In the first stage, low-level data coming from the robot’s sensors is transformed into a more natural, relational representation based on rooms, walls, corners, doors and obstacles, significantly reducing the state space. We use this representation along with Behavioural Cloning, i.e., traces provided by the user; to learn, in few iterations, a relational control policy with discrete actions which can be re-used in different environments. In the second stage, we use Locally Weighted Regression to transform the initial policy into a continuous actions policy. We tested our approach in simulation and with a real service robot on different environments for different navigation and following tasks. Results show how the policies can be used on different domains and perform smoother, faster and shorter paths than the original discrete actions policies.
关键词：Relational Reinforcement Learning; Behavioural Cloning; Continuous Actions; Robotics