文章基本信息

标题：A divided and prioritized experience replay approach for streaming regression
本地全文：下载
作者：Mikkel Leite Arnø ; John-Morten Godhavn ; Ole Morten Aamo 等
期刊名称：MethodsX
印刷版ISSN：2215-0161
电子版ISSN：2215-0161
出版年度：2021
卷号：8
页码：1-14
DOI：10.1016/j.mex.2021.101571
语种：English
出版社：Elsevier
摘要：Graphical abstractDisplay OmittedAbstractIn the streaming learning setting, an agent is presented with a data stream on which to learn from in an online fashion. A common problem is catastrophic forgetting of old knowledge due to updates to the model. Mitigating catastrophic forgetting has received a lot of attention, and a variety of methods exist to solve this problem. In this paper, we present a divided and prioritized experience replay approach for streaming regression, in which relevant observations are retained in the replay, and extra focus is added to poorly estimated observations through prioritization. Using a real-world dataset, the method is compared to the standard sliding window approach. A statistical power analysis is performed, showing how our approach improves performance on rare, important events at a trade-off in performance for more common observations. Close inspections of the dataset are provided, with emphasis on areas where the standard approach fails. A rephrasing of the problem to a binary classification problem is performed to separate common and rare, important events. These results provide an added perspective regarding the improvement made on rare events.•We divide the prediction space in a streaming regression setting•Observations in the experience replay are prioritized for further training by the model’s current error
关键词：Streaming regression;Catastrophic forgetting;Nonstationarity