文章基本信息

标题：Investigation of Alternative Measures for Mutual Information
本地全文：下载
作者：Bulut Kuskonmaz ; Jaron S. Gundersen ; Rafal Wisniewski 等
期刊名称：IFAC PapersOnLine
印刷版ISSN：2405-8963
出版年度：2022
卷号：55
期号：16
页码：154-159
DOI：10.1016/j.ifacol.2022.09.016
语种：English
出版社：Elsevier
摘要：AbstractMutual informationI(X;Y)is a useful definition in information theory to estimate how much information the random variableYholds about the random variableX.One way to define the mutual information is by comparing the joint distribution ofXandYwith the product of the marginals through the Kullback-Leibler (KL) divergence. If the two distributions are close to each other there will be almost no leakage ofXfromYsince the two variables are close to being independent. In the discrete setting the mutual information has the nice interpretation of how many bitsYreveals aboutX.However, in the continuous case we do not have the same reasoning. This fact enables us to try different metrics or divergences to define the mutual information. In this paper, we are evaluating different metrics and divergences to form alternatives to the mutual information in the continuous case. We deploy different methods to estimate or bound these metrics and divergences and evaluate their performances.