首页> 外文会议>IEEE International Symposium on Information Theory >A Measure of Synergy, Redundancy, and Unique Information using Information Geometry
【24h】

A Measure of Synergy, Redundancy, and Unique Information using Information Geometry

机译:使用信息几何来衡量协同,冗余和唯一信息

获取原文

摘要

It is well known that joint interactions between agents can be described qualitatively as having synergistic, unique, and redundant components. In recent years, there have been renewed efforts to decompose mutual information, a general, non-parametric measure of joint interactions, into constituent parts. We propose a novel, non-negative decomposition of mutual information between two sources and a target variable. The decomposition is for the exponential family, and thus can be applied to a broad range of distributions. We also show that values from our decomposition arise naturally from testing hypotheses of conditional dependence. We demonstrate the method numerically using standard binary logic gates and Gaussian channels, as well as apply the method to investigate redundancy between brain regions using an fMRI-based image classification data-set.
机译:众所周知,可以将代理之间的联合交互定性地描述为具有协同,独特和冗余的组件。近年来,人们做出了新的努力将共同信息分解为组成部分,共同信息是一种通用的,非参数化的联合相互作用的方法。我们提出了一种新颖的,非负的,两个源和一个目标变量之间的互信息分解的方法。分解是针对指数族的,因此可以应用于广泛的分布。我们还表明,分解条件得到的值自然来自于对条件依赖假设的检验。我们使用标准的二进制逻辑门和高斯通道以数值方式演示了该方法,并使用基于fMRI的图像分类数据集将该方法应用于研究大脑区域之间的冗余。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号