首页> 外文期刊>Information Theory, IEEE Transactions on >On the Interplay Between Conditional Entropy and Error Probability
【24h】

On the Interplay Between Conditional Entropy and Error Probability

机译:条件熵与错误概率之间的相互作用

获取原文
获取原文并翻译 | 示例
           

摘要

Fano's inequality relates the error probability of guessing a finitely-valued random variable $X$ given another random variable $Y$ and the conditional entropy of $X$ given $Y$ . It is not necessarily tight when the marginal distribution of $X$ is fixed. This paper gives a tight upper bound on the conditional entropy of $X$ given $Y$ in terms of the error probability and the marginal distribution of $X$ . A new lower bound on the conditional entropy for countably infinite alphabets is also found. The relationship between the reliability criteria of vanishing error probability and vanishing conditional entropy is also discussed. A strengthened form of the Schur-concavity of entropy which holds for finite or countably infinite random variables is given.
机译:Fano不等式与给定另一个随机变量$ Y $时猜测有限值随机变量$ X $的错误概率和给定$ Y $的条件熵$ X $有关。当$ X $的边际分布固定时,它不一定紧。本文给出了$ X $给定$ Y $的条件熵的严格上限,该误差的概率是$ X $的边际分布。还发现了无数无限字母的条件熵的新下界。还讨论了消失错误概率的可靠性准则与消失的条件熵之间的关系。给出了熵的舒尔凹度的一种增强形式,该形式适用于有限或可计数的无限随机变量。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号