...
首页> 外文期刊>Physical Review X >Feynman-Hellmann Theorem and Signal Identification from Sample Covariance Matrices
【24h】

Feynman-Hellmann Theorem and Signal Identification from Sample Covariance Matrices

机译:Feynman-Hellmann定理和样本协方差矩阵的信号识别

获取原文
           

摘要

A common method for extracting true correlations from large data sets is to look for variables with unusually large coefficients on those principal components with the biggest eigenvalues. Here, we show that even if the top principal components have no unusually large coefficients, large coefficients on lower principal components can still correspond to a valid signal. This contradicts the typical mathematical justification for principal component analysis, which requires that eigenvalue distributions from relevant random matrix ensembles have compact support, so that any eigenvalue above the upper threshold corresponds to signal. The new possibility arises via a mechanism based on a variant of the Feynman-Hellmann theorem, and leads to significant correlations between a signal and principal components when the underlying noise is not both independent and uncorrelated, so the eigenvalue spacing of the noise distribution can be sufficiently large. This mechanism justifies a new way of using principal component analysis and rationalizes recent empirical findings that lower principal components can have information about the signal, even if the largest ones do not.
机译:从大型数据集中提取真实相关性的一种常用方法是,在特征值最大的那些主成分上寻找系数异常大的变量。在这里,我们表明,即使顶部主成分没有异常大的系数,较低主成分上的大系数仍然可以对应于有效信号。这与主成分分析的典型数学论证相矛盾,后者要求相关随机矩阵集合的特征值分布具有紧凑的支持,因此任何高于上限阈值的特征值都对应于信号。这种新的可能性是通过基于Feynman-Hellmann定理的一种变体的机制产生的,并且当基础噪声不是既独立又不相关时,导致信号与主成分之间的显着相关,因此噪声分布的特征值间隔可以是足够大。这种机制证明了使用主成分分析的新方法的合理性,并使最近的经验发现合理化,即即使最大的主成分没有,较低的主成分也可以具有有关信号的信息。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号