measuring Statistical Dependence with Hilbert-Schmidt Norm

From statwiki
Revision as of 10:56, 24 June 2009 by Hzarkoob (talk | contribs) (Created page with 'An independence criterion based on covariance operators in reproducing kernel Hilbert spaces (RKHSs) is proposed. Also an empirical estimate of the Hilbert-Schmidt norm of the cr...')
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

An independence criterion based on covariance operators in reproducing kernel Hilbert spaces (RKHSs) is proposed. Also an empirical estimate of the Hilbert-Schmidt norm of the cross-covariance operator, referred to as Hilbert-Schmidt Independence Criterion, or HSIC is given. This can be used as dependence measure in practical application such as independent Component Analysis (ICA), Maximum Variance Unfolding (MVU), feature extraction, feature selection, ... .

RKHS Theory

Hilbert-Schmidt Norm

Hilbert-Schmidt Operator

Tensor Product Operator

Cross-Covariance Operator

Mean

Cross-covariance Operator

Hilbert-Schmidt Independence Criterion

Definition (HSIC)

HSIC in terms of kernels

Empirical Criterion

definition

Bias of Estimator

Large Deviation Bound

Deviation Bound for U0statistics

Bound on Empirical HSIC

Independence Test using HSIC

Experimental Results