stat940F24: Difference between revisions
Jump to navigation
Jump to search
No edit summary Tag: Reverted |
|||
| Line 1: | Line 1: | ||
== Regularization in Deep Learning == | <!--== Regularization in Deep Learning == | ||
=== Introduction === | === Introduction === | ||
| Line 1,642: | Line 1,642: | ||
*<math>x*{g}=\sum_{i}\theta_iUT_i(\tilde{\Alpha})U^Tx</math> | *<math>x*{g}=\sum_{i}\theta_iUT_i(\tilde{\Alpha})U^Tx</math> | ||
*<math>x*{g_{\theta}}=U\left(\sum_{i}\theta_iT_i(\tilde{\Alpha})\right)U^Tx</math> | *<math>x*{g_{\theta}}=U\left(\sum_{i}\theta_iT_i(\tilde{\Alpha})\right)U^Tx</math> | ||
*This is equal to: <math>x*{g_{\theta}}=\sum_{i=1}^k{\theta_iT_i(\tilde{L})x}</math>, where <math>\tilde{L}=\frac{2L}{\lambda_{max}}-I_n</math> | *This is equal to: <math>x*{g_{\theta}}=\sum_{i=1}^k{\theta_iT_i(\tilde{L})x}</math>, where <math>\tilde{L}=\frac{2L}{\lambda_{max}}-I_n</math> --> | ||