Dynamic Routing Between Capsules STAT946: Difference between revisions
Jump to navigation
Jump to search
Line 29: | Line 29: | ||
\end{align} | \end{align} | ||
== Routing By Agreement == | == Routing By Agreement == | ||
\begin{align} | |||
c_ij = \frac{exp(b_ij)}{\sum_{k}exp(b_ik)} | |||
\end{align} | |||
= Empirical Results = | = Empirical Results = |
Revision as of 20:59, 1 April 2018
Presented by
Yang, Tong(Richard)
Introduction
Hinton's Critiques on CNN
Mathematical Representations
Capsule
\begin{align} s_j = \sum_{i}c_{ij}\hat{u}_{j|i} \end{align}
where
\begin{align} \hat{u}_{j|i} = W_{ij}u_i \end{align}
Two Key Features of Capsule Network
Squashing
\begin{align} v_j = \frac{||s_j||^2}{1+||s_j||^2}\frac{s_j}{||s_j||} \end{align}
Routing By Agreement
\begin{align} c_ij = \frac{exp(b_ij)}{\sum_{k}exp(b_ik)} \end{align}