What is the status of the capsule networks?
ML is full with things that supposed to work better (in theory).

Sigmoid function seems better than ReLu.

L1 seems way better than L2.

Spikes neural network seem to be better than standard neural network.

A shallow neural network with a lot of neurons has more parameters than a deep one with the same amount of neurons. So, in theory, has to be more powerful.


Is common to forget the big impact of the training capacity. And easy to get charmed by its theoretical capacity.
Training process are still in diapers. We lack a good understating of it.
Today, Capsules neural network are a very powerful architecture, hard to train.