Deep Learning

From Lecun: Deep Learning est mort. Vive Differentiable Programming! It’s really very much like a regular progam, except it’s parameterized, automatically differentiated, and trainable/optimizable.

optimizors

http://ruder.io/optimizing-gradient-descent/