Lecture 6 | Convergence, Loss Surfaces, and Optimization

Carnegie Mellon University Course: 11-785, Intro to Deep Learning Offering: Fall 2019 For more information, please visit: http://deeplearning.cs.cmu.edu/ Contents: • Convergence in neural networks • Rates of convergence • Loss surfaces • Learning rates, and optimization methods • RMSProp, Adagrad, Momentum