zhuwei3014的个人博客分享 http://blog.sciencenet.cn/u/zhuwei3014

博文

Coursera: Neural Networks for ML- Lecture 6

已有 3853 次阅读 2014-7-25 16:22 |个人分类:Coursera: Neural Networks|系统分类:科研笔记| 神经网络, coursera, Hinton

Overview of mini-batch gradient descent & tricks


ICML_2013_On the importance of initialization and momentum in deep learning
2012_No more pesky learning rates

1. Mini-batch gradient descent
2. A bag of tricks
3. The momentum method
4. A separate, adaptive learning rate for each connection
5. Rmsprop





https://blog.sciencenet.cn/blog-1583812-814649.html

上一篇:Coursera: Neural Networks for ML- Lecture 5
下一篇:Coursera: Neural Networks for ML- Lecture 7
收藏 IP: 69.158.119.*| 热度|

1 Vetaren11

该博文允许注册用户评论 请点击登录 评论 (0 个评论)

数据加载中...

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-9-2 03:20

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部