zhuwei3014的个人博客分享 http://blog.sciencenet.cn/u/zhuwei3014

博文

Coursera: Neural Networks for ML- Lecture 14

已有 4135 次阅读 2014-8-19 06:51 |个人分类:Coursera: Neural Networks|系统分类:科研笔记| DBN

DBN(信息量较大)

2006_Hinton_A fast learning algorithm for deep belief nets
2006_Science_Reducing the Dimensionality of data with neural networks
2009_The difficulty of training deep architectures and the effect of unsupervised pre-training
ICML2010_Rectified Linear Units Improve Restricted Boltzmann Machines

1. Learning layers of features by stacking RBMs
2. Discriminative fine-tuning for DBNs
3. What happens during discriminative fine-tuning?
    这一节主要讲了为什么unsupervised pre-training对训练多层结构有帮助,其中的阐述和实验结果具体可以参见这两篇文章:
Erhan_2009_The difficulty of training deep architectures and the effect of unsupervised pre-training
Erhan_2010_Why does unsupervised pre-training help deep learning?

4. Modeling real-valued data with an RBM
5. RBMs are infinite Sigmoid Belief Nets(Optional)





https://blog.sciencenet.cn/blog-1583812-820528.html

上一篇:Coursera: Neural Networks for ML- Lecture 13
下一篇:Ubuntu+CUDA6.5+Caffe安装配置汇总
收藏 IP: 130.63.92.*| 热度|

0

该博文允许注册用户评论 请点击登录 评论 (0 个评论)

数据加载中...

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-11-6 02:23

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部