xiaohai2008的个人博客分享 http://blog.sciencenet.cn/u/xiaohai2008

博文

Gibbs Sampling Algorithm for LDA

已有 12839 次阅读 2012-5-4 10:53 |个人分类:机器学习|系统分类:科研笔记| Model, topic

最近利用Gibbs Sampling算法对许多主题模型(topic model)进行了推导
目前考虑的主题模型包括:LDA (Latent Dirichlet Allocation),AT (Author-Topic),ACT (Author-Conference-Topic),ToT (Topic over Time),TNG (Topic N-Gram),BTM (Bigram Topic Model), LDACOL (LDA Collocation)等
最近会不断的贴在此处,供大家批评指正

今天先贴第一篇:LDAGibbs(全文见LDAGibbs.pdf),主要参考以下文献:
@TECHREPORT{Hei09,
  author = {Heinrich, Gregor},
  title = {Parameter Estimation for Text Analysis},
  institution = {vsonix GmbH and University of Leipzig},
  year = {2009},
  type = {Technical Report Version 2.9},
  abstract = {Presents parameter estimation methods common with discrete probability
distributions, which is of particular interest in text modeling.
Starting with maximum likelihood, a posteriori and Bayesian estimation,
central concepts like conjugate distributions and Bayesian networks
are reviewed. As an application, the model of latent Dirichlet allocation
(LDA) is explained in detail with a full derivation of an aaproximate
inference algorithm based on Gibbs sampling, including a discussion
of Dirichlet hyperparameter estimation.},
}



https://blog.sciencenet.cn/blog-611051-566845.html

上一篇:下一代测序中ChIP-seq数据的处理与分析
下一篇:Gibbs Sampling Algorithm for AT Model
收藏 IP: 168.160.24.*| 热度|

0

该博文允许注册用户评论 请点击登录 评论 (5 个评论)

数据加载中...

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-12-28 00:25

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部