Partially collapsed Gibbs sampling for latent Dirichlet allocation

Hongju Park, Taeyoung Park, Yung Seop Lee

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

A latent Dirichlet allocation (LDA) model is a machine learning technique to identify latent topics from text corpora within a Bayesian hierarchical framework. Current popular inferential methods to fit the LDA model are based on variational Bayesian inference, collapsed Gibbs sampling, or a combination of these. Because these methods assume a unimodal distribution over topics, however, they can suffer from large bias when text corpora consist of various clusters with different topic distributions. This paper proposes an inferential LDA method to efficiently obtain unbiased estimates under flexible modeling for heterogeneous text corpora with the method of partial collapse and the Dirichlet process mixtures. The method is illustrated using a simulation study and an application to a corpus of 1300 documents from neural information processing systems (NIPS) conference articles during the period of 2000–2002 and British Broadcasting Corporation (BBC) news articles during the period of 2004–2005.

Original languageEnglish
Pages (from-to)208-218
Number of pages11
JournalExpert Systems with Applications
Volume131
DOIs
Publication statusPublished - 2019 Oct 1

All Science Journal Classification (ASJC) codes

  • Engineering(all)
  • Computer Science Applications
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Partially collapsed Gibbs sampling for latent Dirichlet allocation'. Together they form a unique fingerprint.

  • Cite this