TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model...

35
TOPIC MODELING: WHY, WHAT, AND HOW @BrianCroxall Brown University https://flic.kr/p/8vT9yB

Transcript of TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model...

Page 1: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

TOPIC MODELING: WHY, WHAT, AND HOW

@BrianCroxallBrown University

https://flic.kr/p/8vT9yB

Page 2: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/4SFZUt

Page 3: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

WHY?WHAT? HOW?

Page 4: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/6eyx7T

Page 5: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/cG3iU7

Page 6: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/cG3iU7

Page 7: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/ahunvp

Page 8: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/89D449

Page 9: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/qCnVkS

Page 10: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/55MNhd

Page 11: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/7LZrQ5

Page 12: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/6pamtQ

Page 13: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

WHY?WHAT?

Page 14: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

“A topic model is a type of statistical model for discovering theabstract ‘topics’ that occur in a collection of documents.”

Wikipedia

Page 15: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

“A topic model is a type of statistical model for discovering the abstract ‘topics’ that occur in a collection of documents.”

Wikipedia

Page 16: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/AepGbv

Page 17: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/9W1TWq

Page 18: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/4AcfNu

Page 19: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/qn9Lwf

Page 20: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/549nsK

Page 21: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

1. Every word in a text belongs to a topic.

Page 22: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

2. Every word in a text is generated from one of the topics thatmake up the text.

Page 23: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

3. Each text is made up of all the topics you could ever find.

Page 24: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

4.The computer does not need to know what the words mean.

Page 25: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

http://flic.kr/p/6tS73K

http://flic.kr/p/6tS73K
Page 26: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/cEJFoo

Page 27: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/jhr8g

Page 28: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

Topic Modeling ≈ LDALatent Dirichlet Allocation

Page 29: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

EXAMPLES

Page 30: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

MINING THE DISPATCHRobert Nelson

University of Richmond

Page 31: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

MODELING PMLATed Underwood, University of Illinois

Andrew Goldstone, Rutgers University

Page 32: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

QUANTIFYING KISSINGERMicki Kaufman, CUNY Graduate Center

Page 33: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

WHY?WHAT? HOW?

Page 34: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/7XTrdz

Page 35: TOPIC MODELING: WHY, AND HOW - Brown University · “A topic model is a type of statistical model for discovering the ... Topic Modeling ≈ LDA Latent Dirichlet Allocation. EXAMPLES.

https://flic.kr/p/h2SkAA

THANKS.@briancroxall / briancroxall.net


Employing Latent Dirichlet Allocation Model for Topic Extraction … · 2017. 10. 20. · 2. Literature Review 2.1. Research of Topic Extraction for English Text Topic extraction

Employing Latent Dirichlet Allocation Model for Topic Extraction … · 2017. 10. 20. · 2. Literature Review 2.1. Research of Topic Extraction for English Text Topic extraction

The IBP Compound Dirichlet Process and its Application to Focused Topic Modeling Sinead Williamson, Chong Wang, Katherine A. Heller, David M. Blei Presented.

The IBP Compound Dirichlet Process and its Application to Focused Topic Modeling Sinead Williamson, Chong Wang, Katherine A. Heller, David M. Blei Presented.

3/11/20151 Latent Dirichlet Allocation (LDA) A review of topic modeling and customer interactions application.

3/11/20151 Latent Dirichlet Allocation (LDA) A review of topic modeling and customer interactions application.

Probabilistic Topic Modeling for GenomicProbabilistic Topic Modeling …xc35/ppt/BIBM_B485_Slides.pdf · 2011-01-01 · Probabilistic Topic Modeling for GenomicProbabilistic Topic

Probabilistic Topic Modeling for GenomicProbabilistic Topic Modeling …xc35/ppt/BIBM_B485_Slides.pdf · 2011-01-01 · Probabilistic Topic Modeling for GenomicProbabilistic Topic

Latent Dirichlet Allocation (LDA) Also Known As Topic Modeling · • mathematical model • a bit hacky Topic Model (LDA) • probabilistic model • principled -> has produced many

Latent Dirichlet Allocation (LDA) Also Known As Topic Modeling · • mathematical model • a bit hacky Topic Model (LDA) • probabilistic model • principled -> has produced many

Parallel Latent Dirichlet Allocation on GPUs · Latent Dirichlet Allocation (LDA) is a powerful technique for topic modeling originally developed by Blei et al. [1]. Given a collection

Parallel Latent Dirichlet Allocation on GPUs · Latent Dirichlet Allocation (LDA) is a powerful technique for topic modeling originally developed by Blei et al. [1]. Given a collection

Topic Modeling of Multimodal Data: An Autoregressive Approachopenaccess.thecvf.com/.../Zheng_Topic_Modeling_of... · Topic modeling based on latent Dirichlet allocation (LDA) has

Topic Modeling of Multimodal Data: An Autoregressive Approachopenaccess.thecvf.com/.../Zheng_Topic_Modeling_of... · Topic modeling based on latent Dirichlet allocation (LDA) has

An Introduction to Topic Modeling - Verbs Indexverbs.colorado.edu/~mpalmer/Ling7800/topic_modeling_slides.pdf · 4/24/2013  · Topic Modeling Sample and ˚from a Dirichlet distribution

An Introduction to Topic Modeling - Verbs Indexverbs.colorado.edu/~mpalmer/Ling7800/topic_modeling_slides.pdf · 4/24/2013  · Topic Modeling Sample and ˚from a Dirichlet distribution

Bayesian Nonparametric Topic Modeling Hierarchical Dirichlet Processes

Bayesian Nonparametric Topic Modeling Hierarchical Dirichlet Processes

Topic modeling

Topic modeling

Dirichlet Distribution, Dirichlet Process and Dirichlet Process Mixture

Dirichlet Distribution, Dirichlet Process and Dirichlet Process Mixture

Computational Techniques for Public Health …dml.cs.byu.edu/~sburton/presentations/2012-04_26...Topic Modeling •Latent Dirichlet allocation (LDA) User chooses a topic (z) Given

Computational Techniques for Public Health …dml.cs.byu.edu/~sburton/presentations/2012-04_26...Topic Modeling •Latent Dirichlet allocation (LDA) User chooses a topic (z) Given

A Latent Dirichlet Allocation Systematic Literature Review ... · (TM) technique and Latent Dirichlet Allocation (LDA) topic model were used to cluster articles in different topics.

A Latent Dirichlet Allocation Systematic Literature Review ... · (TM) technique and Latent Dirichlet Allocation (LDA) topic model were used to cluster articles in different topics.

Topic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression David Mimno Andrew McCallum.

Topic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression David Mimno Andrew McCallum.

SGVB Topic Modeling - UvA · Latent Dirichlet Allocation (LDA), and more recently Deep Exponential Families (DEF), are ... we develop and test how to best use Stochastic Gradient

SGVB Topic Modeling - UvA · Latent Dirichlet Allocation (LDA), and more recently Deep Exponential Families (DEF), are ... we develop and test how to best use Stochastic Gradient

Techniques for Dimensionality Reduction Topic Models/LDA Latent Dirichlet Allocation.

Techniques for Dimensionality Reduction Topic Models/LDA Latent Dirichlet Allocation.

Discipline Hotspots Mining Based on Hierarchical Dirichlet ...determine the number of clusters in LDA topic model. In this paper, Hierarchical Dirichlet Process [11] is used for topic

Discipline Hotspots Mining Based on Hierarchical Dirichlet ...determine the number of clusters in LDA topic model. In this paper, Hierarchical Dirichlet Process [11] is used for topic

DISCUSSION FORUM DATA AS RESEARCH MATERIAL€¦ · • Case: Low-Carbohydrate Diet phenomenon (LCD) • Start with static: Latent Dirichlet Allocation (LDA) topic modeling + close

DISCUSSION FORUM DATA AS RESEARCH MATERIAL€¦ · • Case: Low-Carbohydrate Diet phenomenon (LCD) • Start with static: Latent Dirichlet Allocation (LDA) topic modeling + close

Topic: Modeling Inheritance

Topic: Modeling Inheritance

Modeling Prosodic Sequences with K-Means and Dirichlet Process GMMs

Modeling Prosodic Sequences with K-Means and Dirichlet Process GMMs