Communication Methods and Measures· 2018Q1
Applying LDA Topic Modeling in Communication Research: Toward a Valid and Reliable Methodology
- 818citations
- Q1SCImago
- 2018year
Short summary
This paper proposes a standardized methodology to address key challenges in applying Latent Dirichlet Allocation (LDA) topic modeling for communication research, aiming to improve its validity and reliability.
AI-generated from the title and abstract; the full text is not read.
Key points
- Addresses four major challenges in LDA topic modeling: text pre-processing, parameter selection, reliability evaluation, and interpretation.
- Proposes a standardized methodology to enhance the validity and reliability of LDA in communication research.
- Includes a hands-on user guide for practical application.
- Demonstrates the methodology's value using empirical data from an ongoing research project.
AI-generated from the title and abstract; the full text is not read.
Abstract
Latent Dirichlet allocation (LDA) topic models are increasingly being used in communication research. Yet, questions regarding reliability and validity of the approach have received little attention thus far. In applying LDA to textual data, researchers need to tackle at least four major challenges that affect these criteria: (a) appropriate pre-processing of the text collection; (b) adequate selection of model parameters, including the number of topics to be generated; (c) evaluation of the model’s reliability; and (d) the process of validly interpreting the resulting topics. We review the research literature dealing with these questions and propose a methodology that approaches these challenges. Our overall goal is to make LDA topic modeling more accessible to communication researchers and to ensure compliance with disciplinary standards. Consequently, we develop a brief hands-on user guide for applying LDA topic modeling. We demonstrate the value of our approach with empirical data from an ongoing research project.
The authors' abstract, as published at the source. Communication Methods and Measures, 2018 · DOI ↗
Continue with a free account
Ask the paper: 3 free questions a day about this paper; save it, get its citation, new summaries every day for your field. Takeaways are Premium.
Continue free on the webSign in with Google or Apple; no card needed. You come back to this paper.
On your phone:
Field: General Social Sciences
General Social SciencesSocial Sciences