A Dirichlet Multinomial Mixture Model-based Approach for Short Text Clustering. Yin, J. & Wang, J.
A Dirichlet Multinomial Mixture Model-based Approach for Short Text Clustering [pdf]Paper  A Dirichlet Multinomial Mixture Model-based Approach for Short Text Clustering [link]Website  abstract   bibtex   
Short text clustering has become an increasingly impor-tant task with the popularity of social media like Twitter, Google+, and Facebook. It is a challenging problem due to its sparse, high-dimensional, and large-volume characteris-tics. In this paper, we proposed a collapsed Gibbs Sampling algorithm for the Dirichlet Multinomial Mixture model for short text clustering (abbr. to GSDMM). We found that GS-DMM can infer the number of clusters automatically with a good balance between the completeness and homogeneity of the clustering results, and is fast to converge. GSDMM can also cope with the sparse and high-dimensional problem of short texts, and can obtain the representative words of each cluster. Our extensive experimental study shows that GSDMM can achieve significantly better performance than three other clustering models.

Downloads: 0