Language Modeling by Clustering with Word Embeddings for Text Readability Assessment. Cha, M., Gwon, Y., & Kung, H., T.
Language Modeling by Clustering with Word Embeddings for Text Readability Assessment [pdf]Paper  Language Modeling by Clustering with Word Embeddings for Text Readability Assessment [pdf]Website  abstract   bibtex   
We present a clustering-based language model using word em-beddings for text readability prediction. Presumably, an Euclidean semantic space hypothesis holds true for word embeddings whose training is done by observing word co-occurrences. We argue that clustering with word embeddings in the metric space should yield feature representations in a higher semantic space appropriate for text regression. Also, by representing features in terms of his-tograms, our approach can naturally address documents of varying lengths. An empirical evaluation using the Common Core Standards corpus reveals that the features formed on our clustering-based language model signiicantly improve the previously known results for the same corpus in readability prediction. We also evaluate the task of sentence matching based on semantic relatedness using the Wiki-SimpleWiki corpus and dnd that our features lead to superior matching performance.

Downloads: 0