When you are working with text mining, you might want to reduce the dimensionality of your problem. The word2vec algorithm, developed by Tomas Mikolov and others at Google, offers a nice approach. This page shows how to apply this algorithm within R.
Dmitriy Selivanov. GloVe Word Embeddings. Available in html format.
You can find an earlier version of this page on my blog.