subjectrehigh prolactin in article jer @psuvm psu edu (john rodwaywrites>any comments on the use of the drug parlodel for high prolactin in the blood>it can suppress secretion of prolactin is useful in cases of galactorrhea some adenomas of the pituitary secret too much gordon banks jxp "skepticism is the chastity of the intellectand geb@cadre dsl pitt edu it is shameful to surrender it too soon we received post by the same author discussing medications modeling the whole of wikipedia while the initial lda implementations could be slowmodern systems can work with very large collections of data following the documentation of gensimwe are going to build topic model for the whole of the english language wikipedia this takes hoursbut can be done even with machine that is not too powerful with cluster of machineswe could make it go much fasterbut we will look at that sort of processing in later first we download the whole wikipedia dump from org this is large file (currently just over gb)so it may take whileunless your internet connection is very fast thenwe will index it with gensim toolpython - gensim scripts make_wiki enwiki-latest-pages-articles xml bz wiki_en_output run the previous command on the command linenot on the python shell after few hoursthe indexing will be finished finallywe can build the final topic model this step looks exactly like what we did for the small ap dataset we first import few packagesimport logginggensim logging basicconfigformat='%(asctime) %(levelname) %(message) 'level=logging infonowwe load the data that has been preprocessedid word gensim corpora dictionary load_from_text('wiki_en_output_wordids txt'mm gensim corpora mmcorpus('wiki_en_output_tfidf mm'