For an all-in-one solution, added in methods of reading XML, chunking texts to 1,000 words each (recommended by Jockers), and stripping out all but common nouns (also recommended by Jockers). This script is now fully capable of getting data and cleaning it to be ready to model.
For an all-in-one solution, added in methods of reading XML, chunking texts to 1,000 words each (recommended by Jockers), and stripping out all but common nouns (also recommended by Jockers). This script is now fully capable of getting data and cleaning it to be ready to model.

jmclawson/DHQ_TM