try to batch the document pre-processing in the traiing to avoid using too much memory
try to batch the document pre-processing in the traiing to avoid using too much memory

deanmalmgren/scrubadub,datascopeanalytics/scrubadub,datascopeanalytics/scrubadub,deanmalmgren/scrubadub