Added function to dump tokens into DB and changed regex to for tokens in the form [word]/[pos]
Added function to dump tokens into DB and changed regex to for tokens in the form [word]/[pos]

SahilC/LanguageProcessing