Improve tokenizing of linkable terms
Improve tokenizing of linkable terms

Currently only tabs and blanks are used for tokenizing the description,
which breaks when a term is at the end of a line or has () appended to
it.
1. Use also other white space characters such as new-lines and carriage
   return for splitting.
2. Remove some common non-word characters from the token before lookup.

Signed-off-by: Philipp Hahn <8cb7a2c205789112a9f61bc3102305826b6a8db1@univention.de>

taget/libvirt,jeckersb/libvirt,rlaager/libvirt,rmarwaha/libvirt1,novel/fbsd-libvirt,leilihh/libvirt,shugaoye/libvirt,crobinso/libvirt,rlaager/libvirt,trainstack/libvirt,andreabolognani/libvirt,rmarwaha/libvirt1,eskultety/libvirt,danwent/libvirt-ovs,rlaager/libvirt,taget/libvirt,trainstack/libvirt,rmarwaha/libvirt,crobinso/libvirt,libvirt/libvirt,elmarco/libvirt,jeckersb/libvirt,nertpinx/libvirt,wiedi/libvirt,soulxu/libvirt-xuhj,zippy2/libvirt,zhlcindy/libvirt-1.1.4-maintain,cbosdo/libvirt,iam-TJ/libvirt,nertpinx/libvirt,libvirt/libvirt,andreabolognani/libvirt,datto/libvirt,shugaoye/libvirt,elmarco/libvirt,fabianfreyer/libvirt,datto/libvirt,kantai/libvirt-vfork,trainstack/libvirt,jardasgit/libvirt,rmarwaha/libvirt1,usc-isi/libvirt,foomango/libvirt,iam-TJ/libvirt,olafhering/libvirt,trainstack/libvirt,warewolf/libvirt,novel/fbsd-libvirt,nertpinx/libvirt,zhlcindy/libvirt-1.1.4-maintain,datto/libvirt,agx/libvirt,novel/fbsd-libvirt,cbosdo/libvirt,zhlcindy/libvirt-1.1.4-maintain,bjzhang/libvirt,leilihh/libvirt,jfehlig/libvirt,dumbbell/libvirt,fabianfreyer/libvirt,agx/libvirt,nertpinx/libvirt,eskultety/libvirt,elmarco/libvirt,leilihh/libvirt,novel/fbsd-libvirt,agx/libvirt,warewolf/libvirt,soulxu/libvirt-xuhj,wiedi/libvirt,rmarwaha/libvirt1,fabianfreyer/libvirt,jfehlig/libvirt,rmarwaha/libvirt,foomango/libvirt,eskultety/libvirt,iam-TJ/libvirt,danwent/libvirt-ovs,jfehlig/libvirt,jeckersb/libvirt,jeckersb/libvirt,warewolf/libvirt,iam-TJ/libvirt,soulxu/libvirt-xuhj,wiedi/libvirt,novel/fbsd-libvirt,zippy2/libvirt,wiedi/libvirt,iam-TJ/libvirt,rmarwaha/libvirt,warewolf/libvirt,warewolf/libvirt,rlaager/libvirt,dumbbell/libvirt,emaste/libvirt,jardasgit/libvirt,eskultety/libvirt,emaste/libvirt,rmarwaha/libvirt,novel/fbsd-libvirt,foomango/libvirt,shugaoye/libvirt,cbosdo/libvirt,wiedi/libvirt,kantai/libvirt-vfork,dumbbell/libvirt,emaste/libvirt,jfehlig/libvirt,siboulet/libvirt-openvz,usc-isi/libvirt,jeckersb/libvirt,wiedi/libvirt,libvirt/libvirt,dumbbell/libvirt,jardasgit/libvirt,emaste/libvirt,rmarwaha/libvirt,danwent/libvirt-ovs,foomango/libvirt,siboulet/libvirt-openvz,zippy2/libvirt,crobinso/libvirt,rmarwaha/libvirt,warewolf/libvirt,emaste/libvirt,jeckersb/libvirt,taget/libvirt,olafhering/libvirt,bjzhang/libvirt,usc-isi/libvirt,andreabolognani/libvirt,agx/libvirt,kantai/libvirt-vfork,fabianfreyer/libvirt,iam-TJ/libvirt,andreabolognani/libvirt,VenkatDatta/libvirt,bjzhang/libvirt,leilihh/libvirt,eskultety/libvirt,wiedi/libvirt,bjzhang/libvirt,olafhering/libvirt,rmarwaha/libvirt1,elmarco/libvirt,shugaoye/libvirt,usc-isi/libvirt,dumbbell/libvirt,siboulet/libvirt-openvz,libvirt/libvirt,kantai/libvirt-vfork,soulxu/libvirt-xuhj,foomango/libvirt,agx/libvirt,dumbbell/libvirt,rmarwaha/libvirt1,zippy2/libvirt,warewolf/libvirt,trainstack/libvirt,VenkatDatta/libvirt,taget/libvirt,olafhering/libvirt,jardasgit/libvirt,emaste/libvirt,datto/libvirt,trainstack/libvirt,shugaoye/libvirt,taget/libvirt,VenkatDatta/libvirt,soulxu/libvirt-xuhj,elmarco/libvirt,danwent/libvirt-ovs,emaste/libvirt,VenkatDatta/libvirt,leilihh/libvirt,cbosdo/libvirt,iam-TJ/libvirt,bjzhang/libvirt,danwent/libvirt-ovs,jeckersb/libvirt,fabianfreyer/libvirt,andreabolognani/libvirt,zhlcindy/libvirt-1.1.4-maintain,cbosdo/libvirt,crobinso/libvirt,kantai/libvirt-vfork,siboulet/libvirt-openvz,novel/fbsd-libvirt,novel/fbsd-libvirt,siboulet/libvirt-openvz,datto/libvirt,usc-isi/libvirt,VenkatDatta/libvirt,nertpinx/libvirt,trainstack/libvirt,rlaager/libvirt,zhlcindy/libvirt-1.1.4-maintain,leilihh/libvirt,jardasgit/libvirt,novel/fbsd-libvirt