crawler: performance boost
crawler: performance boost

BeautifulSoup will spend a huge amount of CPU time doing charset detection if you give it a non-unicode string
acdha/django-test-utils,ericholscher/django-test-utils,ericholscher/django-test-utils,acdha/django-test-utils