catching that special case that happens about 1/20th of docs, where we can convert it to unicode successfully, but it has an xml encoding declaration and lxml does not support pre-conversion in that case. So, this commit makes it fallback to using the un-decoded form
catching that special case that happens about 1/20th of docs,
where we can convert it to unicode successfully, but it has an xml encoding declaration
and lxml does not support pre-conversion in that case.
So, this commit makes it fallback to using the un-decoded form

trec-kba/streamcorpus-pipeline,trec-kba/streamcorpus-pipeline,trec-kba/streamcorpus-pipeline