added more debug informations to track down crawler 'stuck' problems
added more debug informations to track down crawler 'stuck' problems

chimbori/crux,chimbori/crux,arunkumar9t2/crux,arunkumar9t2/crux