Add Host header to the request. This fix an issues: If you have to use Http Proxy, this prevent overwrite Host header with proxy address instead of target address
Add Host header to the request. This fix an issues: If you have to use Http Proxy, this prevent overwrite Host header with proxy address instead of target address

simplecrawler/simplecrawler,simplecrawler/simplecrawler,cgiffard/node-simplecrawler,civalin/node-simplecrawler