The previous change was MUCH faster, but it pulled in URLs that did not have any actual results. (Because we saved all 1M top urls, but we only crawl the top 300K.) This version leverages a faster urlhash search to only pull URLs that have results.
The previous change was MUCH faster, but it pulled in URLs that did not have any actual results. (Because we saved all 1M top urls, but we only crawl the top 300K.) This version leverages a faster urlhash search to only pull URLs that have results.

git-svn-id: d5a8a4092b1c3eddbe100e0c5fc6446cfb12afd1@1229 fc7d47d3-c008-acd5-f51f-d19787b8a02f

paulcalvano/httparchive,HTTPArchive/httparchive,paulcalvano/httparchive,HTTPArchive/httparchive