Now that Pat is removing the dump .gz files we have to redefine when a run is "complete". So now we base that on the existance of the stats. In the (near) future I hope to create a crawl table that has meta information about a crawl and we can do this more reliably then.
Now that Pat is removing the dump .gz files we have to redefine when a run is "complete". So now we base that on the existance of the stats. In the (near) future I hope to create a crawl table that has meta information about a crawl and we can do this more reliably then.

git-svn-id: d5a8a4092b1c3eddbe100e0c5fc6446cfb12afd1@974 fc7d47d3-c008-acd5-f51f-d19787b8a02f

HTTPArchive/httparchive,paulcalvano/httparchive,HTTPArchive/httparchive,paulcalvano/httparchive