abandoned the light-weight spidering process as it was flawed and didn't properly preserve state and moved back to parsing the pages and putting them in a queue
abandoned the light-weight spidering process as it was flawed and didn't properly preserve state and moved back to parsing the pages and putting them in a queue

winny19/entersoft-scanner,winny19/entersoft-scanner,winny19/entersoft-scanner