Refactor to add a separate Worker() class, useful for storing state related to a particular crawl greenlet
Refactor to add a separate Worker() class, useful for storing state related to a particular crawl greenlet

storborg/itsy