Made the Crawler block optional, added optional opts hash back in and passing it to the subcrawlers.
Made the Crawler block optional, added optional opts hash back in and passing it to the subcrawlers.

jlindsey/scapeshift