Updated README to add a feature list and mention the new web crawler feature, and multi-threadedness.
Updated README to add a feature list and mention the new web crawler feature, and multi-threadedness.

armiller/link-checker,endymion/link-checker,armiller/link-checker,endymion/link-checker,armiller/link-checker,endymion/link-checker,endymion/link-checker,armiller/link-checker