Document the fact that sitemap directives in /robots.txt are now respected
Document the fact that sitemap directives in /robots.txt are now respected

cgiffard/node-simplecrawler,simplecrawler/simplecrawler,simplecrawler/simplecrawler