The webscraper was to slow in the end, I have now tried to speed it up by using a HashTable (Python Dictionary) instead of array to see if the website has been visited before
The webscraper was to slow in the end, I have now tried to speed it up by using a HashTable (Python Dictionary) instead of array to see if the website has been visited before

MVilstrup/domain_scraper,MVilstrup/domain_scraper