[7sur7] - improved the function that extracts intro to detect links (inline links + plaintext links) - improved extract_article_data to open either a file or an url. - moved the detection of photo album from extract_article_data to get_frontpage_toc (and associated functions) : we now separate photoalbums from articles when we extract links from the frontpage
[7sur7]
- improved the function that extracts intro to detect links (inline links + plaintext links)
- improved extract_article_data to open either a file or an url.
- moved the detection of photo album from extract_article_data to get_frontpage_toc (and associated functions) : we now separate photoalbums from articles when we extract links from the frontpage

sevas/csxj-crawler,sevas/csxj-crawler