ignore page encoding; add links to db; clarify crawl process
ignore page encoding; add links to db; clarify crawl process

KirillShaman/escalate_gspread,KirillShaman/escalate_gspread,KirillShaman/escalate_gspread