always add new links in chunks to minimize work loss during restart
always add new links in chunks to minimize work loss during restart

berkmancenter/mediacloud,berkmancenter/mediacloud,berkmancenter/mediacloud,berkmancenter/mediacloud,berkmancenter/mediacloud