Process each queue in batches, so that it won't be stuck in one queue processing function for a long time. There is one exception: the functions that process the discover queue; this one can run as long as is necessary, because it is required to ensure no data is lost.
Process each queue in batches, so that it won't be stuck in one queue processing function for a long time.
There is one exception: the functions that process the discover queue; this one can run as long as is necessary, because it is required to ensure no data is lost.

wimleers/fileconveyor,WadiInternet/fileconveyor,edx/fileconveyor