crawler: Wait max 1 second (#9894)
crawler: Wait max 1 second (#9894)

Add 1-second timeout to crawler wait.

This will make the crawler able to run, albeit very, 
very slowly on high load servers.
aead/minio,donatello/minio,balamurugana/minio,aead/minio,vadmeste/minio,NitishT/minio,donatello/minio,aead/minio,vadmeste/minio,NitishT/minio,krisis/minio,minio/minio,aead/minio,krisis/minio,aead/minio,aead/minio,minio/minio,NitishT/minio,balamurugana/minio,aead/minio,aead/minio,NitishT/minio