tweak robots.txt.  allow /search, higher crawl-delay
tweak robots.txt.  allow /search, higher crawl-delay

solgenomics/sgn,solgenomics/sgn,solgenomics/sgn,solgenomics/sgn,solgenomics/sgn,solgenomics/sgn,solgenomics/sgn