Block spiders from some paths
Block spiders from some paths

We don't want spiders using up system resources by hitting expensive CSV routes. User profile pages and related routes also sometimes cause problems because spiders don't include required params when hitting them, and there's no point in indexing these anyway.

WikiEducationFoundation/WikiEduDashboard,WikiEducationFoundation/WikiEduDashboard,WikiEducationFoundation/WikiEduDashboard,WikiEducationFoundation/WikiEduDashboard,WikiEducationFoundation/WikiEduDashboard