query: I have 2.1 million pages, how to get crawled by googlebot more frequently?
positive_passages.docid: 28051
positive_passages.text: How to get tens of millions of pages indexed by Google bot?
negative_passages.docid: 22760
negative_passages.text: What is PageRank and how do I get it?
negative_passages.docid: 21966
negative_passages.text: Can external resources be cached for 7 days to improve my PageSpeed score?
negative_passages.docid: 122479
negative_passages.text: robots meta not blocking indexing
negative_passages.docid: 33960
negative_passages.text: How to prevent search engines from indexing a single page of my website?
negative_passages.docid: 154011
negative_passages.text: Google AJAX API - How do I get more than 4 Results?
negative_passages.docid: 147360
negative_passages.text: How do you scrape AJAX pages?
negative_passages.docid: 112869
negative_passages.text: How to paginate query results for Infinite Scroll?
negative_passages.docid: 36143
negative_passages.text: Number of indexed pages with "site:" search less than reported in Google Webmaster Tools
negative_passages.docid: 44207
negative_passages.text: Thousands of 404 errors in Google Webmaster Tools
negative_passages.docid: 122893
negative_passages.text: Should I notify 'under construction' websites to crawlers? If yes how?
negative_passages.docid: 136379
negative_passages.text: How do I control how often search engines visit my site?
negative_passages.docid: 88032
negative_passages.text: Can I invoke Google to check my robots.txt?
negative_passages.docid: 38682
negative_passages.text: How long does Google Webmaster Tools take to index a website?
negative_passages.docid: 110861
negative_passages.text: Don't repeat (or let us skip) posts when requesting next page on 10k tools' Flagged Posts
negative_passages.docid: 8270
negative_passages.text: SEO for pages that load from database
negative_passages.docid: 72220
negative_passages.text: Sudden decrease in pages crawled per day