Search Engines like Google, Yahoo Slurp, MSNbot, Technorati etc keep visiting your blogs regularly once your blog have got many backlinks from different source, which means that the bots would reach your blog through links and would crawl to your blog. In order to find out the rate at which robots visit and crawl your blog you can use the plugin CRT which gives you a report on individual post or else your total blog in the form of a small graph with rates for each robots.
Features of CRT :
* Access crawl data for 3 main search engines
* See the exact times a spider accessed any page on your site
* Monitor your crawl rate over time
* Discover how crawl rate is related to PageRank
Here is a screenshot, which shows you a months report of this tech blog.
If you find out that one of your post is highly crawled, you should click on the links option which can show you the total backlinks of each blog post using Yahoo Search Engine. Also the Crawl rate tracker would show you with a small report with the date and time along with the name of search engine which crawled each of your blog post. Here is a report below for our blog post on Best Laptops
wow thats great to develop site.. thanks for the valuable post
Nice plugin Amit, support fot other bots is very helpful.
Wow That’s Really Great information Amit Thanks
Why their is steep rise in Crawling of Google bot. After 15 Oct. before that it was crawling almost equal to Yahoo and MSN bot.
Ohh, thanks for sharing this post! very useful to me