http://disqus.com/people/thesearchmonitor/enFri, 04 Jul 2008 11:34:29 -0000http://www.vinnylingham.com/the-search-monitor.html#comment-814052Hello Dominic,<br><br>Google and others do have limits, we are careful not to impose on those. We are also careful to be sure that the SE's know that we are a crawler so that there is no negative impact on impressions and CTR's.<br><br>We look forward to working with you.thesearchmonitorFri, 04 Jul 2008 11:34:29 -0000http://www.vinnylingham.com/the-search-monitor.html#comment-808997Hi Dominic,<br><br>We are crawling the search providers using certain urls that provide information on the sponsored bidders. Crawling occurs many times per day to cover time zones and day part behaviors. <br><br>The crawler also crawls blogs, press, optimized sites, and landing pages.thesearchmonitorThu, 03 Jul 2008 14:57:40 -0000