Any one else notice that Yahoo has a bunch of new crawlers/spiders going crazy on their websites as of a couple weeks ago? We are seeing over 15k visits a day from them on some campaigns. The bad thing is that they don't identify themselves as spiders and until very recently they weren't respecting the robots.txt. There is a lively discussion going on over at webmasterworld about it.
INFO: One is some new SLURP spider out of Yahoo China! But Yahoo's various spiders don't share information and come separately to slurp. (By the way, you all should check out Yahoo's new technology pages because they are coming out with some new tech soon). The others are somehow related to editorial content checking and ad checking.
209.191.87.214-219
66.196.97.157-169
INFO: One is some new SLURP spider out of Yahoo China! But Yahoo's various spiders don't share information and come separately to slurp. (By the way, you all should check out Yahoo's new technology pages because they are coming out with some new tech soon). The others are somehow related to editorial content checking and ad checking.
209.191.87.214-219
66.196.97.157-169