MocoSpace_63233
Oct 10, 2007Nimbostratus
Redirecting User-Agent Googlebot to new pool or server
Ok - simple problem but I am a newbie. We are getting killed with Googlebot-Mobile spiders. Chewing up all ouer connections. We don't want to stop it but ultimately we may want to rate limit it or something similar. For now we what to redirect the spider to a non-production server so we can better evaluate why it's behaving the way it is. Wrote a quick and dirtyt iRule but does not seem to be working. Ideas on what to look for.
when HTTP_REQUEST {
if {[HTTP::header "User-Agent"] contains "*Googlebot-Mobile.*"} {
pool HTTP-SearchEngines
}
}
Also any hints on running the traffic generator to test this iRule would also be useful.
THanks!
Cheers
Mark