We have sharepoint 2003 and sharepoint 2007 environments setup on F5. We are migrating from sharepoint 2003 to SP 2007. We had configured iRule which was capturing "404" and "File Not Foud" msgs from ...
Does the issue occur on every request or just the ones that trigger the iRule redirect? Are you redirecting the spider to a site which it doesn't have access to?