More efficient stream iRule

Hi.

You are right. HTTP Profile would break Citrix.

Who is terminating the SSL connection? Are you using SSL Offload?

I guess you could create an iRule to search for robots.txt inside the payload. If robots.txt is inside the payload you can drop the request.

This solution will not require HTTP Profile but be careful about CPU overhead.

I didn't test this iRule.

when CLIENT_ACCEPTED {
  TCP::collect
}
when CLIENT_DATA {
  if { [TCP::payload] contains "robots.txt" } {
     Close TCP Conn
    TCP::close
  }
  TCP::release
  TCP::collect
}

Good luck!