Forum Discussion

BaltoStar_12467's avatar
Aug 14, 2013

11.4.0 : best storage for large data-sets

f5 BIG-IP LTM VE v11.4.0 on ESXi

 

I have multiple data-sets of 1M+ records that my iRule need to match against.

 

I've heard that v11 has improved technology around storing & accessing large datasets.

 

What is the best storage mechanism such large data-sets ? Data Group External File ? iFile ? Table ? Something else ?

 

These data-sets need to be updated on a nightly schedule, so also need an update process.

 

3 Replies

  • External data group should be fine, but an external service called from a sideband connection is an alternative. Since updates are a concern, the external service might be preferable.

     

  • The only issue with going the sideband connection route would be that you would have to write the service that the sideband connection calls. The most easy probably is to implement it as a HTTP request as there are already samples floating around to show how to issue a HTTP GET from a sideband call. You'll just have to have an app server routable that contains the service for the lookup. That will probably be the best performing but, as Jason said, an external data group with the "class" command should work for you as well.

     

  • for high performance requirements, you can make a sideband connection to a second vip on the box that then has the external service defined as a pool of servers and enables oneconnect to them.