COMMENTS
Thanks for the great writeup. However it appears that he f5_v9_host_template.xml is just the Cisco host template. Perhaps the wrong template was included in the zip file??
That appears correct, sorry about that. I'll get the correct template up there today.
OK, the template is updated. I also added an alternative for the CPU script that takes a 10s delta if you'd prefer to use that version. This supports the documentation
When i am importing template "f5_v9_host_template.xml" in Cacti is giving me error "Error: XML: Hash version does not exist.".
I already have Cacti installed.
Thanks in advance
Sunny
I'm not a Cacti expert, but that sounds like a version problem. Try an isolated install of 0.8.7 and see if the template loads correctly.
After install unable to create graphs for the the default localhost or ltms I created.
Apache logs show
ERROR: opening '/usr/local/cacti/rra/localhost_mem_buffers_3.rrd': No such file or directory
ERROR: opening '/usr/local/cacti/rra/localhost_users_6.rrd': No such file or directory
ERROR: opening '/usr/local/cacti/rra/localhost_load_1min_5.rrd': No such file or directory
ERROR: opening '/usr/local/cacti/rra/localhost_proc_7.rrd': No such file or directory
and sure enough there are no .rrd files in /usr/local/cacti/rra
pretty much stuck with the versions in this howto ... running on a linux (centos) box - anyone have any ideas?
check permissions on /usr/local/cacti/rra/.
Make sure the user you are running Cacti with has write access to that folder.
Also, make sure you added a cron job to run poller every 5 minutes. Your RRD files will not get created until poller runs after the graphs get added to Cacti.
crontab exists (and I can run w/o any output)
drwxrwxrwx 2 root root 4096 Jan 29 11:24 rra
I'm looking at graphing each virtual and the individual nodes that are assigned to the pool for the virtual. Is there an easy way to implement this through cacti?
Could you add a section on how to import the MIBs correctly?
The templates don't require the mibs, I never loaded them.
I already have Cacti graphing the performance for my LTMs, i would like to have some more granular graphs of my Virtual Servers, does anyone have a Cacti template to poll the Virtual servers more closely?
What did you have in mind?
Hi there
Does the F5 BigIP - VS Statistics allow you to look at virtual servers that are in partitions? At the moment i can query one of our units that has no partitions configured (9.2.x) but when i look at another unit (9.4.x) where all the virtual servers are in partitions i get nothing back when running the F5 BigIP - VS Statistics Data Query.
Thanks in advance and great article.
cheers
simon
Is this true of the root account as well, or just a user account?
I was just using the public snmp group so there is no security involved. The problem does seem limited to the 9.4.1 units as the others are fine. I will post in the forum to see if anyone else has come across the same thing.
Duh, sorry, it's early on Monday!
Not sure why that wouldn't work. I didn't have much success when testing 9.4.1 in other areas, so I went with 9.4.2 HF3
Thanks for the quick reply. I need to upgrade the unit as we are running a different os version on each of our clusters and this was the only one that was giving us problems. I will give that a go first and then see what happens.
Hi
Thanks for your howto, i the first time i use cacti, is powerfull!
but, for what reason the graph VS Connection Rate, VS Connections, and VS Traffic not have graph ? i like to have like performance item in gui
...
p.d : In the actual version plugin arch have a bug, edit /include/plugins.php and put
$config['url_path'] = '/cacti/';
And other guy have the GTM Template, this work fine.
http://devcentral.f5.com/Default.aspx?tabid=53&forumid=32&postid=20837&view=topic
Thanks a lot.
Do you need to install the Architecture & Weathermap plugins to graph the switchports? Followed the steps above and everything I want is graphing apart from these. They just appear as broken images.
Anyone build this in a VM yet? I'd love to get an export of the VM to avoid building my own? PLEASE!!!
If you are getting graphs with 'nan'. Try to change your SNMP package in the 'Settings' option of Cacti.
Use NET-SNMP instead UCD-SNMP.
Got this working a treat with LTM's where the config is defined under the "Common" partition BUT with an LTM that has "other" partitions defined the F5 LTM templates / vs statistics do not work at all - all the graphs just show broken images. Has anyone got this to work?
Does the m in connections/second mean million? or millisecond?
In the graph output? I think the little m when displayed shows less than 1per...
i get broken images for vs and interface stats, too. any fix for this?
Is there a fix for cpu utilization template?
did you move the xml files into the appropriate directories under for your system? They are not broken for me.
i found problem when loading f5_v9_host_template.xml, it just show blank page.
nb: i have file_uploads=On on my php.ini.
Thanks ...
are you at least at 0.8.7a? If not this is likely your problem.
Might also be a permission problem on the scripts. I just build the CactiEZ implementation, and in moving the scripts, the cacti_path is /var/www/html/. Also note that I needed to chmod the script files (not the xml files, they're fine) to 755, and chown all the files to apache:apache. HTH
solved now, finally i use cacti 0.8.7a and it works well.
Thanks ...
We have BIG-IP 9.4.4 Build 65.1 Final.
I follow all this tutorial and works well. I have problem at adding bigip device.
Here is my problem:
I can add the BigIP device and it also shows no error. But under the graph template, it shows status as not being graphed. I can do snmpwalk on all the OID on host template file (I mean files under F5_v9_host_template).
1) F5 BigIP - Global Connections Not Being Graphed Delete Graph Template Association
2) F5 BigIP - Global HTTP Requests Not Being Graphed Delete Graph Template Association
3) F5 BigIP - Global HTTP Response Errors Not Being Graphed Delete Graph Template Association
4) F5 BigIP - Global HTTP Responses Not Being Graphed Delete Graph Template Association
5) F5 BigIP - Global packets/sec Not Being Graphed Delete Graph Template Association
6) F5 BigIP - Interface Traffic (bits/sec) Not Being Graphed Delete Graph Template Association
7) F5 BigIP - SSL TPS Not Being Graphed Delete Graph Template Association
8) F5 BigIP - TMM CPU Usage Not Being Graphed Delete Graph Template Association
9) F5 BigIP - TMM memory Not Being Graphed Delete Graph Template Association
10) F5 BigIP - VS Connection Rate Not Being Graphed Delete Graph Template Association
11) F5 BigIP - VS Connections Not Being Graphed Delete Graph Template Association
12) F5 BigIP - VS Traffic (bits/sec) Not Being Graphed
and under "Associated Data Queries" it shows status as sucess [0 Items, 0 Rows] .
Can anybody please help me in figuring out the problem.
Thanks a lot in advance.
adding the device doesn't mean the data is set up to be polled. Under the Create menu, select New Graphs, select your BIG-IP host, then select the checkboxes for the graphs you want created. For the data queries, you can run them in debug mode to see where you're getting stuck. Make sure you placed the xml/script files in the directory structure and changed permissions and ownership as necessary on your system.
Thank you very much for your quick reply. I check the permission and I am running as a root user. Permission seems to be okay.
When adding device, under "Associated Data Queries" section, I can see following output:
1) F5 BigIP - Interface Statistics (Verbose Query) Uptime Goes Backwards Success [0 Items, 0 Rows] Reload Data Query Delete Data Query Association
2) F5 BigIP - VS Statistics (Verbose Query) Uptime Goes Backwards Success [0 Items, 0 Rows]
There shuold be some numbers instead of Success [0 Items, 0 Rows] , rt?
When I click at "Verbose Query" under debugging, it shows following error message under "Data Query Debug Information" :
+ Running data query [18].
+ Found type = '3' [snmp query].
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_ifStat.xml'
+ Error parsing XML file into an array.
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_ifStat.xml'
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_ifStat.xml'
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_ifStat.xml'
Same type of error for "F5 BigIP - VS Statistics":
+ Running data query [17].
+ Found type = '3' [snmp query].
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_vs.xml'
+ Error parsing XML file into an array.
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_vs.xml'
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_vs.xml'
+ Could not find data query XML file at 'path_cacti/resource/snmp_queries/f5_bigip_vs.xml'
Thanks,
RB
so the xml files are not in the current directory or cacti can't read them, one of the two
I change the permission of f5_bigip_ifStat.xml and f5_bigip_vs.xml to 777 (to test whether it is because of permission) and they are owned by root user and group.
These files are located at : /usr/local/share/cacti/resource/snmp_queries/ same as in the documentation.
I still have the same problem. I am not a cacti expert but it is working well for other devices.
Thanks,
-RB
Does your data query path (in the GUI) look like this for the interface stats:
/resource/snmp_queries/f5_bigip_ifStat.xml
So it should go to (guessing) /usr/local/share/cacti/resource/snmp_queries/f5_bigip_ifStat.xml, not path_cacti/resource...
Thank you very much for your help. It seems to be working now.
-RB
ok, same problem as above - in my VS stats show 0 available VS's - i have set it up and working in the same cacti instalation on another device - version 9.4.4 - and it's working and graphing.
on 9.4.6 i see no VS's to graph :(
have you looked at the cacti poller log for error information? Can you do an snmp get from the command line successfully to that 9.4.6 system?
cacti poller log doesnt help since i'm not polling anything yet - although i can poll other information from this device - only the VS's are missing
and yes - i can pull them by hand via commandline
So the data queries are not returning anything? you can run them in debug mode to see where you're getting stuck. Make sure you placed the xml/script files in the directory structure and changed permissions and ownership as necessary on your system.
nope - they return nothing, debug mode says that it didnt find any VSs.
files are ok because this template already works for an older F5 device that i have
I've installed cacti-0.8.7d and I'm at the point where I'm going to place the graph on a tree, but when I press the GO button I get a blank page! Device added perfectly fine ... any help is appreciated. Thanks
Here's the httpd/error_log entry related to my issue above:
PHP Fatal error: Allowed memory size of 8388608 bytes exhausted (tried to allocate 92160 bytes) in /usr/local/cacti/lib/tree.php on line 416, referer: http://10.199.6.20/cacti/graphs.php
Allowed memory size of 8388608 bytes exhausted (tried to allocate 128 bytes)
PHP Fatal error: Allowed memory size of 8388608 bytes exhausted (tried to allocate 92160 bytes) in /usr/local/cacti/lib/tree.php on line 348, referer: http://10.199.6.20/cacti/graphs.php
Allowed memory size of 8388608 bytes exhausted (tried to allocate 128 bytes)
Not a php guy ... but a quick google search found this:
http://www.tech-recipes.com/rx/777/solve-php-fatal-error-allowed-memory-size-of-8388608-bytes-exhausted-tried/
Hey there, you're hitting a php memory limitation. You'll need to edit your php.ini file and increase the line:
memory_limit = 8M
to something higher. I'd start at 16M.
ah, found it yourself...good deal!
Thanks citizen_elah ... now I'm anxiously waiting for the graphs to populate. a little concerned because it's been 15 minutes and I've got nothing so far. I saw this populate in my error_log sh: /usr/local/rrdtool: is a directory
and i've verified that I have connectivity via snmp to the ltm. aargh!
Yeah my graphs are not showing up at all ... just have the link for the 6 graphs i've setup on a single device, and the 4 images next to the link for zoom, export, properties and page top. Anyone experienced something similar? Thanks.
So I've now got everything working now (finally!). The only issue I have left is TMM CPU & MEMORY utilization - those graphs are coming up empty. Anyone had this problem before?
there was a lot of tweaking necessary with the changes in snmp.php, but I'm still having trouble with the memory graphs. I've started a new thread if someone could give me some help please --
http://devcentral.f5.com/Default.aspx?tabid=53&forumid=32&postid=33625&view=topic
anyone else have this problem with the Memory Graphs?
03/04/2009 03:50:45 PM - CMDPHP: Poller[0] Host[5] DS[142] WARNING: Result from SERVER not valid. Partial Result: U
This is all running on RedHat Enterprise Server el5
rrdtool-1.2.30
cacti-0.8.7d
php-4.3.9-3.22.9
php-snmp-4.3.9-3.22.9
php-mysql-4.3.9-3.22.9
php-pear-4.3.9-3.22.9
Thanks.
If anyone else experiences this issue with 0.8.7d, download the "SNMP value trim issue" patch release on 3/2/2009.
http://www.cacti.net/download_patches.php
I've got an issue where certain OID's are returning 0. Specifically "F5 BigIP - Global HTTP Requests", "F5 BigIP - Global HTTP Response Errors", and "F5 BigIP - Global HTTP Responses". If I manually snmpget those OID's I can validate the "0" response:
[root@nms102 tmp]# snmpget -v 2c -c blah 10.70.1.57 .1.3.6.1.4.1.3375.2.1.1.2.4.7.0
SNMPv2-SMI::enterprises.3375.2.1.1.2.4.7.0 = Counter64: 0
[root@nms102 tmp]# snmpget -v 2c -c blah 10.70.1.57 .1.3.6.1.4.1.3375.2.1.1.2.4.5.0
SNMPv2-SMI::enterprises.3375.2.1.1.2.4.5.0 = Counter64: 0
[root@nms102 tmp]# snmpget -v 2c -c blah 10.70.1.57 .1.3.6.1.4.1.3375.2.1.1.2.4.6.0
SNMPv2-SMI::enterprises.3375.2.1.1.2.4.6.0 = Counter64: 0
Though there's plenty of traffic being handled. Any suggestions?
Do you have an http profile applied? I'm getting these returned just fine:
snmpget -v 2c -c public localhost .1.3.6.1.4.1.3375.2.1.1.2.4.7.0
F5-BIGIP-SYSTEM-MIB::sysHttpStatNumberReqs.0 = Counter64: 148
snmpget -v 2c -c public localhost .1.3.6.1.4.1.3375.2.1.1.2.4.5.0
F5-BIGIP-SYSTEM-MIB::sysHttpStatResp4xxCnt.0 = Counter64: 2
snmpget -v 2c -c public localhost .1.3.6.1.4.1.3375.2.1.1.2.4.6.0
F5-BIGIP-SYSTEM-MIB::sysHttpStatResp5xxCnt.0 = Counter64: 0
Question: Has anyone "truly" made the same thing for Pool Statistics as well. We use a lot of iRules under one VIP so, total connections there is nice, I need to see what a POOL or even a member is getting
Any good Tar'd up version iuth the Data_Query, Graph etc for this ?
@xerlic...yes, the latest version of the template includes pool statistics for both GTM & LTM. Not pool members, though. You can get the latest template on the wiki page at http://devcentral.f5.com/wiki/default.aspx/AdvDesignConfig/CactiF5HostTemplate.html
Has anyone extended this to show HTTP requests / sec for a pool? We have client API traffic I'm trying to monitor for HTTP requests per second and connections/sec isn't accurate for this because most of our clients are keeping a single connection open for the multiple requests.
For pool level HTTP stats, you'll need to build a stats profile and use an iRule to populate them. Then, you can poll the snmp oids for that profile. It's a complicated setup, but can be done.
@citizen_elah thanks for the info -- I was unaware of the existence of stats profiles. I dug around on the F5 and see it now. I also did some more digging with snmpwalk and noticed the F5s are keeping http stats per http profile. Ex: there's a ltmHttpProfileStatNumberReqs."http", ltmHttpProfileStatNumberReqs."http-lan-optimized-caching", ltmHttpProfileStatNumberReqs."http-wan-optimized-compression", etc. as well as the same for ltmFastHttpProfileStatNumberReqs."fasthttp". For the pools I want to track, I created new http profiles for use by the vservers using the pools, so now I have a ltmHttpProfileStatNumberReqs."http-api" and similar. Now I need to figure out how to add graphs for these to cacti -- I'm not much of a cacti expert. Anyway, mostly rambling to myself, but I thought someone else might find the tracking per http profile useful as well. I'm imagining it will save some overhead over using iRules to populate.
@ziuchkov - if you take a look at some of the articles/videos I've done on Cacti, you should get an idea how to approach it. Here's the Wiki page on the F5 cacti templates:
http://devcentral.f5.com/wiki/default.aspx/AdvDesignConfig/CactiF5HostTemplate.html
cool, but doesn't look much more granular than what's already available in the F5 Performance Stats? We're looking for a way to show the "top talkers" of SSL TPS (transactions/sec). Specifically, which VIP's are using most of the SSL connections? Anyone know if this is possible? Thanks!
@dkraut .. this would almost certainly need to be post analysis. You could do this with a reporting plugin which could rank your SSL TPS gaphs. Pretty rudimentary though.
Does this still apply to version 10? In version 9, it seemed to be working, but version 10 does not. Is there an updated template that I need to download?
The latest template in the wiki work great for me in v10:
http://devcentral.f5.com/wiki/default.aspx/AdvDesignConfig/CactiF5HostTemplate.html
I've updated the article to check the wiki page for the template since the original link is a couple years old now.
Thanks, I imported the new host templates but I still get nothing except for the Interfaces to collect. Is there anything else that needs to be updated from the older document to bring it to the present?
I don't believe any of the mibs have changed, I just cleaned up the templates and added a few things introduced in v10. Did you put the scripts in the correct directories with the necessary permissions? Since writing this article, CactiEZ is definitely the way to go to get off the ground running with a clean Cacti environment.
citizen_elah - did you find a hero? someone who found a way to index the pool name and loop through the pool members for data? i know it's like 2 years later but I just started writing iControl apps and just came across this article describing 'the use of wget' as a data method in place of SNMP - for basically the same reasons.
so i started thinking, "woah...if cacti supports http as the data input method, i should be able to use that some how with this iControl app, right?"
right!
so, i wrote an app that reads in a pool name from the URL, queries the LTM, runs through the pool building the array, then dumps it to the screen in the Cacti format needed...then I just graph it!
basically, if I have a web_pool with 192.168.1.1:801 and 192.168.1.2:802, where 801 has 23 conns and 802 has 15, then my app runs through that pool, grabs the counters, and then displays it to the screen like this:
19216811p801:23 19216812p802:15
then, from Cacti, I use
wget --quiet --no-cache -O - http://[server running my app]/default.aspx?pooldata=web_pool
to grab it!
it's completely changing the flexibility of what i can graph and how we look at 'what the LTM' is doing and, what's really cool, now, is I am can pull data from both sets of boxes in both of our data centers and merge the data into one graph - so I can get a 'total picture' of all web requests (for example) being handled in both data centers at the same time in one graph!
anyway, i am just looking on devcentral to see if anyone else has done this so I can contribute. This is the site that got me thinking about it:
http://penguinman-techtalk.blogspot.com/2009/03/cacti-graphing-remote-service-without.html
it might just be you...this is very intriguing. I don't have time to play yet, but I'm adding this to my list. Excellent work!
Is anyone successfully able to pull traffic and connection graphs for individual virtual servers? I keep getting the error "WARNING: Result from SNMP not valid. Partial Result: U" in my cacti log.
Hi,
I've created a new F5 BIG-IP template using the "F5_BigIP_v9-Host_Template-rev_7.zip" (thanks to Terje Gravvold, citizen_elah, BSOD2600 and matibut14) and other stuff I found on the Internet. I've also added many graphs and data queries (MultiHost CPU Statistics, Pool Statistics and Pool Member Statistics).
You can check it out and download it from the official cacti repository:
http://docs.cacti.net/usertemplate:host:f5:bigip
Best Regards
Youri