I added some additional logging to confirm the same server is being selected, even though there are 15 other servers that could be tried:
Jul 10 12:08:01 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:02 tmm tmm[11686]: 01220002: repeated 2 times
Jul 10 12:08:03 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : jsessionID GylyPWny1tJKRwp1jlvvd3Kp5DH CYThCcJS2Y2JrlNhrMtB6GcJG sent to 10.28.199.183
Jul 10 12:08:03 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:03 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : jsessionID GylyPWny1tJKRwp1jlvvd3Kp5DH CYThCcJS2Y2JrlNhrMtB6GcJG sent to 10.28.199.183
Jul 10 12:08:03 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:06 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : jsessionID GylyPWny1tJKRwp1jlvvd3Kp5DH CYThCcJS2Y2JrlNhrMtB6GcJG sent to 10.28.199.183
Jul 10 12:08:06 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:07 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:07 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:07 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:07 tmm tmm[11686]: 01220002:6: Rule intres_prod-rule : server reselected 10.28.199.183
Jul 10 12:08:08 tmm tmm[11686]: 01220002: repeated 47 times
I would imagine the above HTTP_REQUEST events are client retries, not events retriggered by the LB::reselect, correct? How do I get it to reselect another server?
Also, I though once a node was marked down anything in the session table associated to that node was flushed?