Learn F5 Technologies, Get Answers & Share Community Solutions Join DevCentral

Filter by:
  • Solution
  • Technology
Answers

redirect IIS 500 error to another host in pool

Hi expert,

I need help to configure my F5 LTM to redirect the connection to another host in the pool when one of the host/node in the pool have Image Textinternal server error 500. How can i redirect the request to another host in F5 LTM when hit this internal error?

Thanks

0
Rate this Question

Answers to this Question

placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER

Create a http monitor with alias port 80
send string:

GET / HTTP/1.1\r\nHost:<hostname of your website>\r\nConnection: Close\r\n\r\n

Receive string:

HTTP/1.[01] [23]0[0-6]

And enable it on your pool (please remove the other monitors)

Cheers,

Kees

0
Comments on this Answer
Comment made 1 day ago by Shamsul_Alam 12

You nailed it! Kees Thank you very much! It worked!

0
Comment made 1 day ago by Kees van den Bos | kees4IP 618

Your welcome!

0
placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER

Hi, if you set up an HTTP monitor to check for an HTTP status code of 200, any pool member serving a 500 will not be selected for load balancing

1
Comments on this Answer
Comment made 4 days ago by Shamsul_Alam 12

Right now i have two node (NODE1 and NODE2) and I'm monitoring https_443. Currently NODE2 having internal server error. I would like to send all the request to NODE1 until i resolve the issue on NODE2.

0
Comment made 4 days ago by MrPlastic 779

You'll need to modify the receive string to check response codes:

HTTP/1\.(0|1) (200|301|302)

This would permit HTTP 1.0 or 1.1 responses with a 200, 301 or 302 response code. Anything else will be marked down by the monitor. So in your instance, if a 500 code is returned by NODE2, the monitor would mark it down and serve traffic to NODE1 - providing it is returning a 200, 301 or 302

1
Comment made 3 days ago by Shamsul_Alam 12

I tried to add new monitor as below Image Text

It marked the node as down Image Text

Please help. No idea what going wrong here

0
Comment made 3 days ago by MrPlastic 779

Ok, could you issue this via the command line at your working host, replace NODE1 for the NODE1 IP address (if this is HTTPS only you will probably have to add a -k switch as you will get a certificate error)

curl -s -v NODE1 1> /dev/null

Let me know what the output says, it should print out header information so we know what status codes are being returned by the working node. Something like this:

* Rebuilt URL to: www.google.co.uk/
*   Trying 216.58.208.131...
* TCP_NODELAY set
* Connected to www.google.co.uk (216.58.208.131) port 80 (#0)
> GET / HTTP/1.1
> Host: www.google.co.uk
> User-Agent: curl/7.54.0
> Accept: */*
> 
< HTTP/1.1 200 OK

We can then test the response code as it is, rather than a regex sting, like is being used in the monitor. E.g, set the receive string to 200 OK

1
placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER

here is the output:

[root@f5:Active:Standalone] config # curl -s -v  172.16.5.76 1> /dev/null
* About to connect() to 172.16.5.76 port 80 (#0)
*   Trying 172.16.5.76... connected
* Connected to 172.16.5.76 (172.16.5.76) port 80 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 OpenSSL/1.0.1l zlib/1.2.3 libidn/1.18
> Host: 172.16.5.76
> Accept: */*
>
< HTTP/1.1 200 OK
< Content-Type: text/html
< Last-Modified: Thu, 13 Apr 2017 19:11:24 GMT
< Accept-Ranges: bytes
< ETag: "31cc9dbe89b4d21:0"
< Server: Microsoft-IIS/10.0
< X-Powered-By: ASP.NET
< Date: Wed, 15 Nov 2017 20:15:47 GMT
< Content-Length: 703
<
{ [data not shown]
* Connection #0 to host 172.16.5.76 left intact
0
Comments on this Answer
Comment made 3 days ago by MrPlastic 779

That looks fine. Try just putting 200 OK in the receive string. Any issues please output the tmsh/cli monitor config:

1
Comment made 3 days ago by MrPlastic 779

I've also spotted an issue with the original (regex) receive string, it had a missing escape character. I've tested it at https://regex101.com/ and your receive string should now work.

First - do a basic test put the following in for the receive string:

  • 200 OK

Once you're happy it's working, try the following as it is a more comprehensive string.

  • HTTP\/1\.(0|1) (200|301|302)

Below is a screenshot of successful regex test of the above string. Image Text

1
Comment made 3 days ago by Shamsul_Alam 12

Still failed. No clue what going wrong here.

My monitor setting as below: Image Text

Node setting Image Text

Pool setting Image Text

0
Comment made 2 days ago by MrPlastic 779

Could you change your node monitor to gateway_icmp and remove https_443 from the pool so you're only using the Check_header_200-OK monitor

1
Comment made 2 days ago by Shamsul_Alam 12

Still same after changed the setting as you requested

Monitor setting Image Text

POOL setting Image Text

0
Comment made 2 days ago by MrPlastic 779

Just noticed the Curl command you ran earlier is using TCP/80.

Could you create an HTTP (parent profile http) health monitor, first without a receive string. Then with the receive string.

Thanks

1
Comment made 2 days ago by Shamsul_Alam 12

Still same. Monitor for HTTP Image Text

Pool Image Text

0
Comment made 2 days ago by MrPlastic 779

please remove https from the active health monitors

0
placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER

If you want allow additional status codes 301 and 302, you could do it as below in the receive string.

(200 OK|301|302)
0
Comments on this Answer
Comment made 3 days ago by Shamsul_Alam 12

I tried you suggestion but still not working. LTM marked node as down.

0
placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER

You need specify the HTTP version in your send string if your backend does not support HTTP/0.9:

GET / HTTP/1.0\r\n\r\n

.

0
Comments on this Answer
Comment made 2 days ago by Shamsul_Alam 12

Still same error although i set send string as you advice.

Image Text

Pool Image Text

0
Comment made 2 days ago by MrPlastic 779

Does the health monitor work without the receive string? Please could you paste the output of the following commands:

tmsh list ltm monitor http (your-monitor-name)

tmsh list ltm pool (your-pool-name)

1
Comment made 2 days ago by Shamsul_Alam 12

tmsh list ltm monitor http

Image Text

tmsh list ltm pool Image Text

0
Comment made 2 days ago by MrPlastic 779

Your cURL request, which responded with a 200 OK went to HTTP, not HTTPS yet your pool is configured on port 443. Could you change the pool so that is using HTTP, and not HTTPS

0
Comment made 1 day ago by Shamsul_Alam 12

As you requested i changed the pool setting to http

Image Text

Image Text

Image Text

Image Text

0
Comment made 1 day ago by MrPlastic 779

You should only have one monitor in the pool, otherwise the pool (by default) will require all monitors are reporting up.

Please just have the http_200_OK monitor selected in your pool

I presume this is working ok with just the default http monitor ?

0
Comment made 1 day ago by Shamsul_Alam 12

It only work with default https_443.

The issue still persist even though I used http_200_OK only.

Image Text

0
Comment made 1 day ago by MrPlastic 779

Your cURL request also used HTTP 1.1 - you can use an HTTP 1.1 compliant GET request like the one below:

GET / HTTP/1.1\\r\\nHost: dummy.host.local\\r\\nConnection: Close\\r\\n\\r\\n

0
Comment made 1 day ago by Shamsul_Alam 12

Still same. No progress

Image Text

Image Text

0
Comment made 1 day ago by MrPlastic 779

If it only works with a default http_443 monitor, could you test with this cURL string:

curl -s -v -k https://172.16.5.76 1> /dev/null

curl -s -v -k https://172.16.5.77 1> /dev/null

0
Comment made 1 day ago by Shamsul_Alam 12
[root@f5:Active:Standalone] log # curl -s -v -k  https://172.16.5.76 1> /dev/null
* About to connect() to 172.16.5.76 port 443 (#0)
*   Trying 172.16.5.76... connected
* Connected to 172.16.5.76 (172.16.5.76) port 443 (#0)
* successfully set certificate verify locations:
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* SSLv3, TLS handshake, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Server hello (2):
{ [data not shown]
* SSLv3, TLS handshake, CERT (11):
{ [data not shown]
* SSLv3, TLS handshake, Server key exchange (12):
{ [data not shown]
* SSLv3, TLS handshake, Server finished (14):
{ [data not shown]
* SSLv3, TLS handshake, Client key exchange (16):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Finished (20):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
{ [data not shown]
* SSLv3, TLS handshake, Finished (20):
{ [data not shown]
* SSL connection using ECDHE-RSA-AES256-GCM-SHA384
* Server certificate:
*        SSL certificate verify ok.
> GET / HTTP/1.1
> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 OpenSSL/1.0.1l zlib/1.2.3 libidn/1.18
> Host: 172.16.5.76
> Accept: */*
>
< HTTP/1.1 302 Found
< Cache-Control: no-cache
< Pragma: no-cache
< Content-Type: text/html; charset=utf-8
< Expires: -1
< Location: /signin/?returnurl=%2F
< Server: Microsoft-IIS/10.0
< X-AspNet-Version: 4.0.30319
< Set-Cookie: anonprofile=jrMJR2yo50qSkxwFlcnnLfdzkwBkfcqs4LByzSilUjvuvCb0VUSGRzNxNgvoYJeaq2I_TJFu9hAQliI5nsSmiMiK7qacWOFcvGuNkY3865J6oBGGS56zWxGaSd96SzjSw-UfzpNDmxbSeT2AEYW0lJDjHVB9ChTYPGrO2eRzi7ygowSL0; expires=Sun, 17-Dec-2017 18:16:42 GMT; path=/; HttpOnly
< Set-Cookie: ASP.NET_SessionId=easjn01lzqu3wdmcl5taxq2h; path=/; HttpOnly
< X-Powered-By: ASP.NET
< Date: Fri, 17 Nov 2017 18:16:42 GMT
< Content-Length: 139
<
{ [data not shown]
* Connection #0 to host 172.16.5.76 left intact
* Closing connection #0
* SSLv3, TLS alert, Client hello (1):
} [data not shown]
0
Comment made 1 day ago by Shamsul_Alam 12
[root@f5:Active:Standalone] log # curl -s -v -k  https://172.16.5.77 1> /dev/null
* About to connect() to 172.16.5.77 port 443 (#0)
*   Trying 172.16.5.77... connected
* Connected to 172.16.5.77 (172.16.5.77) port 443 (#0)
* successfully set certificate verify locations:
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* SSLv3, TLS handshake, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Server hello (2):
{ [data not shown]
* SSLv3, TLS handshake, CERT (11):
{ [data not shown]
* SSLv3, TLS handshake, Server key exchange (12):
{ [data not shown]
* SSLv3, TLS handshake, Server finished (14):
{ [data not shown]
* SSLv3, TLS handshake, Client key exchange (16):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
} [data not shown]
* SSLv3, TLS handshake, Finished (20):
} [data not shown]
* SSLv3, TLS change cipher, Client hello (1):
{ [data not shown]
* SSLv3, TLS handshake, Finished (20):
{ [data not shown]
* SSL connection using ECDHE-RSA-AES256-GCM-SHA384
> GET / HTTP/1.1
> User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 OpenSSL/1.0.1l zlib/1.2.3 libidn/1.18
> Host: 172.16.5.77
> Accept: */*
>
< HTTP/1.1 302 Found
< Cache-Control: no-cache
< Pragma: no-cache
< Content-Type: text/html; charset=utf-8
< Expires: -1
< Location: /signin/?returnurl=%2F
< Server: Microsoft-IIS/10.0
< X-AspNet-Version: 4.0.30319
< Set-Cookie: anonprofile=uKaoZDnaVkA5uc5cbZExBQFVaCrpQKMc2AC4in7b-sHf2wfbYHy3SfBrmjK00TMav5jOs2b27BqvBFNN1hFuMIro7uJJyG5AnfgjnS12HRRF79TlOH5-1tmXZs1Ibijzdw8D22xjtXPrZ4RMZlytMFQPu_YZg1G8BlzcKMeWIpfp-SIG0; expires=Sun, 17-Dec-2017 18:16:50 GMT; path=/; HttpOnly
< Set-Cookie: ASP.NET_SessionId=lsdr1tc4th4zci1cih4aw1qu; path=/; HttpOnly
< X-Powered-By: ASP.NET
< Date: Fri, 17 Nov 2017 18:16:50 GMT
< Content-Length: 139
<
{ [data not shown]
* Connection #0 to host 172.16.5.77 left intact
* Closing connection #0
* SSLv3, TLS alert, Client hello (1):
} [data not shown]
0
Comment made 1 day ago by MrPlastic 779

It's not working because it's returning a 302 redirect

HTTP/1.1 302 Found

Are you using the correct URI/location in the GET request?

The following receive string includes 302 response codes which may mark the pool up but won't address the reason for the redirect.

HTTP\/1\.(0|1) (200|301|302)

0
Comment made 1 day ago by Shamsul_Alam 12

Thank you very much MrPlaster! I really appreciate your help. You were helping me since 3days ago. Issue resolved.

Thank a million!

0
placeholder+image
USER ACCEPTED ANSWER & F5 ACCEPTED ANSWER
Comments on this Answer
Comment made 2 days ago by Shamsul_Alam 12
[0][7630] 2017-11-17 07:33:06.927012: ID 149   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51149 ]
[0][7630] 2017-11-17 07:33:06.927055: ID 149   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51149 ]
[0][7630] 2017-11-17 07:33:06.927071: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51149 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:06.927099: ID 149   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:06.927110: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51149 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:06.927318: ID global:(_epoll_del): Event deleted [fd=15]
[0][7630] 2017-11-17 07:33:06.927555: ID 149   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.76:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:06.927585: ID 149   :(adjust_deadline): from [1510932802.875217][2017-11-17 07:33:22] to [1510932807.875217][2017-11-17 07:33:27] [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.875217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932807.875217][2017-11-17 07:33:27] on_service_list=True snd_cnt=15822 rcv_cnt=15821 ]
[0][7630] 2017-11-17 07:33:06.927611: ID 149   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.76:443 srcaddr=none mon=/Common/https_443 snd_cnt=15822 rcv_cnt=15821 ]
[0][7630] 2017-11-17 07:33:09.308063: ID 168   :(_do_ping): time to ping, now=[1510932789.308032][2017-11-17 07:33:09], status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932789.300217][2017-11-17 07:33:09] last_ping=[1510932784.352166][2017-11-17 07:33:04] deadline=[1510932789.053948][2017-11-17 07:33:09] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.308104: ID 168   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ]
[0][7630] 2017-11-17 07:33:09.308123: ID 168   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ] send=GET / HTTP/1.0\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:09.308174: ID 168   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932789.300217][2017-11-17 07:33:09] last_ping=[1510932784.352166][2017-11-17 07:33:04] deadline=[1510932789.053948][2017-11-17 07:33:09] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.308204: ID 168   :(_do_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.300217][2017-11-17 07:33:14] last_ping=[1510932789.308032][2017-11-17 07:33:09] deadline=[1510932789.053948][2017-11-17 07:33:09] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.407474: ID 169   :(adjust_deadline): from [1510932789.053948][2017-11-17 07:33:09] to [1510932794.407444][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.800217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.407514: ID 169   :(_analyze_pings): visit DOWN, now=[1510932789.407444][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.800217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.407553: ID 168   :(adjust_deadline): from [1510932789.053948][2017-11-17 07:33:09] to [1510932794.407444][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.300217][2017-11-17 07:33:14] last_ping=[1510932789.308032][2017-11-17 07:33:09] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.407582: ID 168   :(_analyze_pings): visit DOWN, now=[1510932789.407444][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.300217][2017-11-17 07:33:14] last_ping=[1510932789.308032][2017-11-17 07:33:09] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:09.407633: ID 150   :(_do_ping): time to ping, now=[1510932789.407619][2017-11-17 07:33:09], status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932789.375217][2017-11-17 07:33:09] last_ping=[1510932784.455280][2017-11-17 07:33:04] deadline=[1510932805.375217][2017-11-17 07:33:25] on_service_list=True snd_cnt=13866 rcv_cnt=13866 ]
[0][7630] 2017-11-17 07:33:09.407659: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:09.407668: ID 150   :(_connect_to_service): creating new socket (rd0) [ addr=::ffff:172.16.5.77:443 ]
[0][7630] 2017-11-17 07:33:09.408091: ID 150   :(_connect_to_service): connect: Operation now in progress [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.408122: ID global:(_epoll_add): Event registered [fd=15, op=1]
[0][7630] 2017-11-17 07:33:09.408154: ID 150   :(_do_ping): post ping, status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=15 pend=1 #conn=1 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.375217][2017-11-17 07:33:14] last_ping=[1510932789.407619][2017-11-17 07:33:09] deadline=[1510932805.375217][2017-11-17 07:33:25] on_service_list=True snd_cnt=13867 rcv_cnt=13866 ]
[0][7630] 2017-11-17 07:33:09.410809: ID 150   :(_main_loop): Activity on pending service, now=[1510932789.410787][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 fd=15 pend=1 #conn=1 ]
[0][7630] 2017-11-17 07:33:09.410836: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.410856: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:09.410871: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:09.410887: ID 150   :(do_ssl_write): incoming state: 0 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.411325: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.411354: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:09.416233: ID 150   :(_main_loop): Service ready for read, now=[1510932789.416210][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:09.416260: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.416275: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.416287: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.416298: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:09.416313: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.421787: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.426081: ID 150   :(_main_loop): Service ready for read, now=[1510932789.426059][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:09.426255: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.426380: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.426500: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.426618: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:09.426741: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.427022: ID 150   :(do_ssl_write): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.427169: ID 150   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=15 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.375217][2017-11-17 07:33:14] last_ping=[1510932789.407619][2017-11-17 07:33:09] deadline=[1510932805.375217][2017-11-17 07:33:25] on_service_list=True snd_cnt=13867 rcv_cnt=13866 ]
[0][7630] 2017-11-17 07:33:09.458086: ID 150   :(_main_loop): Service ready for read, now=[1510932789.458063][2017-11-17 07:33:09] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:09.458284: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.458403: ID 150   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.458543: ID 150   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 ]
[0][7630] 2017-11-17 07:33:09.458714: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:09.458858: ID 150   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:09.458996: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44459 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:09.459200: ID global:(_epoll_del): Event deleted [fd=15]
[0][7630] 2017-11-17 07:33:09.459431: ID 150   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:09.459558: ID 150   :(adjust_deadline): from [1510932805.375217][2017-11-17 07:33:25] to [1510932810.375217][2017-11-17 07:33:30] [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.375217][2017-11-17 07:33:14] last_ping=[1510932789.407619][2017-11-17 07:33:09] deadline=[1510932810.375217][2017-11-17 07:33:30] on_service_list=True snd_cnt=13867 rcv_cnt=13866 ]
[0][7630] 2017-11-17 07:33:09.459731: ID 150   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.77:443 srcaddr=none mon=/Common/https_443 snd_cnt=13867 rcv_cnt=13866 ]
[0][7630] 2017-11-17 07:33:11.839898: ID 169   :(_do_ping): time to ping, now=[1510932791.839867][2017-11-17 07:33:11], status=DOWN [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.800217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:11.839937: ID 169   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44457 ]
[0][7630] 2017-11-17 07:33:11.839956: ID 169   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44457 ] send=GET / HTTP/1.0\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:11.839987: ID 169   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.800217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=129 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:11.840016: ID 169   :(_do_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.800217][2017-11-17 07:33:16] last_ping=[1510932791.839867][2017-11-17 07:33:11] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:11.939210: ID 149   :(_do_ping): time to ping, now=[1510932791.939187][2017-11-17 07:33:11], status=UP [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932791.875217][2017-11-17 07:33:11] last_ping=[1510932786.883982][2017-11-17 07:33:06] deadline=[1510932807.875217][2017-11-17 07:33:27] on_service_list=True snd_cnt=15822 rcv_cnt=15822 ]
[0][7630] 2017-11-17 07:33:11.939245: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:11.939255: ID 149   :(_connect_to_service): creating new socket (rd0) [ addr=::ffff:172.16.5.76:443 ]
[0][7630] 2017-11-17 07:33:11.939321: ID 149   :(_connect_to_service): connect: Operation now in progress [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.939344: ID global:(_epoll_add): Event registered [fd=15, op=1]
[0][7630] 2017-11-17 07:33:11.939356: ID 149   :(_do_ping): post ping, status=UP [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=15 pend=1 #conn=1 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.875217][2017-11-17 07:33:16] last_ping=[1510932791.939187][2017-11-17 07:33:11] deadline=[1510932807.875217][2017-11-17 07:33:27] on_service_list=True snd_cnt=15823 rcv_cnt=15822 ]
[0][7630] 2017-11-17 07:33:11.941813: ID 149   :(_main_loop): Activity on pending service, now=[1510932791.941793][2017-11-17 07:33:11] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 fd=15 pend=1 #conn=1 ]
[0][7630] 2017-11-17 07:33:11.941838: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.941857: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:11.941871: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:11.941887: ID 149   :(do_ssl_write): incoming state: 0 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.942296: ID 149   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.942320: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:11.947250: ID 149   :(_main_loop): Service ready for read, now=[1510932791.947230][2017-11-17 07:33:11] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:11.947272: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.947286: ID 149   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.947298: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.947309: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:11.947323: ID 149   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.952810: ID 149   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.955979: ID 149   :(_main_loop): Service ready for read, now=[1510932791.955959][2017-11-17 07:33:11] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:11.956109: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.956258: ID 149   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.956410: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.956529: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:11.956652: ID 149   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.956900: ID 149   :(do_ssl_write): state: 3 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.957029: ID 149   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=15 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.875217][2017-11-17 07:33:16] last_ping=[1510932791.939187][2017-11-17 07:33:11] deadline=[1510932807.875217][2017-11-17 07:33:27] on_service_list=True snd_cnt=15823 rcv_cnt=15822 ]
[0][7630] 2017-11-17 07:33:11.980647: ID 149   :(_main_loop): Service ready for read, now=[1510932791.980625][2017-11-17 07:33:11] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:11.980787: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.980946: ID 149   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.981087: ID 149   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 ]
[0][7630] 2017-11-17 07:33:11.981233: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:11.981421: ID 149   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:11.981560: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51153 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:11.981750: ID global:(_epoll_del): Event deleted [fd=15]
[0][7630] 2017-11-17 07:33:11.981979: ID 149   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.76:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:11.982118: ID 149   :(adjust_deadline): from [1510932807.875217][2017-11-17 07:33:27] to [1510932812.875217][2017-11-17 07:33:32] [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.875217][2017-11-17 07:33:16] last_ping=[1510932791.939187][2017-11-17 07:33:11] deadline=[1510932812.875217][2017-11-17 07:33:32] on_service_list=True snd_cnt=15823 rcv_cnt=15822 ]
[0][7630] 2017-11-17 07:33:11.982274: ID 149   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.76:443 srcaddr=none mon=/Common/https_443 snd_cnt=15823 rcv_cnt=15822 ]
[0][7630] 2017-11-17 07:33:13.668502: service load score:        0        0,        12,       4,       16       18
[0][7630] 2017-11-17 07:33:14.363119: ID 168   :(_do_ping): time to ping, now=[1510932794.363087][2017-11-17 07:33:14], status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.300217][2017-11-17 07:33:14] last_ping=[1510932789.308032][2017-11-17 07:33:09] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.363365: ID 168   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ]
[0][7630] 2017-11-17 07:33:14.363564: ID 168   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ] send=GET / HTTP/1.0\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:14.363770: ID 168   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.300217][2017-11-17 07:33:14] last_ping=[1510932789.308032][2017-11-17 07:33:09] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.363940: ID 168   :(_do_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.300217][2017-11-17 07:33:19] last_ping=[1510932794.363087][2017-11-17 07:33:14] deadline=[1510932794.407444][2017-11-17 07:33:14] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.462333: ID 150   :(_do_ping): time to ping, now=[1510932794.462310][2017-11-17 07:33:14], status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932794.375217][2017-11-17 07:33:14] last_ping=[1510932789.407619][2017-11-17 07:33:09] deadline=[1510932810.375217][2017-11-17 07:33:30] on_service_list=True snd_cnt=13867 rcv_cnt=13867 ]
[0][7630] 2017-11-17 07:33:14.462518: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:14.462691: ID 150   :(_connect_to_service): creating new socket (rd0) [ addr=::ffff:172.16.5.77:443 ]
[0][7630] 2017-11-17 07:33:14.462920: ID 150   :(_connect_to_service): connect: Operation now in progress [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.463085: ID global:(_epoll_add): Event registered [fd=15, op=1]
[0][7630] 2017-11-17 07:33:14.463235: ID 150   :(_do_ping): post ping, status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=15 pend=1 #conn=1 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.375217][2017-11-17 07:33:19] last_ping=[1510932794.462310][2017-11-17 07:33:14] deadline=[1510932810.375217][2017-11-17 07:33:30] on_service_list=True snd_cnt=13868 rcv_cnt=13867 ]
[0][7630] 2017-11-17 07:33:14.465945: ID 150   :(_main_loop): Activity on pending service, now=[1510932794.465922][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 fd=15 pend=1 #conn=1 ]
[0][7630] 2017-11-17 07:33:14.466088: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.466228: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:14.466347: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:14.466507: ID 150   :(do_ssl_write): incoming state: 0 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.466799: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.466933: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:14.471871: ID 150   :(_main_loop): Service ready for read, now=[1510932794.471849][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:14.472011: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.472150: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.472273: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.472401: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:14.472523: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.478124: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.482174: ID 150   :(_main_loop): Service ready for read, now=[1510932794.482155][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:14.482339: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.482454: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.482578: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.482698: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:14.482819: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.483065: ID 150   :(do_ssl_write): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.483245: ID 150   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=15 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.375217][2017-11-17 07:33:19] last_ping=[1510932794.462310][2017-11-17 07:33:14] deadline=[1510932810.375217][2017-11-17 07:33:30] on_service_list=True snd_cnt=13868 rcv_cnt=13867 ]
[0][7630] 2017-11-17 07:33:14.512164: ID 150   :(_main_loop): Service ready for read, now=[1510932794.512143][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:14.512291: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.512468: ID 150   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.512652: ID 150   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 ]
[0][7630] 2017-11-17 07:33:14.512779: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:14.512926: ID 150   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:14.513065: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44463 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:14.513306: ID global:(_epoll_del): Event deleted [fd=15]
[0][7630] 2017-11-17 07:33:14.513535: ID 150   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:14.513678: ID 150   :(adjust_deadline): from [1510932810.375217][2017-11-17 07:33:30] to [1510932815.375217][2017-11-17 07:33:35] [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.375217][2017-11-17 07:33:19] last_ping=[1510932794.462310][2017-11-17 07:33:14] deadline=[1510932815.375217][2017-11-17 07:33:35] on_service_list=True snd_cnt=13868 rcv_cnt=13867 ]
[0][7630] 2017-11-17 07:33:14.513814: ID 150   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.77:443 srcaddr=none mon=/Common/https_443 snd_cnt=13868 rcv_cnt=13867 ]
[0][7630] 2017-11-17 07:33:14.712308: ID 168   :(adjust_deadline): from [1510932794.407444][2017-11-17 07:33:14] to [1510932799.712277][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.300217][2017-11-17 07:33:19] last_ping=[1510932794.363087][2017-11-17 07:33:14] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.712587: ID 168   :(_analyze_pings): visit DOWN, now=[1510932794.712277][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.300217][2017-11-17 07:33:19] last_ping=[1510932794.363087][2017-11-17 07:33:14] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.712749: ID 169   :(adjust_deadline): from [1510932794.407444][2017-11-17 07:33:14] to [1510932799.712277][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.800217][2017-11-17 07:33:16] last_ping=[1510932791.839867][2017-11-17 07:33:11] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:14.712890: ID 169   :(_analyze_pings): visit DOWN, now=[1510932794.712277][2017-11-17 07:33:14] [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.800217][2017-11-17 07:33:16] last_ping=[1510932791.839867][2017-11-17 07:33:11] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:16.895332: ID 169   :(_do_ping): time to ping, now=[1510932796.895271][2017-11-17 07:33:16], status=DOWN [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.800217][2017-11-17 07:33:16] last_ping=[1510932791.839867][2017-11-17 07:33:11] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:16.895595: ID 169   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44457 ]
[0][7630] 2017-11-17 07:33:16.895785: ID 169   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44457 ] send=GET / HTTP/1.0\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:16.895941: ID 169   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.800217][2017-11-17 07:33:16] last_ping=[1510932791.839867][2017-11-17 07:33:11] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=130 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:16.896092: ID 169   :(_do_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.77:443 mon=/Common/http_200_OK fd=14 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932801.800217][2017-11-17 07:33:21] last_ping=[1510932796.895271][2017-11-17 07:33:16] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:16.896269: ID 149   :(_do_ping): time to ping, now=[1510932796.895271][2017-11-17 07:33:16], status=UP [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932796.875217][2017-11-17 07:33:16] last_ping=[1510932791.939187][2017-11-17 07:33:11] deadline=[1510932812.875217][2017-11-17 07:33:32] on_service_list=True snd_cnt=15823 rcv_cnt=15823 ]
[0][7630] 2017-11-17 07:33:16.896436: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:16.896539: ID 149   :(_connect_to_service): creating new socket (rd0) [ addr=::ffff:172.16.5.76:443 ]
[0][7630] 2017-11-17 07:33:16.896706: ID 149   :(_connect_to_service): connect: Operation now in progress [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.896837: ID global:(_epoll_add): Event registered [fd=15, op=1]
[0][7630] 2017-11-17 07:33:16.896950: ID 149   :(_do_ping): post ping, status=UP [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=15 pend=1 #conn=1 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932801.875217][2017-11-17 07:33:21] last_ping=[1510932796.895271][2017-11-17 07:33:16] deadline=[1510932812.875217][2017-11-17 07:33:32] on_service_list=True snd_cnt=15824 rcv_cnt=15823 ]
[0][7630] 2017-11-17 07:33:16.900523: ID 149   :(_main_loop): Activity on pending service, now=[1510932796.900501][2017-11-17 07:33:16] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 fd=15 pend=1 #conn=1 ]
[0][7630] 2017-11-17 07:33:16.900662: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.900790: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:16.900909: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:16.901033: ID 149   :(do_ssl_write): incoming state: 0 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.901368: ID 149   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.901543: ID global:(_epoll_add): Event registered [fd=15, op=3]
[0][7630] 2017-11-17 07:33:16.906173: ID 149   :(_main_loop): Service ready for read, now=[1510932796.906150][2017-11-17 07:33:16] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:16.906315: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.906436: ID 149   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.906555: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.906673: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:16.906793: ID 149   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.912400: ID 149   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.915757: ID 149   :(_main_loop): Service ready for read, now=[1510932796.915736][2017-11-17 07:33:16] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:16.915880: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.916002: ID 149   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.916166: ID 149   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.916287: ID 149   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:16.916415: ID 149   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.916663: ID 149   :(do_ssl_write): state: 3 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.916795: ID 149   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=15 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932801.875217][2017-11-17 07:33:21] last_ping=[1510932796.895271][2017-11-17 07:33:16] deadline=[1510932812.875217][2017-11-17 07:33:32] on_service_list=True snd_cnt=15824 rcv_cnt=15823 ]
[0][7630] 2017-11-17 07:33:16.940399: ID 149   :(_main_loop): Service ready for read, now=[1510932796.940376][2017-11-17 07:33:16] [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 fd=15 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:16.940610: ID 149   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.940717: ID 149   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.940758: ID 149   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 ]
[0][7630] 2017-11-17 07:33:16.940774: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:16.940802: ID 149   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:16.940813: ID 149   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51155 mon=/Common/https_443 fd=15 ]
[0][7630] 2017-11-17 07:33:16.940890: ID global:(_epoll_del): Event deleted [fd=15]
[0][7630] 2017-11-17 07:33:16.941417: ID 149   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.76:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:16.941555: ID 149   :(adjust_deadline): from [1510932812.875217][2017-11-17 07:33:32] to [1510932817.875217][2017-11-17 07:33:37] [ addr=::ffff:172.16.5.76:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932801.875217][2017-11-17 07:33:21] last_ping=[1510932796.895271][2017-11-17 07:33:16] deadline=[1510932817.875217][2017-11-17 07:33:37] on_service_list=True snd_cnt=15824 rcv_cnt=15823 ]
[0][7630] 2017-11-17 07:33:16.941696: ID 149   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.76:443 srcaddr=none mon=/Common/https_443 snd_cnt=15824 rcv_cnt=15823 ]
[0][7630] 2017-11-17 07:33:19.322201: ID 168   :(_do_ping): time to ping, now=[1510932799.322171][2017-11-17 07:33:19], status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.300217][2017-11-17 07:33:19] last_ping=[1510932794.363087][2017-11-17 07:33:14] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:19.322445: ID 168   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ]
[0][7630] 2017-11-17 07:33:19.322472: ID 168   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ] send=GET / HTTP/1.0\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:19.322511: ID 168   :(_send_active_service_ping): unable to connect; giving up [ addr=::ffff:172.16.5.76:443 srcaddr=::ffff:172.16.5.39%0:51146 ]
[0][7630] 2017-11-17 07:33:19.322529: ID global:(_epoll_del): Event deleted [fd=13]
[0][7630] 2017-11-17 07:33:19.322551: ID 168   :(_send_active_service_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.300217][2017-11-17 07:33:19] last_ping=[1510932794.363087][2017-11-17 07:33:14] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=131 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:19.322579: ID 168   :(_do_ping): post ping, status=DOWN [ addr=::ffff:172.16.5.76:443 mon=/Common/http_200_OK fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932804.300217][2017-11-17 07:33:24] last_ping=[1510932799.322171][2017-11-17 07:33:19] deadline=[1510932799.712277][2017-11-17 07:33:19] on_service_list=True snd_cnt=132 rcv_cnt=0 ]
[0][7630] 2017-11-17 07:33:19.421954: ID 150   :(_do_ping): time to ping, now=[1510932799.421932][2017-11-17 07:33:19], status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932799.375217][2017-11-17 07:33:19] last_ping=[1510932794.462310][2017-11-17 07:33:14] deadline=[1510932815.375217][2017-11-17 07:33:35] on_service_list=True snd_cnt=13868 rcv_cnt=13868 ]
[0][7630] 2017-11-17 07:33:19.422114: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:19.422251: ID 150   :(_connect_to_service): creating new socket (rd0) [ addr=::ffff:172.16.5.77:443 ]
[0][7630] 2017-11-17 07:33:19.422460: ID 150   :(_connect_to_service): connect: Operation now in progress [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.422592: ID global:(_epoll_add): Event registered [fd=13, op=1]
[0][7630] 2017-11-17 07:33:19.422707: ID 150   :(_do_ping): post ping, status=UP [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=13 pend=1 #conn=1 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932804.375217][2017-11-17 07:33:24] last_ping=[1510932799.421932][2017-11-17 07:33:19] deadline=[1510932815.375217][2017-11-17 07:33:35] on_service_list=True snd_cnt=13869 rcv_cnt=13868 ]
[0][7630] 2017-11-17 07:33:19.426572: ID 150   :(_main_loop): Activity on pending service, now=[1510932799.426550][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 fd=13 pend=1 #conn=1 ]
[0][7630] 2017-11-17 07:33:19.426716: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.426844: ID global:(_epoll_add): Event registered [fd=13, op=3]
[0][7630] 2017-11-17 07:33:19.426962: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:19.427086: ID 150   :(do_ssl_write): incoming state: 0 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.427419: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.427561: ID global:(_epoll_add): Event registered [fd=13, op=3]
[0][7630] 2017-11-17 07:33:19.432085: ID 150   :(_main_loop): Service ready for read, now=[1510932799.432064][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 fd=13 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:19.432240: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.432362: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.432480: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.432597: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:19.432727: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.440225: ID 150   :(do_ssl_write): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.443997: ID 150   :(_main_loop): Service ready for read, now=[1510932799.443976][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 fd=13 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:19.444150: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.444299: ID 150   :(do_ssl_read): state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.444410: ID 150   :(_send_active_service_ping): pinging [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.444526: ID 150   :(_send_active_service_ping): writing [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ] send=GET /\x0d\x0a\x0d\x0a
[0][7630] 2017-11-17 07:33:19.444659: ID 150   :(do_ssl_write): incoming state: 4 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.444909: ID 150   :(do_ssl_write): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.445040: ID 150   :(_send_active_service_ping): sent ping [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=13 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932804.375217][2017-11-17 07:33:24] last_ping=[1510932799.421932][2017-11-17 07:33:19] deadline=[1510932815.375217][2017-11-17 07:33:35] on_service_list=True snd_cnt=13869 rcv_cnt=13868 ]
[0][7630] 2017-11-17 07:33:19.470294: ID 150   :(_main_loop): Service ready for read, now=[1510932799.470272][2017-11-17 07:33:19] [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 fd=13 pend=0 #conn=0 ]
[0][7630] 2017-11-17 07:33:19.470544: ID 150   :(_recv_active_service_ping): reading [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.470671: ID 150   :(do_ssl_read): state: 3 [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.470813: ID 150   :(_recv_active_service_ping): rcvd 139 bytes: --><html><head><title>Object moved</title></head><body>\x0d\x0a<h2>Object moved to <a href="/signin/?returnurl=%2F">here</a>.</h2>\x0d\x0a</body></html>\x0d\x0a<-- [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 ]
[0][7630] 2017-11-17 07:33:19.470939: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 mon=/Common/https_443 fd=13 ]
[0][7630] 2017-11-17 07:33:19.471078: ID 150   :(_ssl_shutdown_service_internal): recurse from 552
[ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 ]
[0][7630] 2017-11-17 07:33:19.471237: ID 150   :(_ssl_shutdown_service): shutting down, return ssl true [ addr=::ffff:172.16.5.77:443 srcaddr=::ffff:172.16.5.39%0:44467 mon=/Common/https_443 fd=13 ]
[0][7630] 2017-11-17 07:33:19.471457: ID global:(_epoll_del): Event deleted [fd=13]
[0][7630] 2017-11-17 07:33:19.471593: ID 150   :(_recv_active_service_ping): got data [ addr=::ffff:172.16.5.77:443 srcaddr=none ]
[0][7630] 2017-11-17 07:33:19.471737: ID 150   :(adjust_deadline): from [1510932815.375217][2017-11-17 07:33:35] to [1510932820.375217][2017-11-17 07:33:40] [ addr=::ffff:172.16.5.77:443 mon=/Common/https_443 fd=-1 pend=0 #conn=0 up_intvl=5 dn_intvl=5 timeout=16 time_until_up=0 immed=0 next_ping=[1510932804.375217][2017-11-17 07:33:24] last_ping=[1510932799.421932][2017-11-17 07:33:19] deadline=[1510932820.375217][2017-11-17 07:33:40] on_service_list=True snd_cnt=13869 rcv_cnt=13868 ]
[0][7630] 2017-11-17 07:33:19.471865: ID 150   :(_response_success): node was up and is still up [ addr=::ffff:172.16.5.77:443 srcaddr=none mon=/Common/https_443 snd_cnt=13869 rcv_cnt=13868 ]
^C
0