Ok, so one question, it looks like all the health checks, and traffic out to the EC2 nodes is using the MGMT interface on eth0, not the self Ip, is that correct, should it use the SelfIP instead?
I ran the tcpdump on the eth0 interface and looking for one of my external node IPs, and here is what I got back. The 172.18.0.18 is my MGMT address on eth0 and the 184.73.230.13 is the external IP of my EC2 instance:
15:54:54.303532 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: S 1099469672:1099469672(0) win 5840
15:54:54.313691 IP 184.73.230.13.etlservicemgr > 172.18.0.18.40241: S 1751514931:1751514931(0) ack 1099469673 win 5792
15:54:54.313760 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: . ack 1 win 46
15:54:54.314159 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: P 1:10(9) ack 1 win 46
15:54:54.324281 IP 184.73.230.13.etlservicemgr > 172.18.0.18.40241: . ack 10 win 46
15:54:54.326633 IP 184.73.230.13.etlservicemgr > 172.18.0.18.40241: P 1:953(952) ack 10 win 46
15:54:54.326653 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: . ack 953 win 61
15:54:54.326762 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: F 10:10(0) ack 953 win 61
15:54:54.327099 IP 184.73.230.13.etlservicemgr > 172.18.0.18.40241: F 953:953(0) ack 10 win 46
15:54:54.327153 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: . ack 954 win 61
15:54:54.533685 IP 172.18.0.18.40241 > 184.73.230.13.etlservicemgr: F 10:10(0) ack 954 win 61
15:54:54.543304 IP 184.73.230.13.etlservicemgr > 172.18.0.18.40241: . ack 11 win 46