Cannot access Self IP from another remote subnet.

I have an LTM-3600 with weird issues in regards to accessing the Self-IP from another subnet. It's interface is set on an untagged interface and the IP can be reached from the same subnet. But if I try to access it across from another network it does not respond. I have confirmed that those on the same network are accessible from the remote network and I can even ping to another subnet from the LTM itself but reaching it from the remote network is not possible. Seems to be getting dropped at the LTM somewhere but I don't know where. I even did a full factory reset and just added the interface and the self IP, same issue. I am not sure what I am missing. tcpdumps do show it receive traffic but it seems to drop it. I just see a bunch of retrans.