The problem I'm seeing now is as follows:
I have two servers communicating between them just fine.
Each server is behind a different F5 LTM, ping works fine and connectivity seems to be OK.
However, when I'm trying to run a PowerShell command from serverA => serverB or vice versa, it simply fails.
I've confirmed that it works if one of the servers is in front of its F5.