Working now, and you were correct, the issue was with IP addresses.

The IP addresses used needed to be the internal IP addresses, not the public external IPs. So for example one of our addresses was 99.999.9.102:443, it should have been instead 192.168.100.102:443. Stupid mistake on my part.