Ok I have been playing around with this and have come to the conclusion that I can connect to either SQL instance as long as the port has been specified because there is only one IP on the server.

i.e I can connect to the same instance by putting in SERVER,port or SERVER\INSTANCE,port