Ok well that's just annoying.

I failed over one more time before tearing down replication to start again and now it's working. I hadn't changed anything. Thanks for the tips any how.