... when you participate together such as lawn bowling or even just eating out, you get to talk together. That seems to have a positive effect later at work.
Or you detest them even more.
It really depends on the personalities involved.
The best one might do is simply to behave in as professional a manner as possible toward every colleague, betraying as little as possible any personal dislike.