This turned out to be the problem:

http://connect.microsoft.com/SQLServer/feedback/details/273892/replication-agents-hang-when-a-host-has-a-large-number-of-agents-running-on-it

Just migrated to the new cluster, did not change the replication architecture. Everything worked on the old one.