I would use tracert, ping, and pathping to look for performance issues. This sounds like a network problem, it's not going to be super easy to diagnose.

I would also increase your session timeout setting in the AG from the default of 60 to something higher like 120 or 240 and see what happens.