There are 3 nodes involved here, 

1 Priamry

2 Secondaries

Only one of the secondaries is out of sync.

Removing the Secondarires from the AG would need to done on the Primary?

This would remove it from the Secondary that is working fine too?
Which is what I'm trying to avoid.