Got it.
There was a different database role that was a member of the role I was trying to remove from the selected db users. I needed those db users in the one role and not in the other, so whenever I added the user to the role they were required to have, they picked up the other role they weren't supposed to have because the required role was a member of the non-required role in the database.
Does that make sense? If not I'll re-explain so if anyone else has this problem it can help them.
Thanks,
JimiHaze