Remove user from the group