The protocol doesn't hide voters, it hides their votes.

The only downside is that a client needs to be open to reveal votes. This doesn't have to be a continuous process. Mature votes could be revealed when a user logs in.