Downvotes have been poorly used very often. Even if they are used correctly most of the time (which I don't know if they are), the times that they aren't used correctly drive away a lot of users and create a lot of frustration. I'd much rather have community notes.