I agree with you that implementing downvote for witness voting could enhance the system. But for now, I would like to start the basic step first.