Your perceived punishment is just that, a particular viewpoint. Not upvoting is not the same as punishment.

Downvoting would be punishment.

I just (manually) went through your history for over 2 months. The most I saw, as far as whales are concerned, was @nextgencrypto and @enki downvoting separate comments.