You shouldn't see it as just a random group of people following random accounts just to vote because you are part of it. That's not the right way to think about this platform, in my opinion.
Just connect with the people/tags you are interested in yourself and it will all come naturally over time. More people are joining every day, you are sure to make connections that you can relate with instead of just random groups blindly giving their votes to their own group of authors.
I hope you understand my viewpoint. I don't like voting on something just cause all others are voting on it because of a reason other than the content quality.
Yep, I understand what you are saying.