The biggest reason why I often prefer to work alone, especially when I have a task job assigned to me, is that people will always reason differently, and there will often be people that will never match your energy to do the job efficiently and effectively

I understand but we have to work with others mostly, if not in our jobs then just in general society. It's important to learn the skills to work around issues, work with others and know when to cut them lose.

But I have come to understand that working with people will always be inevitable

Yep.

I get easily irritated by drawbacks, so I normally express my frustration and then eventually seem unreasonable.

This happens for sure, but the best leaders know it's happening, that they do it, and make rapid changes as being like this isn't conducive to being a good leader.

I know that I really cannot control their motives and attitudes

Nope, but you can empower them to find better attitudes.

Thanks for your comment and candour.