Yes that is a huge fallacy. If one priest declares himself holy and the authority that speaks with the divine, then that assumes that everything he does is holy. Yet we can obviously see how corrupt and immoral they can be.

Thus authority, once again fails. It doesnt matter if its religious or political.