"That said, perception often matters more than reality and we must design systems that are perceived to be fair even if they are logically and “objectively” less fair from the perspective of mathematics, deductive reasoning, and first principles."
Herein lies the problem, dan.
This is where the swindling occurs, because people are being sold lies - hence the frustration.