The excuse I have heard is: "they did [some bad thing to me], so this is my way of getting back at them" or "this is my way of taking a break from them".
Honestly if you are not going to go full "open" as @ryan-singer just said, that is a total double standard.
Indeed. Two wrongs don't make a right.
Best to just leave.