"He asked why I was still waiting, then I said I don't have a penny on me to board another bus. He told me to get on the bus again, "

That was really a great risk to take with such a reckless driver. If I was to be in such situation i rather board another bus and pay with a transfer from my bank account.

Since you mention you still some money in your account.