Yeah, trust is of course a big concern too. As well as potential for someone very wealthy to buy huge amounts of Steem Power and vote for witnesses that follows their agenda (sounds like a conspiracy, but it's worth debating and figuring out in my opinion).

I honestly don't know what the ramifications of an attack towards the witnesses would be, but you are probably right that it would most likely be downtime for the blockchain and not loss of data.