I believe so.

You only give your posting key, so the worst they could do is drain your voting power.

That is part of the magic of multiple keys like steem has. :-)