That would be pretty sad to be honest :).
We did not implement this in the first version since we don´t think people will set a bounty without voting any comments, but the money excluding the fee will be sent back to the issuer within the next update if there is no engagement.