Sort:  

Public and private keys go in pairs. So you need to have both. A hacker, if he breaks your private key, may change the entire pair of public/private into something new.

So the backing up is more retrieval purposes than security purposes. I think I understand. Thank you for your time.