It is absolutely healthy and sensible to set up boundaries and prune unhealthy relationships/habits/beliefs from one's life. Congratulations!
If something or someone is holding you down, burn that bridge. There is a secret zipline down stream to get back, in the unlikely event that you made a mistake.