There's a saying here: a bird at hand is worth 50 in the bush and all that glitters is not gold.
We are not to decide what's bad for you, you already know we you consider as immoral. So, act accordingly. It's a good thing that you said your husband is at least not doing badly, learn to appreciate what you have and add spices to your sex life with your husband.