It sounds like you want:

a perfect marriage
a exciting single life

Its like 2 situations that do not go hand in hand. You can only have one of them. I will not tell you what I think you schould do, but I will tell you some of my own experiences.

I have been married and are now divorsed. I think the reason we divorsed was my ex wife, wanting to experience other partners. We have a son and I know its painfull for him that we are divorced.

In the last years I have had many other partners, and I got to live out this “wild fase” with many nice woman in my life. But if I could choose then I would have chosen to stayed marriage back in time. It was nice to have many sexual partners and it made me feel very strong as a man. All the time I had the excuse that I was not me that wanted to split up the marriage.

Its an difficult situation, as I do not believe I polyamory. I do not believe that it works for longer periods of time (I could be wrong)...

There is a huge change that you and your husband will disconnect in some form, if you begin to have sex with other people.

Not sure my post help you, other then to realize the truth about your situation.