Success is a relative thing, but I agree with your definition of being successful, because you are doing what you like and most importantly, you can follow your family closely.

Personally, I think that the trade-off between work / leisure is overrated in our society, as you said, I'm not ready to "waste" my free time working for some dollars instead of living my life with the people I love.