I agree, however since time is such a limited commodity I believe it's good to set a deadline or milestones at which you review and check in with yourself to see if the time is well spent here.
You may think so even tough you haven't made your financial goal. You may simply enjoy yourself, which is a great reason. As long as it's a conscious decision.