I guess it's pretty difficult. I think you shouldn't have a problem in the long term if you keep your content's quality consistent.
Just keep on doing what you are doing - similarly to how it is a good idea to accumulate coins in the bear market, in anticipation of a bull market.