Limitations have been faced in many forms in the past. those who faced them either adapted, persisted or fell.

Steemit is at such a juncture in several respects - and while there are some developments occuring, it persists on remaining static at its core. It may prevail. It may not. Time will tell. :c)

Agreed that a database over and above the oresent data layer would be beneficial - if done right. A good suggestion.