"Sky high valuation of companies like OpenAI and Microsoft are largely based on the notion that LLMs will, with continued scaling, become artificial general intelligence," said AI expert Gary Marcus, who predicted the wall in 2022. "There is no principled solution to hallucinations in systems that traffic only in the statistics of language without explicit representation of facts and explicit tools to reason over those facts."

Despite these reports, Altman said in the AMA that AGI (Artificial General Intelligence) is "achievable with current hardware."

Whatever the case, OpenAI has been focused on fleshing out more capabilities with existing models and shipping features that largely rely on variations of current LLMs.