Sources told Bloomberg that OpenAI's new Orion LLM has experienced performance limitations. This means the new LLM would outperform the firm's existing models, but it does not mean there will be a significant leap in development, like that of GPT-3 to GPT-4.

As of late summer, for example, Orion fell short when trying to answer coding questions that it hadn't been trained on, the people said. Overall, Orion is so far not considered to be as big a step up from OpenAI's existing models as GPT-4 was from GPT-3.5, the system that originally powered the company's flagship chatbot, the people said. -BBG