OpenAI's Next-Gen Model Hits Performance Wall: Report
OpenAI's Latest Model Exposes Limitations in Traditional Scaling Approach, Prompting Split into Specialized AI Tracks.
OpenAI's upcoming artificial intelligence model is delivering smaller performance gains than its predecessors, sources familiar with the matter told The Information.
Employee testing reveals Orion achieved GPT-4 level performance after completing only 20% of its training, The Information reports.
The quality increase from GPT-4 to the current version of GPT-5 seems to be smaller than that of GPT-3 to GPT-4.
“Some researchers at the company believe Orion isn’t reliably better than its predecessor in handling certain tasks, according to the (OpenAI) employees,” The Information reported. “Orion performs better at language tasks but may not outperform previous models at tasks such as coding, according to an OpenAI employee.”
While Orion getting closer to GPT-4 at 20% of its training might sound impressive to some, it is important to note that the early stages of AI training typically deliver the most dramatic improvements, with subsequent phases yielding smaller gains.
So, the remaining 80% of training time isn’t likely to produce the same magnitude of advancement seen in previous generational leaps, sources said.
Article