The Limitations of Current AI Architectures
LeCun explains that the core limitation of today's AI lies in their fundamental architecture:
- Large Language Models (LLMs) like ChatGPT are essentially one-dimensional predictors, focused on predicting the next token (word or part of a word) in a sequence.
- Image and video AI models are two-dimensional predictors, working to predict the next pixel.