How World Models Could Work
LeCun outlines a potential framework for human-level AI based on world models:
- Input: The system receives a base representation of the world (e.g., video of a room) and relevant memory.
- World Model Processing: The AI uses this information to predict how the world will change over time.
- Objective Setting: The system is given specific goals (e.g., clean the room) and important constraints (e.g., don't harm humans).
- Action Planning: The world model determines a sequence of actions to achieve the objectives while respecting the constraints.