GameNGen is a new video game engine that is powered by a neural model able to generate gameplay based on different prompts. In the case of this recreation of DOOM, GameNGen is essentially learning to play the game as masterfully as possible, dodging bullets, slaying demons, and interacting with the environment.

Once the AI has understood exactly how to play the game, GameNGen then uses a diffusion model to recreate a perfect image of the content it has just consumed. The game is produced in real-time with the AI model generating each individual frame based on the last one.