The world’s most advanced AI chatbot
The Colossus AI training cluster comprises an interconnected network of 100,000 NVIDIA Hopper GPUs. These use a unified Remote Direct Memory Access network.

The network uses Nvidia’s Spectrum-X technology for low latency. Data moves directly between nodes without being rerouted toward the operating system, allowing Colossus to process the massive amounts of data required to train Grok.

“Across all three tiers of the network fabric, the system has experienced zero application latency degradation or packet loss due to flow collisions,” Nvidia explained in its statement. “It has maintained 95% data throughput enabled by Spectrum-X congestion control.”