Original link: Musk's xAI Supercomputer Goes Online With 100,000 Nvidia GPUs / PCMag.
100000 Nvidia H100. Power will be doubled later by adding 50000 H200.
Musk is proud that the project only took 122 days. And I can understand that - it is indeed impressive to complete that big a project that fast.
I do not understand naming it Colossus. I am sure that Musk has read the book and it is not funny.