Original link: Elon Musk plans to scale the xAI supercomputer to a million GPUs — currently at over 100,000 H100 GPUs and counting / TomsHardware.
xAI has 100000 GPU's and are in the process to upgrade to 200000 GPU's. But they will not stop there. Elon Musk want to upgrade to 1 million GPU's.