Original link: Meta is using more than 100,000 Nvidia H100 AI GPUs to train Llama-4 — Mark Zuckerberg says that Llama 4 is being trained on a cluster “bigger than anything that I’ve seen” / Tom's Hardware.
xAI has 100000 GPU now and plan on upgrading to 200000. Meta has more than 100000 now and plan on upgrading to 500000.