ByteDance, the operator of TikTok, purchased approximately 100,000 A100 and H800 (a nerfed version of the H100) at a cost of approximately $10,000 per unit.
A100, H100, etc. are GPU product names for high computation made by Nvidia.
It's true that I couldn't buy it in September of last year due to regulations on companies related to China... but I've now received what I ordered in August.
So what about NVIDIA’s latest GPU H100?
Performance is better than any existing artificial intelligence computing unit.
One H100 GPU is plugged into one rack → One rack consumes 3,300W of electricity.
The price is also outrageous, tens of thousands of dollars (list price...)
Nevertheless, supply of H100 is impossible due to too many orders.
Currently, the only alternative that can be considered a substitute is TPU, but in fact, there is no substitute.
Even if a replacement product is released, will the performance be as good as NVIDIA? almost impossible
As artificial intelligence becomes more common, computations become more complex, and the size of models increases, GPU shortages continue to occur.
