TikTok operator ByteDance has purchased about 100,000 A100s and H800s (a nerfed version of the H100), each for about $10,000.
A100, H100, etc. are GPU product names for high-performance computing made by Nvidia.
It's true that I couldn't buy it because of the regulations on Chinese companies in September last year... I just received the one I ordered in August.
What about Nvidia's latest GPU, the H100?
Performance is better than any existing AI computing unit.
H100 GPU is installed 1 per rack → One rack consumes 3,300W of electricity
The price is also at a heinous level, tens of thousands of dollars (market price..)
However, the number of H100 orders is too high to supply
The only thing that can be considered a substitute is TPU, but in reality, there is no substitute.
Even if a substitute comes out, will it perform as well as Nvidia? It's almost impossible.
As artificial intelligence becomes more widespread and computations become more complex, and the scale of models grows, GPU shortages will continue to occur.
📚 Welcome to Haebom's archives. --- I post articles related to IT 💻, economy 💰, and humanities 🎭. If you are curious about my thoughts, perspectives or interests, please subscribe. Would you like to be notified when new articles are posted? 🔔 Yes, that means subscribe. haebom@kakao.com
