DeepSeek is building largest huawei cluster on earth with 160k Ascend chips in inner mongolia

DeepSeek will install 160,000 Huawei Ascend-950DT chips in a data center in Inner Mongolia, which is the world’s largest known cluster of Huawei chips, used exclusively for inference (serving online requests). Model training is still done using Nvidia chips.

Huawei cannot provide all the chips for over a year because of manufacturing capacity and a shortage of memory chips. CXMT makes HBM3E memory in low volume, and it lags behind Samsung, SK Hynix and Micron by 3 to 5 years. But the gap is closing, albeit slowly.