Nvidia is developing its Trillion-Parameter Nemotron 4, but Chinese are ahead!

Nvidia has announced Nemotron 4 — an open-weight model with at least 1 trillion parameters. These are the parameters that make up a model’s ‘intelligence’. It will not be released before fall 2026. But their Chinese counterparts have left them behind by a huge margin.

1The Gap With Chinese Labs

Moonshot AI has launched Kimi K3 which has 2.8 trillion parameters. DeepSeek V4 Pro has 1.6 trillion parameters. On the major metric of the AI industry — the Artificial Analysis Intelligence Index (AAII), Nemotron 3 Ultra, the previous champion, has a score of 38 whereas Kimi K3 has a score of roughly 60. That’s a difference of 22 points which isn’t noise.

Nvidia is throwing money at this problem. They are tripling their investments in training their own models in the cloud to $28 billion until 2031. But they still haven’t matched the quality of the Chinese models.

2What This Means for the Industry

Nvidia continues to be the unrivaled king of AI chips. However, that doesn’t mean they’ll continue to lead in the AI field. The Chinese are beating them in the scale-to-quality game in the open-weight segment. And they are doing it with open weights. That’s the future and the present.