[Kimi K4 is larger than K3, but the dark side of the moon is stuck due to NVIDIA chips] According to monitoring by Beating, the dark side of the moon has begun discussions about Kimi K4, with the new model expected to significantly surpass K3 in scale. However, the release date for K4 has not yet been announced, as the company is still searching for more NVIDIA Blackwell chips to prepare computational power for subsequent development. The Information reports that part of K3's training was actually completed in China, contrary to claims by U.S. officials that it was entirely conducted in a data center in Thailand. The dark side of the moon utilized Blackwell chips from at least two Chinese cloud providers. Since no single provider could supply sufficient computational power, the team had to connect a large number of eight-card servers and optimize communication between different suppliers and data centers. This patchwork solution enabled the dark side of the moon to complete K3 with 2.8 trillion parameters, but it also exposed challenges for K4. The U.S. has banned the export of Blackwell chips to China and is investigating how companies like the dark side of the moon are acquiring advanced chips. Computational power for K3's operations remains tight after its launch. The dark side of the moon heavily relies on NVIDIA H20 chips, with each deployment recommending at least 64 chips connected. Following a surge in user demand, the company suspended new subscriptions in less than 48 hours. Domestic chips are currently unable to fill the gap. Large servers capable of connecting dozens or even hundreds of domestic chips are in short supply, with customers facing wait times of up to six months. K4 currently has direction but no timeline. Its potential scale and the start of training may depend on how many Blackwell chips the dark side of the moon can still secure. [Original link]