Tencent Hy4 Preview: A 770B Open AI Model That Activates Only 49B Parameters
Tencent has released Hy4 Preview, a new flagship large language model aimed at demanding productivity tasks including software development, document analysis, financial work and scientific research. The headline figure is difficult to ignore: 770 billion parameters. But Hy4 Preview does not use all of them every time it generates a token. Thanks to a Mixture-of-Experts…