Tencent Hy4 Architecture: Why 770B Isn’t the Point

A 770-billion-parameter model sounds like a brute-force scaling story. The Tencent Hy4 architecture tells a more interesting one: its backbone activates 49 billion parameters for each token, then keeps narrowing the work through sparse attention, reused token indexes, and speculative…








