Tencent Hy @TencentHunyuan

Less size, same intelligence. [引用 @ZhihuFrontier]: How Tencent Packed a 770B-Parameter Model into 214 GiB Shrinking Hy4 preview's weights from roughly 1.5TB to 214 GiB is one challenge. Preserving useful capabilities and practical inference speed is another. How did @TencentHunyuan tackle both? Zhihu contributor yghstill, a member of Tencent Hunyuan's quantization team, explains the engineering behind it. The parameter count remains 770B; the com…

X40 d ago
Read original ↗