Hacker News
points by zozbot234 3 days ago | 0 comments
For reference, Hy4 Preview was a 770B model (49B active) + 10B MTP (0.7B active). Not nearly the same potential as Kimi K3 (which is 2.8T) wrt. real-world knowledge - which matters at the new frontier of advanced research and scholarly tasks. Coding benchmarks are pretty much universally saturated by now which is why newer intelligence indexes have chosen to weigh tasks quite differently.
[–] segmondy 3 days ago
I'm not talking about Hy4 Preview. I'm talking about Hy4, it was announced this morning. - https://hy.tencent.ai/research/hy4
[–] zozbot234 3 days ago
Is there any evidence that Hy4 proper is a new architecture compared to Hy4 Preview? Mind you, the Preview page explicitly says "we're not even done with pretraining, let alone model fine-tuning".
[–] segmondy 3 days ago
Oh ok, I see what you mean, you are just comparing them by weight. In that case, it tracks that K3.1 will have more knowledge. It's the same architecture. I'm just saying that for how large K3.1 is, intelligence by weight, it's not crushing DSV4.1 or Hy4