Hacker News
points by syllogism 5 days ago | 0 comments
They make it sound like they improve Qwen by reading raw weights. They don't. In fact the experiments that use raw weights have very little to do with the experiments that work on larger models.
[–] kenjackson 5 days ago
The paper makes it ridiculously clear what they do and don’t do. And they make the reasons why clear too. There is absolutely nothing interesting in this new article.
[–] syllogism 5 days ago
I don't understand how anyone can read the abstract and think it's "ridiculously clear" that the "Just by looking at the raw weights," doesn't apply to the Qwen experiment.
[–] tedivm 5 days ago
You are right, if you literally just read a one paragraph description you will get less details than reading the whole post, but most of us read more than just the one paragraph. There is some actual interesting stuff in the paper, including the portion where they did edit the weights to fix the looping bug.
[–] malfist 5 days ago
> most of us read more than just the one paragraph

Most of us barely read the title

[–] tedivm 4 days ago
Honestly, that's on them. Coddling people who are too intellectually lazy to read the entire article isn't helping anyone.
[–] kenjackson 5 days ago
It says this “All of this is possible without allowing Astra to write training loops. It uses its reasoning to figure out what each part of a neural network computes, or should compute, and changes the weights accordingly.”

This seems 100% accurate to me. What is a lie here?

[–] stymaar 5 days ago
Nobody said they outright “lied”, most misleading statements are “100% accurate” yet are designed to mislead the reader.

And when you see the reactions in the HN comment to the original article, it's pretty clear that most people have indeed been mislead.

[–] nextaccountic 5 days ago
The article is not misleading either.

The title is but then OP should talk about just the title instead

[–] stymaar 5 days ago
The title and the abstract are, the article is fine (but disappointing, given the excitement built up by the title + abstract)
[–] nater5000 4 days ago
>They make it sound like they improve Qwen by reading raw weights.

Weird, because they explicitly and clearly explain exactly what they did and didn't do.

Did you actually read the original post or just take the word of some HN comments at face value?

[–] PunchTornado 3 days ago
did you read the abstract?