Hacker News

points by foopod 3 days ago | 0 comments

> LLMs are getting very good at this and surpassing what humans have been able to prove.

But if the reverse were true it would be impossible to prove. AI is trained on all of humanities solutions - LLMs stand on the shoulders of giants, not the other way around.

[–] adastra22 3 days ago

As of today, the training data the originates from humans represents a vanishingly small portion of the total training. The vast majority of training - how many 9’s is a trade secret - of a frontier model is synthetic RLVR data. That’s how they got good at this.

[–] drdeca 3 days ago

I thought only like a third (maybe 2/3?) of the training was RLVR?

[–] adastra22 2 days ago

It’s an increasing portion of training month by month. As of this last summer, pretty much all new GPU hardware is going to a combination of inference and post-training model tuning, generally RLVR.

[–] gfosco 3 days ago

We do, too, as we have also been trained from the same prior solutions.