Hacker News

points by adastra22 3 days ago | 0 comments

As of today, the training data the originates from humans represents a vanishingly small portion of the total training. The vast majority of training - how many 9’s is a trade secret - of a frontier model is synthetic RLVR data. That’s how they got good at this.

[–] drdeca 3 days ago

I thought only like a third (maybe 2/3?) of the training was RLVR?

[–] adastra22 2 days ago

It’s an increasing portion of training month by month. As of this last summer, pretty much all new GPU hardware is going to a combination of inference and post-training model tuning, generally RLVR.