Hacker News
points by DamnInteresting 4 days ago | 0 comments
> The mathocalypse didn't happen because they found better training data somewhere.

There are reasons to suspect that OpenAI may have intentionally or unintentionally trained on chat logs from mathematicians--mathematicians who were actively using OpenAI to try to to solve the same problems themselves.[1] If those mathematicians were on the right track, and getting close to a solution, that could be classified as finding "better training data somewhere."

[1] https://cybernews.com/ai-news/openai-accused-stealing-anothe...

[–] Shaanveer 4 days ago
sorry but given how post-training actually works, there's essentially no direct way in which literal PII-scrubbed data made its way into a production oai datamix for RL warmup purposes in 2026 to the extent this data has influence, it's indirect/at the level of process decisions. what i am trying to say more specifically is, the folk model some people seem to still have about ai companies "directly training on user transcripts" in this naive fashion is firstly wrong, and secondarily, would be counterproductive as a strategy for continued progress "transcript shows human trying to do an exotic thing evals don't currently cover -> build synth constructions that broadly cover its genre of problem class -> RL on the verifier set designed to cover the failure" that's the loop... the """flywheel""" is... diagnostics! wow! and so this kind of process improvement driven use of data has an obvious diffuse causal influence on what happens during training, right? but ~none of that process influence looks like "specific mathematician's specific intuitions leak into the training data".
[–] grey-area 4 days ago
It’s perfectly plausible that unscrupulous people at OpenAI (and that’s the culture right from the top) searched user transcripts for relevant approaches to problems they were working on, or searched them for problems to look at, and nudged models based on that.

I agree it’s unlikely this happened by accident, or entered training data (though not impossible), but it could certainly be within the context agents were using when tackling problems.

We have no evidence either way, but they had all the data they would need to do this.

[–] RugnirViking 4 days ago
saw an interview from the mathematician involved, Tristan Buckmaster, on the numberphile yt channel, and he said he thinks it was more a case of people at anthropic leaking it in person to openai. Apparently with a hint about the area they were looking at it could have been easy (ish) to get the same approach, and indeed the paper openai released for Navier–Stokes uses their approach